00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2412 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3673 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.060 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.061 The recommended git tool is: git 00:00:00.062 using credential 00000000-0000-0000-0000-000000000002 00:00:00.064 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.094 Fetching changes from the remote Git repository 00:00:00.100 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.160 Using shallow fetch with depth 1 00:00:00.160 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.160 > git --version # timeout=10 00:00:00.209 > git --version # 'git version 2.39.2' 00:00:00.209 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.237 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.237 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:08.526 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:08.536 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:08.547 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:08.548 > git config core.sparsecheckout # timeout=10 00:00:08.558 > git read-tree -mu HEAD # timeout=10 00:00:08.573 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:08.594 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:08.595 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:08.721 [Pipeline] Start of Pipeline 00:00:08.735 [Pipeline] library 00:00:08.737 Loading library shm_lib@master 00:00:08.737 Library shm_lib@master is cached. Copying from home. 00:00:08.757 [Pipeline] node 00:00:08.768 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:08.770 [Pipeline] { 00:00:08.780 [Pipeline] catchError 00:00:08.781 [Pipeline] { 00:00:08.795 [Pipeline] wrap 00:00:08.806 [Pipeline] { 00:00:08.814 [Pipeline] stage 00:00:08.816 [Pipeline] { (Prologue) 00:00:09.074 [Pipeline] sh 00:00:09.357 + logger -p user.info -t JENKINS-CI 00:00:09.379 [Pipeline] echo 00:00:09.381 Node: GP11 00:00:09.389 [Pipeline] sh 00:00:09.691 [Pipeline] setCustomBuildProperty 00:00:09.706 [Pipeline] echo 00:00:09.708 Cleanup processes 00:00:09.714 [Pipeline] sh 00:00:10.002 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.002 3785185 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.020 [Pipeline] sh 00:00:10.309 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:10.309 ++ grep -v 'sudo pgrep' 00:00:10.310 ++ awk '{print $1}' 00:00:10.310 + sudo kill -9 00:00:10.310 + true 00:00:10.324 [Pipeline] cleanWs 00:00:10.334 [WS-CLEANUP] Deleting project workspace... 00:00:10.334 [WS-CLEANUP] Deferred wipeout is used... 00:00:10.341 [WS-CLEANUP] done 00:00:10.345 [Pipeline] setCustomBuildProperty 00:00:10.362 [Pipeline] sh 00:00:10.650 + sudo git config --global --replace-all safe.directory '*' 00:00:10.751 [Pipeline] httpRequest 00:00:11.977 [Pipeline] echo 00:00:11.979 Sorcerer 10.211.164.101 is alive 00:00:11.990 [Pipeline] retry 00:00:11.992 [Pipeline] { 00:00:12.007 [Pipeline] httpRequest 00:00:12.012 HttpMethod: GET 00:00:12.013 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.013 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.027 Response Code: HTTP/1.1 200 OK 00:00:12.028 Success: Status code 200 is in the accepted range: 200,404 00:00:12.028 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:15.300 [Pipeline] } 00:00:15.320 [Pipeline] // retry 00:00:15.327 [Pipeline] sh 00:00:15.611 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:15.629 [Pipeline] httpRequest 00:00:16.260 [Pipeline] echo 00:00:16.262 Sorcerer 10.211.164.101 is alive 00:00:16.272 [Pipeline] retry 00:00:16.274 [Pipeline] { 00:00:16.288 [Pipeline] httpRequest 00:00:16.293 HttpMethod: GET 00:00:16.294 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.295 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.306 Response Code: HTTP/1.1 200 OK 00:00:16.307 Success: Status code 200 is in the accepted range: 200,404 00:00:16.307 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:19.907 [Pipeline] } 00:01:19.928 [Pipeline] // retry 00:01:19.938 [Pipeline] sh 00:01:20.226 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:22.773 [Pipeline] sh 00:01:23.060 + git -C spdk log --oneline -n5 00:01:23.060 c13c99a5e test: Various fixes for Fedora40 00:01:23.060 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:23.060 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:23.060 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:23.060 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:23.084 [Pipeline] } 00:01:23.120 [Pipeline] // stage 00:01:23.127 [Pipeline] stage 00:01:23.129 [Pipeline] { (Prepare) 00:01:23.139 [Pipeline] writeFile 00:01:23.148 [Pipeline] sh 00:01:23.429 + logger -p user.info -t JENKINS-CI 00:01:23.442 [Pipeline] sh 00:01:23.726 + logger -p user.info -t JENKINS-CI 00:01:23.740 [Pipeline] sh 00:01:24.026 + cat autorun-spdk.conf 00:01:24.026 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.026 SPDK_TEST_NVMF=1 00:01:24.026 SPDK_TEST_NVME_CLI=1 00:01:24.026 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.026 SPDK_TEST_NVMF_NICS=e810 00:01:24.026 SPDK_RUN_UBSAN=1 00:01:24.026 NET_TYPE=phy 00:01:24.034 RUN_NIGHTLY=1 00:01:24.039 [Pipeline] readFile 00:01:24.065 [Pipeline] withEnv 00:01:24.067 [Pipeline] { 00:01:24.080 [Pipeline] sh 00:01:24.369 + set -ex 00:01:24.369 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:24.369 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:24.369 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.369 ++ SPDK_TEST_NVMF=1 00:01:24.369 ++ SPDK_TEST_NVME_CLI=1 00:01:24.369 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.369 ++ SPDK_TEST_NVMF_NICS=e810 00:01:24.369 ++ SPDK_RUN_UBSAN=1 00:01:24.369 ++ NET_TYPE=phy 00:01:24.369 ++ RUN_NIGHTLY=1 00:01:24.369 + case $SPDK_TEST_NVMF_NICS in 00:01:24.369 + DRIVERS=ice 00:01:24.369 + [[ tcp == \r\d\m\a ]] 00:01:24.369 + [[ -n ice ]] 00:01:24.369 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:24.370 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:24.370 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:24.370 rmmod: ERROR: Module irdma is not currently loaded 00:01:24.370 rmmod: ERROR: Module i40iw is not currently loaded 00:01:24.370 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:24.370 + true 00:01:24.370 + for D in $DRIVERS 00:01:24.370 + sudo modprobe ice 00:01:24.370 + exit 0 00:01:24.381 [Pipeline] } 00:01:24.398 [Pipeline] // withEnv 00:01:24.403 [Pipeline] } 00:01:24.420 [Pipeline] // stage 00:01:24.430 [Pipeline] catchError 00:01:24.433 [Pipeline] { 00:01:24.447 [Pipeline] timeout 00:01:24.447 Timeout set to expire in 1 hr 0 min 00:01:24.448 [Pipeline] { 00:01:24.463 [Pipeline] stage 00:01:24.465 [Pipeline] { (Tests) 00:01:24.480 [Pipeline] sh 00:01:24.767 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.767 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.767 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.767 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:24.767 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.767 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.767 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:24.767 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.767 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.767 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.767 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:24.767 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.767 + source /etc/os-release 00:01:24.767 ++ NAME='Fedora Linux' 00:01:24.767 ++ VERSION='39 (Cloud Edition)' 00:01:24.767 ++ ID=fedora 00:01:24.767 ++ VERSION_ID=39 00:01:24.767 ++ VERSION_CODENAME= 00:01:24.767 ++ PLATFORM_ID=platform:f39 00:01:24.767 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:24.767 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:24.767 ++ LOGO=fedora-logo-icon 00:01:24.767 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:24.767 ++ HOME_URL=https://fedoraproject.org/ 00:01:24.767 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:24.767 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:24.767 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:24.767 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:24.767 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:24.767 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:24.767 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:24.767 ++ SUPPORT_END=2024-11-12 00:01:24.767 ++ VARIANT='Cloud Edition' 00:01:24.767 ++ VARIANT_ID=cloud 00:01:24.767 + uname -a 00:01:24.767 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:24.767 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:25.702 Hugepages 00:01:25.702 node hugesize free / total 00:01:25.702 node0 1048576kB 0 / 0 00:01:25.702 node0 2048kB 0 / 0 00:01:25.702 node1 1048576kB 0 / 0 00:01:25.702 node1 2048kB 0 / 0 00:01:25.702 00:01:25.702 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:25.703 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:25.703 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:25.703 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:25.703 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:25.703 + rm -f /tmp/spdk-ld-path 00:01:25.703 + source autorun-spdk.conf 00:01:25.703 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.703 ++ SPDK_TEST_NVMF=1 00:01:25.703 ++ SPDK_TEST_NVME_CLI=1 00:01:25.703 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.703 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.703 ++ SPDK_RUN_UBSAN=1 00:01:25.703 ++ NET_TYPE=phy 00:01:25.703 ++ RUN_NIGHTLY=1 00:01:25.703 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:25.703 + [[ -n '' ]] 00:01:25.703 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.961 + for M in /var/spdk/build-*-manifest.txt 00:01:25.961 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:25.961 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.961 + for M in /var/spdk/build-*-manifest.txt 00:01:25.961 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:25.961 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.961 + for M in /var/spdk/build-*-manifest.txt 00:01:25.961 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:25.961 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.961 ++ uname 00:01:25.961 + [[ Linux == \L\i\n\u\x ]] 00:01:25.961 + sudo dmesg -T 00:01:25.961 + sudo dmesg --clear 00:01:25.961 + dmesg_pid=3786469 00:01:25.961 + [[ Fedora Linux == FreeBSD ]] 00:01:25.961 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.961 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.961 + sudo dmesg -Tw 00:01:25.961 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:25.961 + [[ -x /usr/src/fio-static/fio ]] 00:01:25.961 + export FIO_BIN=/usr/src/fio-static/fio 00:01:25.961 + FIO_BIN=/usr/src/fio-static/fio 00:01:25.961 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:25.961 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:25.961 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:25.961 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.961 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.961 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:25.961 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.961 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.961 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.961 Test configuration: 00:01:25.961 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.961 SPDK_TEST_NVMF=1 00:01:25.961 SPDK_TEST_NVME_CLI=1 00:01:25.961 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.961 SPDK_TEST_NVMF_NICS=e810 00:01:25.961 SPDK_RUN_UBSAN=1 00:01:25.961 NET_TYPE=phy 00:01:25.961 RUN_NIGHTLY=1 20:51:22 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:25.961 20:51:22 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:25.961 20:51:22 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:25.961 20:51:22 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:25.961 20:51:22 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:25.961 20:51:22 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.961 20:51:22 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.961 20:51:22 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.961 20:51:22 -- paths/export.sh@5 -- $ export PATH 00:01:25.961 20:51:22 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.961 20:51:22 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.961 20:51:22 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.961 20:51:22 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732737082.XXXXXX 00:01:25.961 20:51:22 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732737082.Bk6USz 00:01:25.961 20:51:22 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.961 20:51:22 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:25.961 20:51:22 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:25.962 20:51:22 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.962 20:51:22 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.962 20:51:22 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.962 20:51:22 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:25.962 20:51:22 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.962 20:51:22 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:25.962 20:51:22 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.962 20:51:22 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.962 20:51:22 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.962 20:51:22 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.962 Wed Nov 27 07:51:22 PM UTC 2024 00:01:25.962 20:51:22 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:25.962 LTS-67-gc13c99a5e 00:01:25.962 20:51:22 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:25.962 20:51:22 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:25.962 20:51:22 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:25.962 20:51:22 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:25.962 20:51:22 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:25.962 20:51:22 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.962 ************************************ 00:01:25.962 START TEST ubsan 00:01:25.962 ************************************ 00:01:25.962 20:51:22 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:25.962 using ubsan 00:01:25.962 00:01:25.962 real 0m0.000s 00:01:25.962 user 0m0.000s 00:01:25.962 sys 0m0.000s 00:01:25.962 20:51:22 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:25.962 20:51:22 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.962 ************************************ 00:01:25.962 END TEST ubsan 00:01:25.962 ************************************ 00:01:25.962 20:51:22 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:25.962 20:51:22 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:25.962 20:51:22 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:25.962 20:51:22 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:25.962 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:25.962 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:26.219 Using 'verbs' RDMA provider 00:01:36.782 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:46.770 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:46.770 Creating mk/config.mk...done. 00:01:46.770 Creating mk/cc.flags.mk...done. 00:01:46.770 Type 'make' to build. 00:01:46.770 20:51:42 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:46.770 20:51:42 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:46.770 20:51:42 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:46.770 20:51:42 -- common/autotest_common.sh@10 -- $ set +x 00:01:46.770 ************************************ 00:01:46.770 START TEST make 00:01:46.770 ************************************ 00:01:46.770 20:51:42 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:46.770 make[1]: Nothing to be done for 'all'. 00:01:56.869 The Meson build system 00:01:56.869 Version: 1.5.0 00:01:56.869 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:56.869 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:56.869 Build type: native build 00:01:56.869 Program cat found: YES (/usr/bin/cat) 00:01:56.869 Project name: DPDK 00:01:56.869 Project version: 23.11.0 00:01:56.869 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:56.869 C linker for the host machine: cc ld.bfd 2.40-14 00:01:56.869 Host machine cpu family: x86_64 00:01:56.869 Host machine cpu: x86_64 00:01:56.869 Message: ## Building in Developer Mode ## 00:01:56.869 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:56.869 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:56.869 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:56.869 Program python3 found: YES (/usr/bin/python3) 00:01:56.869 Program cat found: YES (/usr/bin/cat) 00:01:56.869 Compiler for C supports arguments -march=native: YES 00:01:56.869 Checking for size of "void *" : 8 00:01:56.869 Checking for size of "void *" : 8 (cached) 00:01:56.869 Library m found: YES 00:01:56.869 Library numa found: YES 00:01:56.869 Has header "numaif.h" : YES 00:01:56.869 Library fdt found: NO 00:01:56.869 Library execinfo found: NO 00:01:56.869 Has header "execinfo.h" : YES 00:01:56.869 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:56.869 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:56.869 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:56.869 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:56.869 Run-time dependency openssl found: YES 3.1.1 00:01:56.869 Run-time dependency libpcap found: YES 1.10.4 00:01:56.869 Has header "pcap.h" with dependency libpcap: YES 00:01:56.869 Compiler for C supports arguments -Wcast-qual: YES 00:01:56.869 Compiler for C supports arguments -Wdeprecated: YES 00:01:56.869 Compiler for C supports arguments -Wformat: YES 00:01:56.869 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:56.869 Compiler for C supports arguments -Wformat-security: NO 00:01:56.869 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:56.869 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:56.869 Compiler for C supports arguments -Wnested-externs: YES 00:01:56.869 Compiler for C supports arguments -Wold-style-definition: YES 00:01:56.869 Compiler for C supports arguments -Wpointer-arith: YES 00:01:56.869 Compiler for C supports arguments -Wsign-compare: YES 00:01:56.869 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:56.869 Compiler for C supports arguments -Wundef: YES 00:01:56.869 Compiler for C supports arguments -Wwrite-strings: YES 00:01:56.869 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:56.869 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:56.869 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:56.869 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:56.869 Program objdump found: YES (/usr/bin/objdump) 00:01:56.869 Compiler for C supports arguments -mavx512f: YES 00:01:56.869 Checking if "AVX512 checking" compiles: YES 00:01:56.869 Fetching value of define "__SSE4_2__" : 1 00:01:56.869 Fetching value of define "__AES__" : 1 00:01:56.869 Fetching value of define "__AVX__" : 1 00:01:56.869 Fetching value of define "__AVX2__" : (undefined) 00:01:56.869 Fetching value of define "__AVX512BW__" : (undefined) 00:01:56.869 Fetching value of define "__AVX512CD__" : (undefined) 00:01:56.869 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:56.869 Fetching value of define "__AVX512F__" : (undefined) 00:01:56.869 Fetching value of define "__AVX512VL__" : (undefined) 00:01:56.869 Fetching value of define "__PCLMUL__" : 1 00:01:56.869 Fetching value of define "__RDRND__" : 1 00:01:56.869 Fetching value of define "__RDSEED__" : (undefined) 00:01:56.869 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:56.869 Fetching value of define "__znver1__" : (undefined) 00:01:56.869 Fetching value of define "__znver2__" : (undefined) 00:01:56.869 Fetching value of define "__znver3__" : (undefined) 00:01:56.869 Fetching value of define "__znver4__" : (undefined) 00:01:56.869 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:56.869 Message: lib/log: Defining dependency "log" 00:01:56.869 Message: lib/kvargs: Defining dependency "kvargs" 00:01:56.869 Message: lib/telemetry: Defining dependency "telemetry" 00:01:56.870 Checking for function "getentropy" : NO 00:01:56.870 Message: lib/eal: Defining dependency "eal" 00:01:56.870 Message: lib/ring: Defining dependency "ring" 00:01:56.870 Message: lib/rcu: Defining dependency "rcu" 00:01:56.870 Message: lib/mempool: Defining dependency "mempool" 00:01:56.870 Message: lib/mbuf: Defining dependency "mbuf" 00:01:56.870 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:56.870 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:56.870 Compiler for C supports arguments -mpclmul: YES 00:01:56.870 Compiler for C supports arguments -maes: YES 00:01:56.870 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:56.870 Compiler for C supports arguments -mavx512bw: YES 00:01:56.870 Compiler for C supports arguments -mavx512dq: YES 00:01:56.870 Compiler for C supports arguments -mavx512vl: YES 00:01:56.870 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:56.870 Compiler for C supports arguments -mavx2: YES 00:01:56.870 Compiler for C supports arguments -mavx: YES 00:01:56.870 Message: lib/net: Defining dependency "net" 00:01:56.870 Message: lib/meter: Defining dependency "meter" 00:01:56.870 Message: lib/ethdev: Defining dependency "ethdev" 00:01:56.870 Message: lib/pci: Defining dependency "pci" 00:01:56.870 Message: lib/cmdline: Defining dependency "cmdline" 00:01:56.870 Message: lib/hash: Defining dependency "hash" 00:01:56.870 Message: lib/timer: Defining dependency "timer" 00:01:56.870 Message: lib/compressdev: Defining dependency "compressdev" 00:01:56.870 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:56.870 Message: lib/dmadev: Defining dependency "dmadev" 00:01:56.870 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:56.870 Message: lib/power: Defining dependency "power" 00:01:56.870 Message: lib/reorder: Defining dependency "reorder" 00:01:56.870 Message: lib/security: Defining dependency "security" 00:01:56.870 Has header "linux/userfaultfd.h" : YES 00:01:56.870 Has header "linux/vduse.h" : YES 00:01:56.870 Message: lib/vhost: Defining dependency "vhost" 00:01:56.870 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:56.870 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:56.870 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:56.870 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:56.870 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:56.870 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:56.870 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:56.870 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:56.870 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:56.870 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:56.870 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:56.870 Configuring doxy-api-html.conf using configuration 00:01:56.870 Configuring doxy-api-man.conf using configuration 00:01:56.870 Program mandb found: YES (/usr/bin/mandb) 00:01:56.870 Program sphinx-build found: NO 00:01:56.870 Configuring rte_build_config.h using configuration 00:01:56.870 Message: 00:01:56.870 ================= 00:01:56.870 Applications Enabled 00:01:56.870 ================= 00:01:56.870 00:01:56.870 apps: 00:01:56.870 00:01:56.870 00:01:56.870 Message: 00:01:56.870 ================= 00:01:56.870 Libraries Enabled 00:01:56.870 ================= 00:01:56.870 00:01:56.870 libs: 00:01:56.870 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:56.870 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:56.870 cryptodev, dmadev, power, reorder, security, vhost, 00:01:56.870 00:01:56.870 Message: 00:01:56.870 =============== 00:01:56.870 Drivers Enabled 00:01:56.870 =============== 00:01:56.870 00:01:56.870 common: 00:01:56.870 00:01:56.870 bus: 00:01:56.870 pci, vdev, 00:01:56.870 mempool: 00:01:56.870 ring, 00:01:56.870 dma: 00:01:56.870 00:01:56.870 net: 00:01:56.870 00:01:56.870 crypto: 00:01:56.870 00:01:56.870 compress: 00:01:56.870 00:01:56.870 vdpa: 00:01:56.870 00:01:56.870 00:01:56.870 Message: 00:01:56.870 ================= 00:01:56.870 Content Skipped 00:01:56.870 ================= 00:01:56.870 00:01:56.870 apps: 00:01:56.870 dumpcap: explicitly disabled via build config 00:01:56.870 graph: explicitly disabled via build config 00:01:56.870 pdump: explicitly disabled via build config 00:01:56.870 proc-info: explicitly disabled via build config 00:01:56.870 test-acl: explicitly disabled via build config 00:01:56.870 test-bbdev: explicitly disabled via build config 00:01:56.870 test-cmdline: explicitly disabled via build config 00:01:56.870 test-compress-perf: explicitly disabled via build config 00:01:56.870 test-crypto-perf: explicitly disabled via build config 00:01:56.870 test-dma-perf: explicitly disabled via build config 00:01:56.870 test-eventdev: explicitly disabled via build config 00:01:56.870 test-fib: explicitly disabled via build config 00:01:56.870 test-flow-perf: explicitly disabled via build config 00:01:56.870 test-gpudev: explicitly disabled via build config 00:01:56.870 test-mldev: explicitly disabled via build config 00:01:56.870 test-pipeline: explicitly disabled via build config 00:01:56.870 test-pmd: explicitly disabled via build config 00:01:56.870 test-regex: explicitly disabled via build config 00:01:56.870 test-sad: explicitly disabled via build config 00:01:56.870 test-security-perf: explicitly disabled via build config 00:01:56.870 00:01:56.870 libs: 00:01:56.870 metrics: explicitly disabled via build config 00:01:56.870 acl: explicitly disabled via build config 00:01:56.870 bbdev: explicitly disabled via build config 00:01:56.870 bitratestats: explicitly disabled via build config 00:01:56.870 bpf: explicitly disabled via build config 00:01:56.870 cfgfile: explicitly disabled via build config 00:01:56.870 distributor: explicitly disabled via build config 00:01:56.870 efd: explicitly disabled via build config 00:01:56.870 eventdev: explicitly disabled via build config 00:01:56.870 dispatcher: explicitly disabled via build config 00:01:56.870 gpudev: explicitly disabled via build config 00:01:56.870 gro: explicitly disabled via build config 00:01:56.870 gso: explicitly disabled via build config 00:01:56.870 ip_frag: explicitly disabled via build config 00:01:56.870 jobstats: explicitly disabled via build config 00:01:56.870 latencystats: explicitly disabled via build config 00:01:56.870 lpm: explicitly disabled via build config 00:01:56.870 member: explicitly disabled via build config 00:01:56.870 pcapng: explicitly disabled via build config 00:01:56.870 rawdev: explicitly disabled via build config 00:01:56.870 regexdev: explicitly disabled via build config 00:01:56.870 mldev: explicitly disabled via build config 00:01:56.870 rib: explicitly disabled via build config 00:01:56.870 sched: explicitly disabled via build config 00:01:56.870 stack: explicitly disabled via build config 00:01:56.870 ipsec: explicitly disabled via build config 00:01:56.870 pdcp: explicitly disabled via build config 00:01:56.870 fib: explicitly disabled via build config 00:01:56.870 port: explicitly disabled via build config 00:01:56.870 pdump: explicitly disabled via build config 00:01:56.870 table: explicitly disabled via build config 00:01:56.870 pipeline: explicitly disabled via build config 00:01:56.870 graph: explicitly disabled via build config 00:01:56.870 node: explicitly disabled via build config 00:01:56.870 00:01:56.870 drivers: 00:01:56.870 common/cpt: not in enabled drivers build config 00:01:56.870 common/dpaax: not in enabled drivers build config 00:01:56.870 common/iavf: not in enabled drivers build config 00:01:56.870 common/idpf: not in enabled drivers build config 00:01:56.870 common/mvep: not in enabled drivers build config 00:01:56.870 common/octeontx: not in enabled drivers build config 00:01:56.870 bus/auxiliary: not in enabled drivers build config 00:01:56.870 bus/cdx: not in enabled drivers build config 00:01:56.870 bus/dpaa: not in enabled drivers build config 00:01:56.870 bus/fslmc: not in enabled drivers build config 00:01:56.870 bus/ifpga: not in enabled drivers build config 00:01:56.870 bus/platform: not in enabled drivers build config 00:01:56.870 bus/vmbus: not in enabled drivers build config 00:01:56.870 common/cnxk: not in enabled drivers build config 00:01:56.870 common/mlx5: not in enabled drivers build config 00:01:56.870 common/nfp: not in enabled drivers build config 00:01:56.870 common/qat: not in enabled drivers build config 00:01:56.870 common/sfc_efx: not in enabled drivers build config 00:01:56.870 mempool/bucket: not in enabled drivers build config 00:01:56.870 mempool/cnxk: not in enabled drivers build config 00:01:56.870 mempool/dpaa: not in enabled drivers build config 00:01:56.870 mempool/dpaa2: not in enabled drivers build config 00:01:56.870 mempool/octeontx: not in enabled drivers build config 00:01:56.870 mempool/stack: not in enabled drivers build config 00:01:56.870 dma/cnxk: not in enabled drivers build config 00:01:56.870 dma/dpaa: not in enabled drivers build config 00:01:56.870 dma/dpaa2: not in enabled drivers build config 00:01:56.870 dma/hisilicon: not in enabled drivers build config 00:01:56.870 dma/idxd: not in enabled drivers build config 00:01:56.870 dma/ioat: not in enabled drivers build config 00:01:56.870 dma/skeleton: not in enabled drivers build config 00:01:56.870 net/af_packet: not in enabled drivers build config 00:01:56.870 net/af_xdp: not in enabled drivers build config 00:01:56.870 net/ark: not in enabled drivers build config 00:01:56.870 net/atlantic: not in enabled drivers build config 00:01:56.870 net/avp: not in enabled drivers build config 00:01:56.870 net/axgbe: not in enabled drivers build config 00:01:56.870 net/bnx2x: not in enabled drivers build config 00:01:56.870 net/bnxt: not in enabled drivers build config 00:01:56.870 net/bonding: not in enabled drivers build config 00:01:56.870 net/cnxk: not in enabled drivers build config 00:01:56.870 net/cpfl: not in enabled drivers build config 00:01:56.870 net/cxgbe: not in enabled drivers build config 00:01:56.871 net/dpaa: not in enabled drivers build config 00:01:56.871 net/dpaa2: not in enabled drivers build config 00:01:56.871 net/e1000: not in enabled drivers build config 00:01:56.871 net/ena: not in enabled drivers build config 00:01:56.871 net/enetc: not in enabled drivers build config 00:01:56.871 net/enetfec: not in enabled drivers build config 00:01:56.871 net/enic: not in enabled drivers build config 00:01:56.871 net/failsafe: not in enabled drivers build config 00:01:56.871 net/fm10k: not in enabled drivers build config 00:01:56.871 net/gve: not in enabled drivers build config 00:01:56.871 net/hinic: not in enabled drivers build config 00:01:56.871 net/hns3: not in enabled drivers build config 00:01:56.871 net/i40e: not in enabled drivers build config 00:01:56.871 net/iavf: not in enabled drivers build config 00:01:56.871 net/ice: not in enabled drivers build config 00:01:56.871 net/idpf: not in enabled drivers build config 00:01:56.871 net/igc: not in enabled drivers build config 00:01:56.871 net/ionic: not in enabled drivers build config 00:01:56.871 net/ipn3ke: not in enabled drivers build config 00:01:56.871 net/ixgbe: not in enabled drivers build config 00:01:56.871 net/mana: not in enabled drivers build config 00:01:56.871 net/memif: not in enabled drivers build config 00:01:56.871 net/mlx4: not in enabled drivers build config 00:01:56.871 net/mlx5: not in enabled drivers build config 00:01:56.871 net/mvneta: not in enabled drivers build config 00:01:56.871 net/mvpp2: not in enabled drivers build config 00:01:56.871 net/netvsc: not in enabled drivers build config 00:01:56.871 net/nfb: not in enabled drivers build config 00:01:56.871 net/nfp: not in enabled drivers build config 00:01:56.871 net/ngbe: not in enabled drivers build config 00:01:56.871 net/null: not in enabled drivers build config 00:01:56.871 net/octeontx: not in enabled drivers build config 00:01:56.871 net/octeon_ep: not in enabled drivers build config 00:01:56.871 net/pcap: not in enabled drivers build config 00:01:56.871 net/pfe: not in enabled drivers build config 00:01:56.871 net/qede: not in enabled drivers build config 00:01:56.871 net/ring: not in enabled drivers build config 00:01:56.871 net/sfc: not in enabled drivers build config 00:01:56.871 net/softnic: not in enabled drivers build config 00:01:56.871 net/tap: not in enabled drivers build config 00:01:56.871 net/thunderx: not in enabled drivers build config 00:01:56.871 net/txgbe: not in enabled drivers build config 00:01:56.871 net/vdev_netvsc: not in enabled drivers build config 00:01:56.871 net/vhost: not in enabled drivers build config 00:01:56.871 net/virtio: not in enabled drivers build config 00:01:56.871 net/vmxnet3: not in enabled drivers build config 00:01:56.871 raw/*: missing internal dependency, "rawdev" 00:01:56.871 crypto/armv8: not in enabled drivers build config 00:01:56.871 crypto/bcmfs: not in enabled drivers build config 00:01:56.871 crypto/caam_jr: not in enabled drivers build config 00:01:56.871 crypto/ccp: not in enabled drivers build config 00:01:56.871 crypto/cnxk: not in enabled drivers build config 00:01:56.871 crypto/dpaa_sec: not in enabled drivers build config 00:01:56.871 crypto/dpaa2_sec: not in enabled drivers build config 00:01:56.871 crypto/ipsec_mb: not in enabled drivers build config 00:01:56.871 crypto/mlx5: not in enabled drivers build config 00:01:56.871 crypto/mvsam: not in enabled drivers build config 00:01:56.871 crypto/nitrox: not in enabled drivers build config 00:01:56.871 crypto/null: not in enabled drivers build config 00:01:56.871 crypto/octeontx: not in enabled drivers build config 00:01:56.871 crypto/openssl: not in enabled drivers build config 00:01:56.871 crypto/scheduler: not in enabled drivers build config 00:01:56.871 crypto/uadk: not in enabled drivers build config 00:01:56.871 crypto/virtio: not in enabled drivers build config 00:01:56.871 compress/isal: not in enabled drivers build config 00:01:56.871 compress/mlx5: not in enabled drivers build config 00:01:56.871 compress/octeontx: not in enabled drivers build config 00:01:56.871 compress/zlib: not in enabled drivers build config 00:01:56.871 regex/*: missing internal dependency, "regexdev" 00:01:56.871 ml/*: missing internal dependency, "mldev" 00:01:56.871 vdpa/ifc: not in enabled drivers build config 00:01:56.871 vdpa/mlx5: not in enabled drivers build config 00:01:56.871 vdpa/nfp: not in enabled drivers build config 00:01:56.871 vdpa/sfc: not in enabled drivers build config 00:01:56.871 event/*: missing internal dependency, "eventdev" 00:01:56.871 baseband/*: missing internal dependency, "bbdev" 00:01:56.871 gpu/*: missing internal dependency, "gpudev" 00:01:56.871 00:01:56.871 00:01:56.871 Build targets in project: 85 00:01:56.871 00:01:56.871 DPDK 23.11.0 00:01:56.871 00:01:56.871 User defined options 00:01:56.871 buildtype : debug 00:01:56.871 default_library : shared 00:01:56.871 libdir : lib 00:01:56.871 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:56.871 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:56.871 c_link_args : 00:01:56.871 cpu_instruction_set: native 00:01:56.871 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:56.871 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:56.871 enable_docs : false 00:01:56.871 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:56.871 enable_kmods : false 00:01:56.871 tests : false 00:01:56.871 00:01:56.871 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:56.871 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:56.871 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:56.871 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:56.871 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:56.871 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:56.871 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:56.871 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:56.871 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:56.871 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:56.871 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:56.871 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:56.871 [11/265] Linking static target lib/librte_kvargs.a 00:01:56.871 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:56.871 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:56.871 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:56.871 [15/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:56.871 [16/265] Linking static target lib/librte_log.a 00:01:56.871 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:56.871 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:56.871 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:56.871 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:56.871 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:56.871 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.871 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:57.132 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:57.132 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:57.132 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:57.132 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:57.132 [28/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:57.132 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:57.132 [30/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:57.132 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:57.132 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:57.132 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:57.132 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:57.132 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:57.132 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:57.132 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:57.132 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:57.132 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:57.132 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:57.132 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:57.132 [42/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:57.132 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:57.132 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:57.132 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:57.132 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:57.132 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:57.132 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:57.133 [49/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:57.133 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:57.133 [51/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:57.133 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:57.133 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:57.133 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:57.133 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:57.133 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:57.133 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:57.133 [58/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:57.133 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:57.133 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:57.133 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:57.133 [62/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:57.133 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:57.133 [64/265] Linking static target lib/librte_telemetry.a 00:01:57.394 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:57.394 [66/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:57.394 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:57.394 [68/265] Linking static target lib/librte_pci.a 00:01:57.394 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:57.394 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:57.394 [71/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.394 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:57.394 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:57.394 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:57.394 [75/265] Linking target lib/librte_log.so.24.0 00:01:57.656 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:57.656 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:57.656 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:57.656 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:57.656 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:57.656 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:57.656 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:57.656 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:57.656 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:57.656 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:57.656 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:57.656 [87/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:57.916 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:57.916 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:57.916 [90/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.916 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:57.916 [92/265] Linking target lib/librte_kvargs.so.24.0 00:01:57.916 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:57.916 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:57.916 [95/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:57.916 [96/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:57.916 [97/265] Linking static target lib/librte_ring.a 00:01:58.176 [98/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:58.176 [99/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:58.176 [100/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:58.176 [101/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:58.176 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:58.176 [103/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:58.176 [104/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:58.176 [105/265] Linking static target lib/librte_eal.a 00:01:58.176 [106/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:58.176 [107/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:58.176 [108/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:58.176 [109/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:58.176 [110/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:58.176 [111/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:58.176 [112/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:58.176 [113/265] Linking static target lib/librte_meter.a 00:01:58.176 [114/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:58.176 [115/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:58.176 [116/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.176 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:58.176 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:58.176 [119/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:58.441 [120/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:58.441 [121/265] Linking static target lib/librte_mempool.a 00:01:58.441 [122/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:58.441 [123/265] Linking static target lib/librte_rcu.a 00:01:58.441 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:58.441 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:58.441 [126/265] Linking target lib/librte_telemetry.so.24.0 00:01:58.441 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:58.441 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:58.441 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:58.441 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:58.441 [131/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:58.441 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:58.441 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:58.441 [134/265] Linking static target lib/librte_cmdline.a 00:01:58.704 [135/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.704 [136/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:58.704 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:58.704 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:58.704 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:58.704 [140/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:58.704 [141/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:58.704 [142/265] Linking static target lib/librte_net.a 00:01:58.704 [143/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:58.704 [144/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:58.704 [145/265] Linking static target lib/librte_timer.a 00:01:58.704 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:58.704 [147/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:58.963 [148/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.963 [149/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.963 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:58.963 [151/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:58.963 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:58.963 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:58.963 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:58.963 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:58.963 [156/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:58.963 [157/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.963 [158/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:59.223 [159/265] Linking static target lib/librte_dmadev.a 00:01:59.223 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:59.223 [161/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:59.223 [162/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.223 [163/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:59.223 [164/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:59.223 [165/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.223 [166/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:59.223 [167/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:59.223 [168/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:59.224 [169/265] Linking static target lib/librte_hash.a 00:01:59.224 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:59.482 [171/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:59.482 [172/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:59.482 [173/265] Linking static target lib/librte_compressdev.a 00:01:59.482 [174/265] Linking static target lib/librte_power.a 00:01:59.482 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:59.482 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:59.482 [177/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:59.482 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:59.482 [179/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:59.482 [180/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.482 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:59.482 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:59.482 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:59.483 [184/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.483 [185/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:59.483 [186/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:59.483 [187/265] Linking static target lib/librte_reorder.a 00:01:59.483 [188/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:59.741 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:59.741 [190/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:59.741 [191/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:59.741 [192/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.741 [193/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.741 [194/265] Linking static target drivers/librte_bus_vdev.a 00:01:59.741 [195/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:59.741 [196/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:59.741 [197/265] Linking static target lib/librte_security.a 00:01:59.741 [198/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.741 [199/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:59.741 [200/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:59.741 [201/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.741 [202/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:59.741 [203/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:59.741 [204/265] Linking static target lib/librte_mbuf.a 00:01:59.741 [205/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:59.998 [206/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.998 [207/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.999 [208/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.999 [209/265] Linking static target drivers/librte_bus_pci.a 00:01:59.999 [210/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.999 [211/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.999 [212/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:59.999 [213/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:59.999 [214/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.999 [215/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.999 [216/265] Linking static target drivers/librte_mempool_ring.a 00:01:59.999 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.255 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:00.255 [219/265] Linking static target lib/librte_ethdev.a 00:02:00.255 [220/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.255 [221/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.512 [222/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:00.512 [223/265] Linking static target lib/librte_cryptodev.a 00:02:01.446 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.382 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:04.281 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.281 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.281 [228/265] Linking target lib/librte_eal.so.24.0 00:02:04.539 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:04.539 [230/265] Linking target lib/librte_ring.so.24.0 00:02:04.539 [231/265] Linking target lib/librte_meter.so.24.0 00:02:04.539 [232/265] Linking target lib/librte_dmadev.so.24.0 00:02:04.539 [233/265] Linking target lib/librte_timer.so.24.0 00:02:04.539 [234/265] Linking target lib/librte_pci.so.24.0 00:02:04.539 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:04.797 [236/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:04.797 [237/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:04.797 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:04.797 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:04.797 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:04.797 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:04.797 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:04.797 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:04.797 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:04.797 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:04.797 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:04.797 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:05.054 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:05.054 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:05.054 [250/265] Linking target lib/librte_compressdev.so.24.0 00:02:05.054 [251/265] Linking target lib/librte_net.so.24.0 00:02:05.054 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:05.054 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:05.054 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:05.311 [255/265] Linking target lib/librte_security.so.24.0 00:02:05.311 [256/265] Linking target lib/librte_cmdline.so.24.0 00:02:05.311 [257/265] Linking target lib/librte_hash.so.24.0 00:02:05.311 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:05.311 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:05.311 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:05.311 [261/265] Linking target lib/librte_power.so.24.0 00:02:07.840 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:07.840 [263/265] Linking static target lib/librte_vhost.a 00:02:09.214 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.214 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:09.214 INFO: autodetecting backend as ninja 00:02:09.214 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:10.146 CC lib/ut/ut.o 00:02:10.146 CC lib/ut_mock/mock.o 00:02:10.147 CC lib/log/log.o 00:02:10.147 CC lib/log/log_flags.o 00:02:10.147 CC lib/log/log_deprecated.o 00:02:10.147 LIB libspdk_ut_mock.a 00:02:10.147 SO libspdk_ut_mock.so.5.0 00:02:10.147 LIB libspdk_ut.a 00:02:10.147 LIB libspdk_log.a 00:02:10.147 SO libspdk_ut.so.1.0 00:02:10.147 SO libspdk_log.so.6.1 00:02:10.147 SYMLINK libspdk_ut_mock.so 00:02:10.147 SYMLINK libspdk_ut.so 00:02:10.147 SYMLINK libspdk_log.so 00:02:10.405 CC lib/ioat/ioat.o 00:02:10.405 CC lib/dma/dma.o 00:02:10.405 CXX lib/trace_parser/trace.o 00:02:10.405 CC lib/util/base64.o 00:02:10.405 CC lib/util/bit_array.o 00:02:10.405 CC lib/util/cpuset.o 00:02:10.405 CC lib/util/crc16.o 00:02:10.405 CC lib/util/crc32.o 00:02:10.405 CC lib/util/crc32c.o 00:02:10.405 CC lib/util/crc32_ieee.o 00:02:10.405 CC lib/util/crc64.o 00:02:10.405 CC lib/util/dif.o 00:02:10.405 CC lib/util/fd.o 00:02:10.405 CC lib/util/file.o 00:02:10.405 CC lib/util/hexlify.o 00:02:10.405 CC lib/util/iov.o 00:02:10.405 CC lib/util/math.o 00:02:10.405 CC lib/util/pipe.o 00:02:10.405 CC lib/util/strerror_tls.o 00:02:10.405 CC lib/util/string.o 00:02:10.405 CC lib/util/uuid.o 00:02:10.405 CC lib/util/fd_group.o 00:02:10.405 CC lib/util/xor.o 00:02:10.405 CC lib/util/zipf.o 00:02:10.405 CC lib/vfio_user/host/vfio_user_pci.o 00:02:10.405 CC lib/vfio_user/host/vfio_user.o 00:02:10.663 LIB libspdk_dma.a 00:02:10.663 LIB libspdk_ioat.a 00:02:10.663 SO libspdk_dma.so.3.0 00:02:10.663 SO libspdk_ioat.so.6.0 00:02:10.663 SYMLINK libspdk_dma.so 00:02:10.663 SYMLINK libspdk_ioat.so 00:02:10.663 LIB libspdk_vfio_user.a 00:02:10.663 SO libspdk_vfio_user.so.4.0 00:02:10.663 SYMLINK libspdk_vfio_user.so 00:02:10.921 LIB libspdk_util.a 00:02:10.921 SO libspdk_util.so.8.0 00:02:10.921 SYMLINK libspdk_util.so 00:02:11.179 CC lib/json/json_parse.o 00:02:11.179 CC lib/env_dpdk/env.o 00:02:11.179 CC lib/json/json_util.o 00:02:11.179 CC lib/env_dpdk/memory.o 00:02:11.179 CC lib/json/json_write.o 00:02:11.179 CC lib/vmd/vmd.o 00:02:11.179 CC lib/idxd/idxd.o 00:02:11.179 CC lib/vmd/led.o 00:02:11.179 CC lib/idxd/idxd_user.o 00:02:11.179 CC lib/env_dpdk/pci.o 00:02:11.179 CC lib/conf/conf.o 00:02:11.179 CC lib/idxd/idxd_kernel.o 00:02:11.179 CC lib/env_dpdk/init.o 00:02:11.179 CC lib/env_dpdk/threads.o 00:02:11.179 CC lib/env_dpdk/pci_ioat.o 00:02:11.179 CC lib/rdma/common.o 00:02:11.179 CC lib/env_dpdk/pci_virtio.o 00:02:11.179 CC lib/rdma/rdma_verbs.o 00:02:11.179 CC lib/env_dpdk/pci_vmd.o 00:02:11.179 CC lib/env_dpdk/pci_idxd.o 00:02:11.179 CC lib/env_dpdk/pci_event.o 00:02:11.180 CC lib/env_dpdk/sigbus_handler.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:11.180 LIB libspdk_trace_parser.a 00:02:11.180 SO libspdk_trace_parser.so.4.0 00:02:11.438 SYMLINK libspdk_trace_parser.so 00:02:11.438 LIB libspdk_rdma.a 00:02:11.438 LIB libspdk_json.a 00:02:11.438 SO libspdk_rdma.so.5.0 00:02:11.438 LIB libspdk_conf.a 00:02:11.438 SO libspdk_json.so.5.1 00:02:11.438 SO libspdk_conf.so.5.0 00:02:11.438 SYMLINK libspdk_rdma.so 00:02:11.438 SYMLINK libspdk_json.so 00:02:11.438 SYMLINK libspdk_conf.so 00:02:11.696 CC lib/jsonrpc/jsonrpc_server.o 00:02:11.696 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:11.696 CC lib/jsonrpc/jsonrpc_client.o 00:02:11.696 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:11.696 LIB libspdk_idxd.a 00:02:11.696 SO libspdk_idxd.so.11.0 00:02:11.696 SYMLINK libspdk_idxd.so 00:02:11.954 LIB libspdk_vmd.a 00:02:11.954 SO libspdk_vmd.so.5.0 00:02:11.954 LIB libspdk_jsonrpc.a 00:02:11.954 SYMLINK libspdk_vmd.so 00:02:11.954 SO libspdk_jsonrpc.so.5.1 00:02:11.954 SYMLINK libspdk_jsonrpc.so 00:02:12.212 CC lib/rpc/rpc.o 00:02:12.212 LIB libspdk_rpc.a 00:02:12.212 SO libspdk_rpc.so.5.0 00:02:12.470 SYMLINK libspdk_rpc.so 00:02:12.470 CC lib/trace/trace.o 00:02:12.470 CC lib/trace/trace_flags.o 00:02:12.470 CC lib/sock/sock.o 00:02:12.470 CC lib/trace/trace_rpc.o 00:02:12.470 CC lib/sock/sock_rpc.o 00:02:12.470 CC lib/notify/notify.o 00:02:12.470 CC lib/notify/notify_rpc.o 00:02:12.728 LIB libspdk_notify.a 00:02:12.728 SO libspdk_notify.so.5.0 00:02:12.728 SYMLINK libspdk_notify.so 00:02:12.728 LIB libspdk_trace.a 00:02:12.728 SO libspdk_trace.so.9.0 00:02:12.728 SYMLINK libspdk_trace.so 00:02:12.987 LIB libspdk_sock.a 00:02:12.987 SO libspdk_sock.so.8.0 00:02:12.987 CC lib/thread/thread.o 00:02:12.987 CC lib/thread/iobuf.o 00:02:12.987 SYMLINK libspdk_sock.so 00:02:12.987 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:12.987 CC lib/nvme/nvme_ctrlr.o 00:02:12.987 CC lib/nvme/nvme_fabric.o 00:02:12.987 CC lib/nvme/nvme_ns_cmd.o 00:02:12.987 CC lib/nvme/nvme_ns.o 00:02:12.987 CC lib/nvme/nvme_pcie_common.o 00:02:12.987 CC lib/nvme/nvme_pcie.o 00:02:12.987 CC lib/nvme/nvme_qpair.o 00:02:12.987 CC lib/nvme/nvme.o 00:02:12.987 CC lib/nvme/nvme_quirks.o 00:02:12.987 CC lib/nvme/nvme_transport.o 00:02:12.987 CC lib/nvme/nvme_discovery.o 00:02:12.987 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:12.987 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:12.987 CC lib/nvme/nvme_tcp.o 00:02:12.987 CC lib/nvme/nvme_opal.o 00:02:12.987 CC lib/nvme/nvme_io_msg.o 00:02:12.987 CC lib/nvme/nvme_poll_group.o 00:02:12.987 CC lib/nvme/nvme_zns.o 00:02:12.987 CC lib/nvme/nvme_cuse.o 00:02:12.987 CC lib/nvme/nvme_vfio_user.o 00:02:12.987 CC lib/nvme/nvme_rdma.o 00:02:13.244 LIB libspdk_env_dpdk.a 00:02:13.244 SO libspdk_env_dpdk.so.13.0 00:02:13.502 SYMLINK libspdk_env_dpdk.so 00:02:14.437 LIB libspdk_thread.a 00:02:14.696 SO libspdk_thread.so.9.0 00:02:14.696 SYMLINK libspdk_thread.so 00:02:14.696 CC lib/accel/accel.o 00:02:14.696 CC lib/accel/accel_rpc.o 00:02:14.696 CC lib/virtio/virtio.o 00:02:14.696 CC lib/accel/accel_sw.o 00:02:14.696 CC lib/virtio/virtio_vhost_user.o 00:02:14.696 CC lib/virtio/virtio_vfio_user.o 00:02:14.696 CC lib/virtio/virtio_pci.o 00:02:14.696 CC lib/blob/blobstore.o 00:02:14.696 CC lib/blob/request.o 00:02:14.696 CC lib/init/json_config.o 00:02:14.696 CC lib/init/subsystem.o 00:02:14.696 CC lib/blob/zeroes.o 00:02:14.696 CC lib/blob/blob_bs_dev.o 00:02:14.696 CC lib/init/subsystem_rpc.o 00:02:14.696 CC lib/init/rpc.o 00:02:14.954 LIB libspdk_init.a 00:02:14.954 SO libspdk_init.so.4.0 00:02:14.954 SYMLINK libspdk_init.so 00:02:14.954 LIB libspdk_virtio.a 00:02:15.212 SO libspdk_virtio.so.6.0 00:02:15.212 SYMLINK libspdk_virtio.so 00:02:15.212 CC lib/event/app.o 00:02:15.212 CC lib/event/reactor.o 00:02:15.212 CC lib/event/log_rpc.o 00:02:15.212 CC lib/event/app_rpc.o 00:02:15.212 CC lib/event/scheduler_static.o 00:02:15.470 LIB libspdk_nvme.a 00:02:15.470 SO libspdk_nvme.so.12.0 00:02:15.470 LIB libspdk_event.a 00:02:15.728 SO libspdk_event.so.12.0 00:02:15.729 SYMLINK libspdk_event.so 00:02:15.729 SYMLINK libspdk_nvme.so 00:02:15.729 LIB libspdk_accel.a 00:02:15.729 SO libspdk_accel.so.14.0 00:02:15.987 SYMLINK libspdk_accel.so 00:02:15.987 CC lib/bdev/bdev.o 00:02:15.987 CC lib/bdev/bdev_rpc.o 00:02:15.987 CC lib/bdev/bdev_zone.o 00:02:15.987 CC lib/bdev/part.o 00:02:15.987 CC lib/bdev/scsi_nvme.o 00:02:17.885 LIB libspdk_blob.a 00:02:17.885 SO libspdk_blob.so.10.1 00:02:17.885 SYMLINK libspdk_blob.so 00:02:17.885 CC lib/blobfs/blobfs.o 00:02:17.885 CC lib/blobfs/tree.o 00:02:17.885 CC lib/lvol/lvol.o 00:02:18.451 LIB libspdk_bdev.a 00:02:18.451 SO libspdk_bdev.so.14.0 00:02:18.451 SYMLINK libspdk_bdev.so 00:02:18.715 CC lib/ublk/ublk.o 00:02:18.715 CC lib/scsi/dev.o 00:02:18.715 CC lib/nbd/nbd.o 00:02:18.715 CC lib/ublk/ublk_rpc.o 00:02:18.715 CC lib/nbd/nbd_rpc.o 00:02:18.715 CC lib/scsi/lun.o 00:02:18.715 CC lib/nvmf/ctrlr.o 00:02:18.715 CC lib/scsi/port.o 00:02:18.715 CC lib/ftl/ftl_core.o 00:02:18.715 CC lib/nvmf/ctrlr_discovery.o 00:02:18.715 CC lib/scsi/scsi.o 00:02:18.715 CC lib/ftl/ftl_init.o 00:02:18.715 CC lib/scsi/scsi_bdev.o 00:02:18.715 CC lib/ftl/ftl_layout.o 00:02:18.715 CC lib/nvmf/ctrlr_bdev.o 00:02:18.715 CC lib/scsi/scsi_pr.o 00:02:18.715 CC lib/ftl/ftl_debug.o 00:02:18.715 CC lib/nvmf/subsystem.o 00:02:18.715 CC lib/nvmf/nvmf.o 00:02:18.715 CC lib/scsi/scsi_rpc.o 00:02:18.715 CC lib/ftl/ftl_io.o 00:02:18.715 CC lib/nvmf/nvmf_rpc.o 00:02:18.715 CC lib/scsi/task.o 00:02:18.715 CC lib/ftl/ftl_l2p.o 00:02:18.715 CC lib/nvmf/transport.o 00:02:18.715 CC lib/ftl/ftl_l2p_flat.o 00:02:18.715 CC lib/nvmf/tcp.o 00:02:18.715 CC lib/ftl/ftl_sb.o 00:02:18.715 CC lib/nvmf/rdma.o 00:02:18.715 CC lib/ftl/ftl_nv_cache.o 00:02:18.715 CC lib/ftl/ftl_band.o 00:02:18.715 CC lib/ftl/ftl_band_ops.o 00:02:18.715 CC lib/ftl/ftl_writer.o 00:02:18.715 CC lib/ftl/ftl_rq.o 00:02:18.715 CC lib/ftl/ftl_reloc.o 00:02:18.715 CC lib/ftl/ftl_l2p_cache.o 00:02:18.715 CC lib/ftl/ftl_p2l.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:18.715 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:18.981 LIB libspdk_blobfs.a 00:02:18.981 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:18.981 SO libspdk_blobfs.so.9.0 00:02:18.981 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:18.981 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:18.981 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:18.981 CC lib/ftl/utils/ftl_conf.o 00:02:18.981 CC lib/ftl/utils/ftl_md.o 00:02:18.981 CC lib/ftl/utils/ftl_mempool.o 00:02:18.981 CC lib/ftl/utils/ftl_bitmap.o 00:02:18.981 CC lib/ftl/utils/ftl_property.o 00:02:18.981 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:18.981 SYMLINK libspdk_blobfs.so 00:02:18.981 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:18.981 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:18.981 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:18.981 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:18.981 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:19.243 LIB libspdk_lvol.a 00:02:19.243 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:19.243 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:19.243 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:19.243 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:19.243 SO libspdk_lvol.so.9.1 00:02:19.243 CC lib/ftl/base/ftl_base_dev.o 00:02:19.243 CC lib/ftl/base/ftl_base_bdev.o 00:02:19.243 CC lib/ftl/ftl_trace.o 00:02:19.243 SYMLINK libspdk_lvol.so 00:02:19.501 LIB libspdk_nbd.a 00:02:19.501 SO libspdk_nbd.so.6.0 00:02:19.501 LIB libspdk_scsi.a 00:02:19.501 SYMLINK libspdk_nbd.so 00:02:19.501 SO libspdk_scsi.so.8.0 00:02:19.501 SYMLINK libspdk_scsi.so 00:02:19.759 LIB libspdk_ublk.a 00:02:19.759 SO libspdk_ublk.so.2.0 00:02:19.759 CC lib/iscsi/conn.o 00:02:19.759 CC lib/vhost/vhost.o 00:02:19.759 CC lib/vhost/vhost_rpc.o 00:02:19.759 CC lib/vhost/vhost_scsi.o 00:02:19.759 CC lib/iscsi/init_grp.o 00:02:19.759 CC lib/iscsi/iscsi.o 00:02:19.759 CC lib/vhost/vhost_blk.o 00:02:19.759 CC lib/iscsi/md5.o 00:02:19.759 CC lib/vhost/rte_vhost_user.o 00:02:19.759 CC lib/iscsi/param.o 00:02:19.759 CC lib/iscsi/portal_grp.o 00:02:19.759 CC lib/iscsi/tgt_node.o 00:02:19.759 CC lib/iscsi/iscsi_subsystem.o 00:02:19.759 CC lib/iscsi/iscsi_rpc.o 00:02:19.759 CC lib/iscsi/task.o 00:02:19.759 SYMLINK libspdk_ublk.so 00:02:20.017 LIB libspdk_ftl.a 00:02:20.276 SO libspdk_ftl.so.8.0 00:02:20.565 SYMLINK libspdk_ftl.so 00:02:20.845 LIB libspdk_vhost.a 00:02:21.103 SO libspdk_vhost.so.7.1 00:02:21.103 SYMLINK libspdk_vhost.so 00:02:21.103 LIB libspdk_nvmf.a 00:02:21.103 LIB libspdk_iscsi.a 00:02:21.103 SO libspdk_nvmf.so.17.0 00:02:21.361 SO libspdk_iscsi.so.7.0 00:02:21.361 SYMLINK libspdk_nvmf.so 00:02:21.361 SYMLINK libspdk_iscsi.so 00:02:21.619 CC module/env_dpdk/env_dpdk_rpc.o 00:02:21.619 CC module/sock/posix/posix.o 00:02:21.619 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:21.619 CC module/blob/bdev/blob_bdev.o 00:02:21.619 CC module/accel/iaa/accel_iaa.o 00:02:21.619 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:21.619 CC module/accel/iaa/accel_iaa_rpc.o 00:02:21.619 CC module/accel/ioat/accel_ioat.o 00:02:21.619 CC module/accel/ioat/accel_ioat_rpc.o 00:02:21.619 CC module/accel/dsa/accel_dsa.o 00:02:21.619 CC module/accel/dsa/accel_dsa_rpc.o 00:02:21.619 CC module/scheduler/gscheduler/gscheduler.o 00:02:21.619 CC module/accel/error/accel_error.o 00:02:21.619 CC module/accel/error/accel_error_rpc.o 00:02:21.619 LIB libspdk_env_dpdk_rpc.a 00:02:21.619 SO libspdk_env_dpdk_rpc.so.5.0 00:02:21.878 SYMLINK libspdk_env_dpdk_rpc.so 00:02:21.878 LIB libspdk_scheduler_gscheduler.a 00:02:21.878 LIB libspdk_scheduler_dpdk_governor.a 00:02:21.878 SO libspdk_scheduler_gscheduler.so.3.0 00:02:21.878 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:21.878 LIB libspdk_accel_error.a 00:02:21.878 LIB libspdk_accel_ioat.a 00:02:21.878 LIB libspdk_scheduler_dynamic.a 00:02:21.878 LIB libspdk_accel_iaa.a 00:02:21.878 SO libspdk_accel_error.so.1.0 00:02:21.878 SO libspdk_accel_ioat.so.5.0 00:02:21.878 SYMLINK libspdk_scheduler_gscheduler.so 00:02:21.878 SO libspdk_scheduler_dynamic.so.3.0 00:02:21.878 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:21.878 SO libspdk_accel_iaa.so.2.0 00:02:21.878 LIB libspdk_accel_dsa.a 00:02:21.878 SYMLINK libspdk_accel_error.so 00:02:21.878 SYMLINK libspdk_accel_ioat.so 00:02:21.878 SYMLINK libspdk_scheduler_dynamic.so 00:02:21.878 LIB libspdk_blob_bdev.a 00:02:21.878 SO libspdk_accel_dsa.so.4.0 00:02:21.878 SYMLINK libspdk_accel_iaa.so 00:02:21.878 SO libspdk_blob_bdev.so.10.1 00:02:21.878 SYMLINK libspdk_accel_dsa.so 00:02:21.878 SYMLINK libspdk_blob_bdev.so 00:02:22.138 CC module/blobfs/bdev/blobfs_bdev.o 00:02:22.139 CC module/bdev/lvol/vbdev_lvol.o 00:02:22.139 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:22.139 CC module/bdev/malloc/bdev_malloc.o 00:02:22.139 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:22.139 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:22.139 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:22.139 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:22.139 CC module/bdev/ftl/bdev_ftl.o 00:02:22.139 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:22.139 CC module/bdev/delay/vbdev_delay.o 00:02:22.139 CC module/bdev/iscsi/bdev_iscsi.o 00:02:22.139 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:22.139 CC module/bdev/raid/bdev_raid.o 00:02:22.139 CC module/bdev/gpt/gpt.o 00:02:22.139 CC module/bdev/null/bdev_null.o 00:02:22.139 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:22.139 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:22.139 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:22.139 CC module/bdev/null/bdev_null_rpc.o 00:02:22.139 CC module/bdev/raid/bdev_raid_rpc.o 00:02:22.139 CC module/bdev/aio/bdev_aio.o 00:02:22.139 CC module/bdev/raid/bdev_raid_sb.o 00:02:22.139 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:22.139 CC module/bdev/gpt/vbdev_gpt.o 00:02:22.139 CC module/bdev/raid/raid0.o 00:02:22.139 CC module/bdev/split/vbdev_split.o 00:02:22.139 CC module/bdev/nvme/bdev_nvme.o 00:02:22.139 CC module/bdev/passthru/vbdev_passthru.o 00:02:22.139 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:22.139 CC module/bdev/split/vbdev_split_rpc.o 00:02:22.139 CC module/bdev/aio/bdev_aio_rpc.o 00:02:22.139 CC module/bdev/error/vbdev_error_rpc.o 00:02:22.139 CC module/bdev/error/vbdev_error.o 00:02:22.139 CC module/bdev/nvme/nvme_rpc.o 00:02:22.139 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:22.139 CC module/bdev/raid/raid1.o 00:02:22.139 CC module/bdev/raid/concat.o 00:02:22.139 CC module/bdev/nvme/bdev_mdns_client.o 00:02:22.139 CC module/bdev/nvme/vbdev_opal.o 00:02:22.139 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:22.139 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:22.397 LIB libspdk_blobfs_bdev.a 00:02:22.397 LIB libspdk_sock_posix.a 00:02:22.397 SO libspdk_blobfs_bdev.so.5.0 00:02:22.397 SO libspdk_sock_posix.so.5.0 00:02:22.397 LIB libspdk_bdev_ftl.a 00:02:22.655 SO libspdk_bdev_ftl.so.5.0 00:02:22.655 LIB libspdk_bdev_zone_block.a 00:02:22.655 SYMLINK libspdk_blobfs_bdev.so 00:02:22.655 LIB libspdk_bdev_split.a 00:02:22.655 SYMLINK libspdk_sock_posix.so 00:02:22.655 LIB libspdk_bdev_gpt.a 00:02:22.655 SO libspdk_bdev_zone_block.so.5.0 00:02:22.655 SO libspdk_bdev_split.so.5.0 00:02:22.655 LIB libspdk_bdev_null.a 00:02:22.655 SO libspdk_bdev_gpt.so.5.0 00:02:22.655 LIB libspdk_bdev_passthru.a 00:02:22.655 SYMLINK libspdk_bdev_ftl.so 00:02:22.655 LIB libspdk_bdev_error.a 00:02:22.655 LIB libspdk_bdev_aio.a 00:02:22.655 SO libspdk_bdev_null.so.5.0 00:02:22.655 SO libspdk_bdev_passthru.so.5.0 00:02:22.655 SO libspdk_bdev_error.so.5.0 00:02:22.655 SYMLINK libspdk_bdev_zone_block.so 00:02:22.655 LIB libspdk_bdev_malloc.a 00:02:22.655 SYMLINK libspdk_bdev_split.so 00:02:22.655 SO libspdk_bdev_aio.so.5.0 00:02:22.655 SYMLINK libspdk_bdev_gpt.so 00:02:22.655 SO libspdk_bdev_malloc.so.5.0 00:02:22.655 SYMLINK libspdk_bdev_null.so 00:02:22.655 SYMLINK libspdk_bdev_passthru.so 00:02:22.655 SYMLINK libspdk_bdev_error.so 00:02:22.655 SYMLINK libspdk_bdev_aio.so 00:02:22.655 LIB libspdk_bdev_delay.a 00:02:22.655 SYMLINK libspdk_bdev_malloc.so 00:02:22.655 LIB libspdk_bdev_iscsi.a 00:02:22.655 SO libspdk_bdev_delay.so.5.0 00:02:22.655 SO libspdk_bdev_iscsi.so.5.0 00:02:22.912 SYMLINK libspdk_bdev_delay.so 00:02:22.912 SYMLINK libspdk_bdev_iscsi.so 00:02:22.912 LIB libspdk_bdev_virtio.a 00:02:22.912 LIB libspdk_bdev_lvol.a 00:02:22.912 SO libspdk_bdev_virtio.so.5.0 00:02:22.912 SO libspdk_bdev_lvol.so.5.0 00:02:22.912 SYMLINK libspdk_bdev_lvol.so 00:02:22.912 SYMLINK libspdk_bdev_virtio.so 00:02:23.170 LIB libspdk_bdev_raid.a 00:02:23.170 SO libspdk_bdev_raid.so.5.0 00:02:23.170 SYMLINK libspdk_bdev_raid.so 00:02:24.544 LIB libspdk_bdev_nvme.a 00:02:24.544 SO libspdk_bdev_nvme.so.6.0 00:02:24.544 SYMLINK libspdk_bdev_nvme.so 00:02:24.802 CC module/event/subsystems/iobuf/iobuf.o 00:02:24.802 CC module/event/subsystems/sock/sock.o 00:02:24.802 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:24.802 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:24.802 CC module/event/subsystems/vmd/vmd.o 00:02:24.802 CC module/event/subsystems/scheduler/scheduler.o 00:02:24.802 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:24.802 LIB libspdk_event_sock.a 00:02:24.802 LIB libspdk_event_vhost_blk.a 00:02:24.802 LIB libspdk_event_scheduler.a 00:02:24.802 LIB libspdk_event_vmd.a 00:02:25.061 SO libspdk_event_sock.so.4.0 00:02:25.061 LIB libspdk_event_iobuf.a 00:02:25.061 SO libspdk_event_vhost_blk.so.2.0 00:02:25.061 SO libspdk_event_scheduler.so.3.0 00:02:25.061 SO libspdk_event_vmd.so.5.0 00:02:25.061 SO libspdk_event_iobuf.so.2.0 00:02:25.061 SYMLINK libspdk_event_sock.so 00:02:25.061 SYMLINK libspdk_event_vhost_blk.so 00:02:25.061 SYMLINK libspdk_event_scheduler.so 00:02:25.061 SYMLINK libspdk_event_vmd.so 00:02:25.061 SYMLINK libspdk_event_iobuf.so 00:02:25.061 CC module/event/subsystems/accel/accel.o 00:02:25.320 LIB libspdk_event_accel.a 00:02:25.320 SO libspdk_event_accel.so.5.0 00:02:25.320 SYMLINK libspdk_event_accel.so 00:02:25.579 CC module/event/subsystems/bdev/bdev.o 00:02:25.579 LIB libspdk_event_bdev.a 00:02:25.579 SO libspdk_event_bdev.so.5.0 00:02:25.579 SYMLINK libspdk_event_bdev.so 00:02:25.837 CC module/event/subsystems/nbd/nbd.o 00:02:25.837 CC module/event/subsystems/scsi/scsi.o 00:02:25.837 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:25.837 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:25.837 CC module/event/subsystems/ublk/ublk.o 00:02:25.837 LIB libspdk_event_nbd.a 00:02:25.837 LIB libspdk_event_ublk.a 00:02:25.837 LIB libspdk_event_scsi.a 00:02:25.837 SO libspdk_event_ublk.so.2.0 00:02:25.837 SO libspdk_event_nbd.so.5.0 00:02:26.095 SO libspdk_event_scsi.so.5.0 00:02:26.095 SYMLINK libspdk_event_nbd.so 00:02:26.095 SYMLINK libspdk_event_ublk.so 00:02:26.095 SYMLINK libspdk_event_scsi.so 00:02:26.095 LIB libspdk_event_nvmf.a 00:02:26.095 SO libspdk_event_nvmf.so.5.0 00:02:26.095 SYMLINK libspdk_event_nvmf.so 00:02:26.095 CC module/event/subsystems/iscsi/iscsi.o 00:02:26.095 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:26.353 LIB libspdk_event_vhost_scsi.a 00:02:26.353 SO libspdk_event_vhost_scsi.so.2.0 00:02:26.353 LIB libspdk_event_iscsi.a 00:02:26.353 SO libspdk_event_iscsi.so.5.0 00:02:26.353 SYMLINK libspdk_event_vhost_scsi.so 00:02:26.353 SYMLINK libspdk_event_iscsi.so 00:02:26.353 SO libspdk.so.5.0 00:02:26.353 SYMLINK libspdk.so 00:02:26.617 CXX app/trace/trace.o 00:02:26.617 CC app/spdk_lspci/spdk_lspci.o 00:02:26.617 CC app/trace_record/trace_record.o 00:02:26.617 CC test/rpc_client/rpc_client_test.o 00:02:26.617 TEST_HEADER include/spdk/accel.h 00:02:26.617 CC app/spdk_nvme_perf/perf.o 00:02:26.617 TEST_HEADER include/spdk/accel_module.h 00:02:26.617 CC app/spdk_nvme_identify/identify.o 00:02:26.617 TEST_HEADER include/spdk/assert.h 00:02:26.617 CC app/spdk_top/spdk_top.o 00:02:26.617 TEST_HEADER include/spdk/barrier.h 00:02:26.617 CC app/spdk_nvme_discover/discovery_aer.o 00:02:26.617 TEST_HEADER include/spdk/base64.h 00:02:26.617 TEST_HEADER include/spdk/bdev.h 00:02:26.617 TEST_HEADER include/spdk/bdev_module.h 00:02:26.617 TEST_HEADER include/spdk/bdev_zone.h 00:02:26.617 TEST_HEADER include/spdk/bit_array.h 00:02:26.617 TEST_HEADER include/spdk/bit_pool.h 00:02:26.617 TEST_HEADER include/spdk/blob_bdev.h 00:02:26.617 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:26.617 TEST_HEADER include/spdk/blobfs.h 00:02:26.617 TEST_HEADER include/spdk/blob.h 00:02:26.617 TEST_HEADER include/spdk/conf.h 00:02:26.617 CC app/spdk_dd/spdk_dd.o 00:02:26.617 TEST_HEADER include/spdk/config.h 00:02:26.617 TEST_HEADER include/spdk/cpuset.h 00:02:26.617 TEST_HEADER include/spdk/crc16.h 00:02:26.617 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:26.617 TEST_HEADER include/spdk/crc32.h 00:02:26.617 TEST_HEADER include/spdk/crc64.h 00:02:26.617 CC app/nvmf_tgt/nvmf_main.o 00:02:26.617 TEST_HEADER include/spdk/dif.h 00:02:26.617 CC app/iscsi_tgt/iscsi_tgt.o 00:02:26.617 TEST_HEADER include/spdk/dma.h 00:02:26.617 TEST_HEADER include/spdk/endian.h 00:02:26.617 TEST_HEADER include/spdk/env_dpdk.h 00:02:26.617 TEST_HEADER include/spdk/env.h 00:02:26.617 CC test/thread/poller_perf/poller_perf.o 00:02:26.617 TEST_HEADER include/spdk/event.h 00:02:26.617 CC test/app/jsoncat/jsoncat.o 00:02:26.617 CC examples/idxd/perf/perf.o 00:02:26.617 CC examples/nvme/hello_world/hello_world.o 00:02:26.617 TEST_HEADER include/spdk/fd_group.h 00:02:26.617 CC examples/vmd/lsvmd/lsvmd.o 00:02:26.617 CC examples/sock/hello_world/hello_sock.o 00:02:26.617 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:26.617 CC test/env/vtophys/vtophys.o 00:02:26.617 CC examples/nvme/reconnect/reconnect.o 00:02:26.617 CC examples/nvme/arbitration/arbitration.o 00:02:26.617 CC app/vhost/vhost.o 00:02:26.617 CC examples/vmd/led/led.o 00:02:26.617 TEST_HEADER include/spdk/fd.h 00:02:26.617 CC examples/nvme/hotplug/hotplug.o 00:02:26.617 CC examples/ioat/perf/perf.o 00:02:26.617 CC test/app/stub/stub.o 00:02:26.617 CC test/app/histogram_perf/histogram_perf.o 00:02:26.617 TEST_HEADER include/spdk/file.h 00:02:26.617 CC examples/accel/perf/accel_perf.o 00:02:26.617 TEST_HEADER include/spdk/ftl.h 00:02:26.617 CC examples/util/zipf/zipf.o 00:02:26.617 TEST_HEADER include/spdk/gpt_spec.h 00:02:26.617 CC app/fio/nvme/fio_plugin.o 00:02:26.617 TEST_HEADER include/spdk/hexlify.h 00:02:26.617 CC test/event/event_perf/event_perf.o 00:02:26.617 TEST_HEADER include/spdk/histogram_data.h 00:02:26.617 CC test/nvme/aer/aer.o 00:02:26.617 TEST_HEADER include/spdk/idxd.h 00:02:26.617 TEST_HEADER include/spdk/idxd_spec.h 00:02:26.617 CC app/spdk_tgt/spdk_tgt.o 00:02:26.617 TEST_HEADER include/spdk/init.h 00:02:26.617 TEST_HEADER include/spdk/ioat.h 00:02:26.617 TEST_HEADER include/spdk/ioat_spec.h 00:02:26.617 TEST_HEADER include/spdk/iscsi_spec.h 00:02:26.617 TEST_HEADER include/spdk/json.h 00:02:26.617 TEST_HEADER include/spdk/jsonrpc.h 00:02:26.617 TEST_HEADER include/spdk/likely.h 00:02:26.617 TEST_HEADER include/spdk/log.h 00:02:26.876 CC test/blobfs/mkfs/mkfs.o 00:02:26.876 CC test/accel/dif/dif.o 00:02:26.876 TEST_HEADER include/spdk/lvol.h 00:02:26.876 TEST_HEADER include/spdk/memory.h 00:02:26.876 CC test/dma/test_dma/test_dma.o 00:02:26.876 CC examples/nvmf/nvmf/nvmf.o 00:02:26.876 CC test/app/bdev_svc/bdev_svc.o 00:02:26.876 CC examples/bdev/hello_world/hello_bdev.o 00:02:26.876 TEST_HEADER include/spdk/mmio.h 00:02:26.876 CC test/bdev/bdevio/bdevio.o 00:02:26.876 TEST_HEADER include/spdk/nbd.h 00:02:26.876 CC examples/bdev/bdevperf/bdevperf.o 00:02:26.876 CC examples/blob/hello_world/hello_blob.o 00:02:26.876 CC examples/thread/thread/thread_ex.o 00:02:26.876 TEST_HEADER include/spdk/notify.h 00:02:26.876 TEST_HEADER include/spdk/nvme.h 00:02:26.876 TEST_HEADER include/spdk/nvme_intel.h 00:02:26.876 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:26.876 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:26.876 TEST_HEADER include/spdk/nvme_spec.h 00:02:26.876 CC test/env/mem_callbacks/mem_callbacks.o 00:02:26.876 TEST_HEADER include/spdk/nvme_zns.h 00:02:26.876 CC test/lvol/esnap/esnap.o 00:02:26.876 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:26.876 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:26.876 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:26.876 TEST_HEADER include/spdk/nvmf.h 00:02:26.876 TEST_HEADER include/spdk/nvmf_spec.h 00:02:26.876 TEST_HEADER include/spdk/nvmf_transport.h 00:02:26.876 TEST_HEADER include/spdk/opal.h 00:02:26.876 TEST_HEADER include/spdk/opal_spec.h 00:02:26.876 TEST_HEADER include/spdk/pci_ids.h 00:02:26.876 TEST_HEADER include/spdk/pipe.h 00:02:26.876 TEST_HEADER include/spdk/queue.h 00:02:26.876 TEST_HEADER include/spdk/reduce.h 00:02:26.876 TEST_HEADER include/spdk/rpc.h 00:02:26.876 TEST_HEADER include/spdk/scheduler.h 00:02:26.876 TEST_HEADER include/spdk/scsi.h 00:02:26.876 TEST_HEADER include/spdk/scsi_spec.h 00:02:26.876 TEST_HEADER include/spdk/sock.h 00:02:26.876 TEST_HEADER include/spdk/stdinc.h 00:02:26.876 LINK spdk_lspci 00:02:26.876 TEST_HEADER include/spdk/string.h 00:02:26.876 TEST_HEADER include/spdk/thread.h 00:02:26.876 TEST_HEADER include/spdk/trace.h 00:02:26.876 TEST_HEADER include/spdk/trace_parser.h 00:02:26.876 TEST_HEADER include/spdk/tree.h 00:02:26.876 TEST_HEADER include/spdk/ublk.h 00:02:26.876 TEST_HEADER include/spdk/util.h 00:02:26.876 TEST_HEADER include/spdk/uuid.h 00:02:26.876 TEST_HEADER include/spdk/version.h 00:02:26.876 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:26.876 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:26.876 TEST_HEADER include/spdk/vhost.h 00:02:26.876 TEST_HEADER include/spdk/vmd.h 00:02:26.876 TEST_HEADER include/spdk/xor.h 00:02:26.876 TEST_HEADER include/spdk/zipf.h 00:02:26.876 CXX test/cpp_headers/accel.o 00:02:26.876 LINK lsvmd 00:02:26.876 LINK jsoncat 00:02:26.876 LINK rpc_client_test 00:02:26.876 LINK vtophys 00:02:26.876 LINK poller_perf 00:02:26.876 LINK histogram_perf 00:02:26.876 LINK spdk_nvme_discover 00:02:26.876 LINK led 00:02:26.876 LINK event_perf 00:02:27.138 LINK zipf 00:02:27.138 LINK interrupt_tgt 00:02:27.138 LINK nvmf_tgt 00:02:27.138 LINK stub 00:02:27.138 LINK vhost 00:02:27.138 LINK spdk_trace_record 00:02:27.138 LINK iscsi_tgt 00:02:27.138 LINK bdev_svc 00:02:27.138 LINK ioat_perf 00:02:27.138 LINK hello_world 00:02:27.138 LINK spdk_tgt 00:02:27.138 LINK mkfs 00:02:27.138 LINK hotplug 00:02:27.138 LINK hello_sock 00:02:27.138 LINK hello_bdev 00:02:27.138 LINK thread 00:02:27.138 LINK hello_blob 00:02:27.138 LINK aer 00:02:27.138 CC test/event/reactor/reactor.o 00:02:27.404 CXX test/cpp_headers/accel_module.o 00:02:27.404 CXX test/cpp_headers/assert.o 00:02:27.404 CXX test/cpp_headers/barrier.o 00:02:27.404 LINK idxd_perf 00:02:27.404 LINK spdk_dd 00:02:27.404 LINK nvmf 00:02:27.404 LINK arbitration 00:02:27.404 CC test/event/reactor_perf/reactor_perf.o 00:02:27.404 LINK reconnect 00:02:27.404 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:27.404 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:27.404 CC test/event/app_repeat/app_repeat.o 00:02:27.404 CC test/env/memory/memory_ut.o 00:02:27.404 CXX test/cpp_headers/base64.o 00:02:27.404 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:27.404 CC test/event/scheduler/scheduler.o 00:02:27.404 LINK spdk_trace 00:02:27.404 LINK dif 00:02:27.404 CC test/nvme/reset/reset.o 00:02:27.404 CC examples/ioat/verify/verify.o 00:02:27.404 CC test/nvme/sgl/sgl.o 00:02:27.404 CC app/fio/bdev/fio_plugin.o 00:02:27.404 LINK test_dma 00:02:27.404 LINK bdevio 00:02:27.404 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:27.667 CXX test/cpp_headers/bdev.o 00:02:27.667 LINK reactor 00:02:27.667 CC test/env/pci/pci_ut.o 00:02:27.667 CC test/nvme/e2edp/nvme_dp.o 00:02:27.667 LINK accel_perf 00:02:27.667 LINK nvme_fuzz 00:02:27.667 CC examples/nvme/abort/abort.o 00:02:27.667 LINK nvme_manage 00:02:27.667 CC test/nvme/overhead/overhead.o 00:02:27.667 CXX test/cpp_headers/bdev_module.o 00:02:27.667 CC test/nvme/err_injection/err_injection.o 00:02:27.667 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:27.667 CXX test/cpp_headers/bdev_zone.o 00:02:27.667 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:27.667 CXX test/cpp_headers/bit_array.o 00:02:27.667 CC test/nvme/startup/startup.o 00:02:27.667 CXX test/cpp_headers/bit_pool.o 00:02:27.667 LINK reactor_perf 00:02:27.667 CC examples/blob/cli/blobcli.o 00:02:27.667 CC test/nvme/reserve/reserve.o 00:02:27.667 LINK app_repeat 00:02:27.667 LINK env_dpdk_post_init 00:02:27.667 LINK cmb_copy 00:02:27.667 CXX test/cpp_headers/blob_bdev.o 00:02:27.667 CC test/nvme/simple_copy/simple_copy.o 00:02:27.667 CC test/nvme/connect_stress/connect_stress.o 00:02:27.667 LINK spdk_nvme 00:02:27.935 CC test/nvme/boot_partition/boot_partition.o 00:02:27.935 CC test/nvme/compliance/nvme_compliance.o 00:02:27.935 CXX test/cpp_headers/blobfs_bdev.o 00:02:27.935 CC test/nvme/fused_ordering/fused_ordering.o 00:02:27.935 CXX test/cpp_headers/blobfs.o 00:02:27.935 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:27.935 CC test/nvme/fdp/fdp.o 00:02:27.935 CXX test/cpp_headers/blob.o 00:02:27.935 LINK scheduler 00:02:27.935 CXX test/cpp_headers/conf.o 00:02:27.935 CXX test/cpp_headers/config.o 00:02:27.935 LINK verify 00:02:27.935 CXX test/cpp_headers/cpuset.o 00:02:27.935 CC test/nvme/cuse/cuse.o 00:02:27.935 CXX test/cpp_headers/crc16.o 00:02:27.935 CXX test/cpp_headers/crc32.o 00:02:27.935 CXX test/cpp_headers/crc64.o 00:02:27.935 CXX test/cpp_headers/dif.o 00:02:27.935 LINK mem_callbacks 00:02:27.935 LINK pmr_persistence 00:02:27.935 LINK reset 00:02:27.935 LINK startup 00:02:27.935 CXX test/cpp_headers/dma.o 00:02:27.935 CXX test/cpp_headers/endian.o 00:02:27.935 LINK err_injection 00:02:27.935 CXX test/cpp_headers/env_dpdk.o 00:02:27.935 LINK sgl 00:02:27.935 CXX test/cpp_headers/env.o 00:02:27.935 CXX test/cpp_headers/event.o 00:02:28.194 CXX test/cpp_headers/fd_group.o 00:02:28.194 CXX test/cpp_headers/fd.o 00:02:28.194 LINK spdk_nvme_perf 00:02:28.194 LINK nvme_dp 00:02:28.194 LINK reserve 00:02:28.194 LINK connect_stress 00:02:28.194 LINK boot_partition 00:02:28.194 CXX test/cpp_headers/file.o 00:02:28.194 CXX test/cpp_headers/ftl.o 00:02:28.194 LINK overhead 00:02:28.194 CXX test/cpp_headers/gpt_spec.o 00:02:28.194 LINK spdk_nvme_identify 00:02:28.194 LINK fused_ordering 00:02:28.194 LINK bdevperf 00:02:28.194 CXX test/cpp_headers/histogram_data.o 00:02:28.194 CXX test/cpp_headers/hexlify.o 00:02:28.194 LINK simple_copy 00:02:28.194 LINK doorbell_aers 00:02:28.194 CXX test/cpp_headers/idxd.o 00:02:28.194 CXX test/cpp_headers/idxd_spec.o 00:02:28.194 LINK spdk_top 00:02:28.194 CXX test/cpp_headers/init.o 00:02:28.194 CXX test/cpp_headers/ioat.o 00:02:28.194 CXX test/cpp_headers/ioat_spec.o 00:02:28.194 CXX test/cpp_headers/iscsi_spec.o 00:02:28.194 CXX test/cpp_headers/json.o 00:02:28.194 CXX test/cpp_headers/jsonrpc.o 00:02:28.194 LINK pci_ut 00:02:28.194 CXX test/cpp_headers/likely.o 00:02:28.194 CXX test/cpp_headers/log.o 00:02:28.458 CXX test/cpp_headers/lvol.o 00:02:28.458 CXX test/cpp_headers/memory.o 00:02:28.458 LINK abort 00:02:28.458 CXX test/cpp_headers/mmio.o 00:02:28.458 CXX test/cpp_headers/nbd.o 00:02:28.458 CXX test/cpp_headers/notify.o 00:02:28.458 CXX test/cpp_headers/nvme.o 00:02:28.458 LINK spdk_bdev 00:02:28.458 CXX test/cpp_headers/nvme_intel.o 00:02:28.458 LINK nvme_compliance 00:02:28.458 LINK vhost_fuzz 00:02:28.458 CXX test/cpp_headers/nvme_ocssd.o 00:02:28.458 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:28.458 CXX test/cpp_headers/nvme_spec.o 00:02:28.458 CXX test/cpp_headers/nvme_zns.o 00:02:28.458 CXX test/cpp_headers/nvmf_cmd.o 00:02:28.458 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:28.458 CXX test/cpp_headers/nvmf.o 00:02:28.458 CXX test/cpp_headers/nvmf_spec.o 00:02:28.458 CXX test/cpp_headers/nvmf_transport.o 00:02:28.458 LINK fdp 00:02:28.458 CXX test/cpp_headers/opal.o 00:02:28.458 CXX test/cpp_headers/opal_spec.o 00:02:28.458 CXX test/cpp_headers/pci_ids.o 00:02:28.458 CXX test/cpp_headers/pipe.o 00:02:28.458 CXX test/cpp_headers/queue.o 00:02:28.458 CXX test/cpp_headers/reduce.o 00:02:28.458 CXX test/cpp_headers/rpc.o 00:02:28.458 CXX test/cpp_headers/scheduler.o 00:02:28.715 CXX test/cpp_headers/scsi.o 00:02:28.715 CXX test/cpp_headers/scsi_spec.o 00:02:28.715 CXX test/cpp_headers/sock.o 00:02:28.715 CXX test/cpp_headers/stdinc.o 00:02:28.715 LINK blobcli 00:02:28.715 CXX test/cpp_headers/string.o 00:02:28.715 CXX test/cpp_headers/thread.o 00:02:28.715 CXX test/cpp_headers/trace.o 00:02:28.715 CXX test/cpp_headers/trace_parser.o 00:02:28.715 CXX test/cpp_headers/tree.o 00:02:28.715 CXX test/cpp_headers/ublk.o 00:02:28.715 CXX test/cpp_headers/util.o 00:02:28.715 CXX test/cpp_headers/uuid.o 00:02:28.715 CXX test/cpp_headers/version.o 00:02:28.715 CXX test/cpp_headers/vfio_user_pci.o 00:02:28.716 CXX test/cpp_headers/vfio_user_spec.o 00:02:28.716 CXX test/cpp_headers/vhost.o 00:02:28.716 CXX test/cpp_headers/vmd.o 00:02:28.716 CXX test/cpp_headers/xor.o 00:02:28.716 CXX test/cpp_headers/zipf.o 00:02:28.991 LINK memory_ut 00:02:29.557 LINK cuse 00:02:29.815 LINK iscsi_fuzz 00:02:32.352 LINK esnap 00:02:32.352 00:02:32.352 real 0m45.942s 00:02:32.352 user 9m39.418s 00:02:32.352 sys 2m9.789s 00:02:32.352 20:52:28 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:32.352 20:52:28 -- common/autotest_common.sh@10 -- $ set +x 00:02:32.352 ************************************ 00:02:32.352 END TEST make 00:02:32.352 ************************************ 00:02:32.610 20:52:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:32.610 20:52:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:32.610 20:52:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:32.610 20:52:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:32.610 20:52:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:32.610 20:52:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:32.610 20:52:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:32.610 20:52:28 -- scripts/common.sh@335 -- # IFS=.-: 00:02:32.610 20:52:28 -- scripts/common.sh@335 -- # read -ra ver1 00:02:32.610 20:52:28 -- scripts/common.sh@336 -- # IFS=.-: 00:02:32.610 20:52:28 -- scripts/common.sh@336 -- # read -ra ver2 00:02:32.610 20:52:28 -- scripts/common.sh@337 -- # local 'op=<' 00:02:32.610 20:52:28 -- scripts/common.sh@339 -- # ver1_l=2 00:02:32.610 20:52:28 -- scripts/common.sh@340 -- # ver2_l=1 00:02:32.610 20:52:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:32.610 20:52:28 -- scripts/common.sh@343 -- # case "$op" in 00:02:32.610 20:52:28 -- scripts/common.sh@344 -- # : 1 00:02:32.610 20:52:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:32.610 20:52:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:32.610 20:52:28 -- scripts/common.sh@364 -- # decimal 1 00:02:32.610 20:52:28 -- scripts/common.sh@352 -- # local d=1 00:02:32.610 20:52:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:32.610 20:52:28 -- scripts/common.sh@354 -- # echo 1 00:02:32.610 20:52:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:32.610 20:52:28 -- scripts/common.sh@365 -- # decimal 2 00:02:32.610 20:52:28 -- scripts/common.sh@352 -- # local d=2 00:02:32.610 20:52:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:32.610 20:52:28 -- scripts/common.sh@354 -- # echo 2 00:02:32.610 20:52:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:32.610 20:52:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:32.610 20:52:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:32.610 20:52:28 -- scripts/common.sh@367 -- # return 0 00:02:32.610 20:52:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:32.610 20:52:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.610 --rc genhtml_branch_coverage=1 00:02:32.610 --rc genhtml_function_coverage=1 00:02:32.610 --rc genhtml_legend=1 00:02:32.610 --rc geninfo_all_blocks=1 00:02:32.610 --rc geninfo_unexecuted_blocks=1 00:02:32.610 00:02:32.610 ' 00:02:32.610 20:52:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.610 --rc genhtml_branch_coverage=1 00:02:32.610 --rc genhtml_function_coverage=1 00:02:32.610 --rc genhtml_legend=1 00:02:32.610 --rc geninfo_all_blocks=1 00:02:32.610 --rc geninfo_unexecuted_blocks=1 00:02:32.610 00:02:32.610 ' 00:02:32.610 20:52:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.610 --rc genhtml_branch_coverage=1 00:02:32.610 --rc genhtml_function_coverage=1 00:02:32.610 --rc genhtml_legend=1 00:02:32.610 --rc geninfo_all_blocks=1 00:02:32.610 --rc geninfo_unexecuted_blocks=1 00:02:32.610 00:02:32.610 ' 00:02:32.610 20:52:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:32.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.610 --rc genhtml_branch_coverage=1 00:02:32.610 --rc genhtml_function_coverage=1 00:02:32.610 --rc genhtml_legend=1 00:02:32.610 --rc geninfo_all_blocks=1 00:02:32.610 --rc geninfo_unexecuted_blocks=1 00:02:32.610 00:02:32.610 ' 00:02:32.610 20:52:28 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:32.610 20:52:28 -- nvmf/common.sh@7 -- # uname -s 00:02:32.610 20:52:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:32.610 20:52:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:32.610 20:52:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:32.610 20:52:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:32.611 20:52:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:32.611 20:52:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:32.611 20:52:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:32.611 20:52:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:32.611 20:52:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:32.611 20:52:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:32.611 20:52:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:32.611 20:52:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:32.611 20:52:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:32.611 20:52:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:32.611 20:52:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:32.611 20:52:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:32.611 20:52:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:32.611 20:52:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:32.611 20:52:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:32.611 20:52:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.611 20:52:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.611 20:52:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.611 20:52:28 -- paths/export.sh@5 -- # export PATH 00:02:32.611 20:52:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:32.611 20:52:28 -- nvmf/common.sh@46 -- # : 0 00:02:32.611 20:52:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:32.611 20:52:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:32.611 20:52:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:32.611 20:52:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:32.611 20:52:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:32.611 20:52:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:32.611 20:52:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:32.611 20:52:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:32.611 20:52:28 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:32.611 20:52:28 -- spdk/autotest.sh@32 -- # uname -s 00:02:32.611 20:52:28 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:32.611 20:52:28 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:32.611 20:52:28 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:32.611 20:52:28 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:32.611 20:52:28 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:32.611 20:52:28 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:32.611 20:52:28 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:32.611 20:52:28 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:32.611 20:52:28 -- spdk/autotest.sh@48 -- # udevadm_pid=3828765 00:02:32.611 20:52:28 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:32.611 20:52:28 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.611 20:52:28 -- spdk/autotest.sh@54 -- # echo 3828767 00:02:32.611 20:52:28 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.611 20:52:28 -- spdk/autotest.sh@56 -- # echo 3828768 00:02:32.611 20:52:28 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:32.611 20:52:28 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:32.611 20:52:28 -- spdk/autotest.sh@60 -- # echo 3828769 00:02:32.611 20:52:28 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:32.611 20:52:28 -- spdk/autotest.sh@62 -- # echo 3828770 00:02:32.611 20:52:28 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:32.611 20:52:28 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:32.611 20:52:28 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:32.611 20:52:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:32.611 20:52:28 -- common/autotest_common.sh@10 -- # set +x 00:02:32.611 20:52:28 -- spdk/autotest.sh@70 -- # create_test_list 00:02:32.611 20:52:28 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:32.611 20:52:28 -- common/autotest_common.sh@10 -- # set +x 00:02:32.611 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:32.611 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:32.611 20:52:28 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:32.611 20:52:28 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.611 20:52:28 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.611 20:52:28 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:32.611 20:52:28 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:32.611 20:52:28 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:32.611 20:52:28 -- common/autotest_common.sh@1450 -- # uname 00:02:32.611 20:52:28 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:32.611 20:52:28 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:32.611 20:52:28 -- common/autotest_common.sh@1470 -- # uname 00:02:32.611 20:52:28 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:32.611 20:52:28 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:32.611 20:52:28 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:32.611 lcov: LCOV version 1.15 00:02:32.611 20:52:28 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:50.693 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:50.693 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:50.693 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:50.693 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:50.693 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:50.693 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:05.568 20:53:01 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:05.568 20:53:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:05.568 20:53:01 -- common/autotest_common.sh@10 -- # set +x 00:03:05.568 20:53:01 -- spdk/autotest.sh@89 -- # rm -f 00:03:05.568 20:53:01 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:06.502 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:06.502 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:06.502 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:06.502 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:06.502 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:06.502 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:06.502 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:06.502 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:06.502 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:06.502 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:06.502 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:06.502 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:06.502 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:06.502 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:06.502 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:06.502 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:06.502 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:06.760 20:53:02 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:06.760 20:53:02 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:06.760 20:53:02 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:06.760 20:53:02 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:06.760 20:53:02 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:06.760 20:53:02 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:06.760 20:53:02 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:06.760 20:53:02 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:06.760 20:53:02 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:06.760 20:53:02 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:06.760 20:53:02 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:06.760 20:53:02 -- spdk/autotest.sh@108 -- # grep -v p 00:03:06.760 20:53:02 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:06.760 20:53:02 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:06.760 20:53:02 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:06.760 20:53:02 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:06.760 20:53:02 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:06.760 No valid GPT data, bailing 00:03:06.760 20:53:02 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:06.760 20:53:02 -- scripts/common.sh@393 -- # pt= 00:03:06.760 20:53:02 -- scripts/common.sh@394 -- # return 1 00:03:06.760 20:53:02 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:06.760 1+0 records in 00:03:06.760 1+0 records out 00:03:06.760 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00162549 s, 645 MB/s 00:03:06.760 20:53:02 -- spdk/autotest.sh@116 -- # sync 00:03:06.760 20:53:02 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:06.760 20:53:02 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:06.760 20:53:02 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:08.660 20:53:04 -- spdk/autotest.sh@122 -- # uname -s 00:03:08.660 20:53:04 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:08.660 20:53:04 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.660 20:53:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.660 20:53:04 -- common/autotest_common.sh@10 -- # set +x 00:03:08.660 ************************************ 00:03:08.660 START TEST setup.sh 00:03:08.660 ************************************ 00:03:08.660 20:53:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:08.660 * Looking for test storage... 00:03:08.660 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.660 20:53:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.660 20:53:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.660 20:53:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.660 20:53:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.660 20:53:04 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.660 20:53:04 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.660 20:53:04 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.660 20:53:04 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.660 20:53:04 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.660 20:53:04 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.660 20:53:04 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.660 20:53:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.660 20:53:04 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.660 20:53:04 -- scripts/common.sh@344 -- # : 1 00:03:08.660 20:53:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.660 20:53:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.660 20:53:04 -- scripts/common.sh@364 -- # decimal 1 00:03:08.660 20:53:04 -- scripts/common.sh@352 -- # local d=1 00:03:08.660 20:53:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.660 20:53:04 -- scripts/common.sh@354 -- # echo 1 00:03:08.660 20:53:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.660 20:53:04 -- scripts/common.sh@365 -- # decimal 2 00:03:08.660 20:53:04 -- scripts/common.sh@352 -- # local d=2 00:03:08.660 20:53:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.660 20:53:04 -- scripts/common.sh@354 -- # echo 2 00:03:08.660 20:53:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.660 20:53:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.660 20:53:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.660 20:53:04 -- scripts/common.sh@367 -- # return 0 00:03:08.660 20:53:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- setup/test-setup.sh@10 -- # uname -s 00:03:08.660 20:53:04 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:08.660 20:53:04 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.660 20:53:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.660 20:53:04 -- common/autotest_common.sh@10 -- # set +x 00:03:08.660 ************************************ 00:03:08.660 START TEST acl 00:03:08.660 ************************************ 00:03:08.660 20:53:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:08.660 * Looking for test storage... 00:03:08.660 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.660 20:53:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:08.660 20:53:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:08.660 20:53:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:08.660 20:53:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:08.660 20:53:04 -- scripts/common.sh@335 -- # IFS=.-: 00:03:08.660 20:53:04 -- scripts/common.sh@335 -- # read -ra ver1 00:03:08.660 20:53:04 -- scripts/common.sh@336 -- # IFS=.-: 00:03:08.660 20:53:04 -- scripts/common.sh@336 -- # read -ra ver2 00:03:08.660 20:53:04 -- scripts/common.sh@337 -- # local 'op=<' 00:03:08.660 20:53:04 -- scripts/common.sh@339 -- # ver1_l=2 00:03:08.660 20:53:04 -- scripts/common.sh@340 -- # ver2_l=1 00:03:08.660 20:53:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:08.660 20:53:04 -- scripts/common.sh@343 -- # case "$op" in 00:03:08.660 20:53:04 -- scripts/common.sh@344 -- # : 1 00:03:08.660 20:53:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:08.660 20:53:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:08.660 20:53:04 -- scripts/common.sh@364 -- # decimal 1 00:03:08.660 20:53:04 -- scripts/common.sh@352 -- # local d=1 00:03:08.660 20:53:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:08.660 20:53:04 -- scripts/common.sh@354 -- # echo 1 00:03:08.660 20:53:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:08.660 20:53:04 -- scripts/common.sh@365 -- # decimal 2 00:03:08.660 20:53:04 -- scripts/common.sh@352 -- # local d=2 00:03:08.660 20:53:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:08.660 20:53:04 -- scripts/common.sh@354 -- # echo 2 00:03:08.660 20:53:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:08.660 20:53:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:08.660 20:53:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:08.660 20:53:04 -- scripts/common.sh@367 -- # return 0 00:03:08.660 20:53:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.660 --rc genhtml_function_coverage=1 00:03:08.660 --rc genhtml_legend=1 00:03:08.660 --rc geninfo_all_blocks=1 00:03:08.660 --rc geninfo_unexecuted_blocks=1 00:03:08.660 00:03:08.660 ' 00:03:08.660 20:53:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:08.660 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:08.660 --rc genhtml_branch_coverage=1 00:03:08.661 --rc genhtml_function_coverage=1 00:03:08.661 --rc genhtml_legend=1 00:03:08.661 --rc geninfo_all_blocks=1 00:03:08.661 --rc geninfo_unexecuted_blocks=1 00:03:08.661 00:03:08.661 ' 00:03:08.661 20:53:04 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:08.661 20:53:04 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:08.661 20:53:04 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:08.661 20:53:04 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:08.661 20:53:04 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:08.661 20:53:04 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:08.661 20:53:04 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:08.661 20:53:04 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:08.661 20:53:04 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:08.661 20:53:04 -- setup/acl.sh@12 -- # devs=() 00:03:08.661 20:53:04 -- setup/acl.sh@12 -- # declare -a devs 00:03:08.661 20:53:04 -- setup/acl.sh@13 -- # drivers=() 00:03:08.661 20:53:04 -- setup/acl.sh@13 -- # declare -A drivers 00:03:08.661 20:53:04 -- setup/acl.sh@51 -- # setup reset 00:03:08.661 20:53:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:08.661 20:53:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.560 20:53:06 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:10.560 20:53:06 -- setup/acl.sh@16 -- # local dev driver 00:03:10.560 20:53:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:10.560 20:53:06 -- setup/acl.sh@15 -- # setup output status 00:03:10.560 20:53:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.560 20:53:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:11.134 Hugepages 00:03:11.134 node hugesize free / total 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 00:03:11.134 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.134 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.134 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.134 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.485 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.485 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.485 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.486 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.486 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.486 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.486 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.486 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.486 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # continue 00:03:11.486 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.486 20:53:07 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:11.486 20:53:07 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:11.486 20:53:07 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:11.486 20:53:07 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:11.486 20:53:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.486 20:53:07 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:11.486 20:53:07 -- setup/acl.sh@54 -- # run_test denied denied 00:03:11.486 20:53:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.486 20:53:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.486 20:53:07 -- common/autotest_common.sh@10 -- # set +x 00:03:11.486 ************************************ 00:03:11.486 START TEST denied 00:03:11.486 ************************************ 00:03:11.486 20:53:07 -- common/autotest_common.sh@1114 -- # denied 00:03:11.486 20:53:07 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:11.486 20:53:07 -- setup/acl.sh@38 -- # setup output config 00:03:11.486 20:53:07 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:11.486 20:53:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.486 20:53:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:12.863 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:12.863 20:53:08 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:12.863 20:53:08 -- setup/acl.sh@28 -- # local dev driver 00:03:12.863 20:53:08 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:12.863 20:53:08 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:12.863 20:53:08 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:12.863 20:53:08 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:12.863 20:53:08 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:12.863 20:53:08 -- setup/acl.sh@41 -- # setup reset 00:03:12.863 20:53:08 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.863 20:53:08 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:15.394 00:03:15.394 real 0m4.000s 00:03:15.394 user 0m1.145s 00:03:15.394 sys 0m1.977s 00:03:15.394 20:53:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.394 20:53:11 -- common/autotest_common.sh@10 -- # set +x 00:03:15.395 ************************************ 00:03:15.395 END TEST denied 00:03:15.395 ************************************ 00:03:15.395 20:53:11 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:15.395 20:53:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.395 20:53:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.395 20:53:11 -- common/autotest_common.sh@10 -- # set +x 00:03:15.395 ************************************ 00:03:15.395 START TEST allowed 00:03:15.395 ************************************ 00:03:15.395 20:53:11 -- common/autotest_common.sh@1114 -- # allowed 00:03:15.395 20:53:11 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:15.395 20:53:11 -- setup/acl.sh@45 -- # setup output config 00:03:15.395 20:53:11 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:15.395 20:53:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.395 20:53:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:17.927 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:17.927 20:53:13 -- setup/acl.sh@47 -- # verify 00:03:17.927 20:53:13 -- setup/acl.sh@28 -- # local dev driver 00:03:17.927 20:53:13 -- setup/acl.sh@48 -- # setup reset 00:03:17.927 20:53:13 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:17.927 20:53:13 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:19.299 00:03:19.300 real 0m4.029s 00:03:19.300 user 0m1.015s 00:03:19.300 sys 0m1.911s 00:03:19.300 20:53:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.300 20:53:15 -- common/autotest_common.sh@10 -- # set +x 00:03:19.300 ************************************ 00:03:19.300 END TEST allowed 00:03:19.300 ************************************ 00:03:19.300 00:03:19.300 real 0m10.815s 00:03:19.300 user 0m3.280s 00:03:19.300 sys 0m5.643s 00:03:19.300 20:53:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.300 20:53:15 -- common/autotest_common.sh@10 -- # set +x 00:03:19.300 ************************************ 00:03:19.300 END TEST acl 00:03:19.300 ************************************ 00:03:19.559 20:53:15 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:19.560 20:53:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.560 20:53:15 -- common/autotest_common.sh@10 -- # set +x 00:03:19.560 ************************************ 00:03:19.560 START TEST hugepages 00:03:19.560 ************************************ 00:03:19.560 20:53:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:19.560 * Looking for test storage... 00:03:19.560 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:19.560 20:53:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:19.560 20:53:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:19.560 20:53:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:19.560 20:53:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:19.560 20:53:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:19.560 20:53:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:19.560 20:53:15 -- scripts/common.sh@335 -- # IFS=.-: 00:03:19.560 20:53:15 -- scripts/common.sh@335 -- # read -ra ver1 00:03:19.560 20:53:15 -- scripts/common.sh@336 -- # IFS=.-: 00:03:19.560 20:53:15 -- scripts/common.sh@336 -- # read -ra ver2 00:03:19.560 20:53:15 -- scripts/common.sh@337 -- # local 'op=<' 00:03:19.560 20:53:15 -- scripts/common.sh@339 -- # ver1_l=2 00:03:19.560 20:53:15 -- scripts/common.sh@340 -- # ver2_l=1 00:03:19.560 20:53:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:19.560 20:53:15 -- scripts/common.sh@343 -- # case "$op" in 00:03:19.560 20:53:15 -- scripts/common.sh@344 -- # : 1 00:03:19.560 20:53:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:19.560 20:53:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:19.560 20:53:15 -- scripts/common.sh@364 -- # decimal 1 00:03:19.560 20:53:15 -- scripts/common.sh@352 -- # local d=1 00:03:19.560 20:53:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:19.560 20:53:15 -- scripts/common.sh@354 -- # echo 1 00:03:19.560 20:53:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:19.560 20:53:15 -- scripts/common.sh@365 -- # decimal 2 00:03:19.560 20:53:15 -- scripts/common.sh@352 -- # local d=2 00:03:19.560 20:53:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:19.560 20:53:15 -- scripts/common.sh@354 -- # echo 2 00:03:19.560 20:53:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:19.560 20:53:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:19.560 20:53:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:19.560 20:53:15 -- scripts/common.sh@367 -- # return 0 00:03:19.560 20:53:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:19.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.560 --rc genhtml_branch_coverage=1 00:03:19.560 --rc genhtml_function_coverage=1 00:03:19.560 --rc genhtml_legend=1 00:03:19.560 --rc geninfo_all_blocks=1 00:03:19.560 --rc geninfo_unexecuted_blocks=1 00:03:19.560 00:03:19.560 ' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:19.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.560 --rc genhtml_branch_coverage=1 00:03:19.560 --rc genhtml_function_coverage=1 00:03:19.560 --rc genhtml_legend=1 00:03:19.560 --rc geninfo_all_blocks=1 00:03:19.560 --rc geninfo_unexecuted_blocks=1 00:03:19.560 00:03:19.560 ' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:19.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.560 --rc genhtml_branch_coverage=1 00:03:19.560 --rc genhtml_function_coverage=1 00:03:19.560 --rc genhtml_legend=1 00:03:19.560 --rc geninfo_all_blocks=1 00:03:19.560 --rc geninfo_unexecuted_blocks=1 00:03:19.560 00:03:19.560 ' 00:03:19.560 20:53:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:19.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.560 --rc genhtml_branch_coverage=1 00:03:19.560 --rc genhtml_function_coverage=1 00:03:19.560 --rc genhtml_legend=1 00:03:19.560 --rc geninfo_all_blocks=1 00:03:19.560 --rc geninfo_unexecuted_blocks=1 00:03:19.560 00:03:19.560 ' 00:03:19.560 20:53:15 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:19.560 20:53:15 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:19.560 20:53:15 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:19.560 20:53:15 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:19.560 20:53:15 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:19.560 20:53:15 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:19.560 20:53:15 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:19.560 20:53:15 -- setup/common.sh@18 -- # local node= 00:03:19.560 20:53:15 -- setup/common.sh@19 -- # local var val 00:03:19.560 20:53:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.560 20:53:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.560 20:53:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.560 20:53:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.560 20:53:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.560 20:53:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43060568 kB' 'MemAvailable: 46829276 kB' 'Buffers: 2708 kB' 'Cached: 10753960 kB' 'SwapCached: 0 kB' 'Active: 7471492 kB' 'Inactive: 3764112 kB' 'Active(anon): 7071012 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482236 kB' 'Mapped: 216880 kB' 'Shmem: 6592076 kB' 'KReclaimable: 195392 kB' 'Slab: 725508 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530116 kB' 'KernelStack: 12816 kB' 'PageTables: 8508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 8146336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.560 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.560 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.561 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.561 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:53:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.562 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:53:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.562 20:53:15 -- setup/common.sh@32 -- # continue 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.562 20:53:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.562 20:53:15 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:19.562 20:53:15 -- setup/common.sh@33 -- # echo 2048 00:03:19.562 20:53:15 -- setup/common.sh@33 -- # return 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:19.562 20:53:15 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:19.562 20:53:15 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:19.562 20:53:15 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:19.562 20:53:15 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:19.562 20:53:15 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:19.562 20:53:15 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:19.562 20:53:15 -- setup/hugepages.sh@207 -- # get_nodes 00:03:19.562 20:53:15 -- setup/hugepages.sh@27 -- # local node 00:03:19.562 20:53:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.562 20:53:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:19.562 20:53:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.562 20:53:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:19.562 20:53:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.562 20:53:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.562 20:53:15 -- setup/hugepages.sh@208 -- # clear_hp 00:03:19.562 20:53:15 -- setup/hugepages.sh@37 -- # local node hp 00:03:19.562 20:53:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.562 20:53:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.562 20:53:15 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.562 20:53:15 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.562 20:53:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.562 20:53:15 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.562 20:53:15 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:19.562 20:53:15 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:19.562 20:53:15 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:19.562 20:53:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.562 20:53:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.562 20:53:15 -- common/autotest_common.sh@10 -- # set +x 00:03:19.562 ************************************ 00:03:19.562 START TEST default_setup 00:03:19.562 ************************************ 00:03:19.562 20:53:15 -- common/autotest_common.sh@1114 -- # default_setup 00:03:19.562 20:53:15 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.562 20:53:15 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:19.562 20:53:15 -- setup/hugepages.sh@51 -- # shift 00:03:19.562 20:53:15 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:19.562 20:53:15 -- setup/hugepages.sh@52 -- # local node_ids 00:03:19.562 20:53:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.562 20:53:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.562 20:53:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:19.562 20:53:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.562 20:53:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.562 20:53:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.562 20:53:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.562 20:53:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.562 20:53:15 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:19.562 20:53:15 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:19.562 20:53:15 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:19.562 20:53:15 -- setup/hugepages.sh@73 -- # return 0 00:03:19.562 20:53:15 -- setup/hugepages.sh@137 -- # setup output 00:03:19.562 20:53:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.562 20:53:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.943 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.943 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.943 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:21.202 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:22.141 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:22.141 20:53:18 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:22.141 20:53:18 -- setup/hugepages.sh@89 -- # local node 00:03:22.141 20:53:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.142 20:53:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.142 20:53:18 -- setup/hugepages.sh@92 -- # local surp 00:03:22.142 20:53:18 -- setup/hugepages.sh@93 -- # local resv 00:03:22.142 20:53:18 -- setup/hugepages.sh@94 -- # local anon 00:03:22.142 20:53:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.142 20:53:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.142 20:53:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.142 20:53:18 -- setup/common.sh@18 -- # local node= 00:03:22.142 20:53:18 -- setup/common.sh@19 -- # local var val 00:03:22.142 20:53:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.142 20:53:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.142 20:53:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.142 20:53:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.142 20:53:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.142 20:53:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45192572 kB' 'MemAvailable: 48961280 kB' 'Buffers: 2708 kB' 'Cached: 10754048 kB' 'SwapCached: 0 kB' 'Active: 7469896 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069416 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480592 kB' 'Mapped: 216276 kB' 'Shmem: 6592164 kB' 'KReclaimable: 195392 kB' 'Slab: 725460 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530068 kB' 'KernelStack: 12832 kB' 'PageTables: 8420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.142 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.142 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.143 20:53:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.143 20:53:18 -- setup/common.sh@33 -- # echo 0 00:03:22.143 20:53:18 -- setup/common.sh@33 -- # return 0 00:03:22.143 20:53:18 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.143 20:53:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.143 20:53:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.143 20:53:18 -- setup/common.sh@18 -- # local node= 00:03:22.143 20:53:18 -- setup/common.sh@19 -- # local var val 00:03:22.143 20:53:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.143 20:53:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.143 20:53:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.143 20:53:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.143 20:53:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.143 20:53:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.143 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45200224 kB' 'MemAvailable: 48968932 kB' 'Buffers: 2708 kB' 'Cached: 10754052 kB' 'SwapCached: 0 kB' 'Active: 7469964 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069484 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480752 kB' 'Mapped: 216276 kB' 'Shmem: 6592168 kB' 'KReclaimable: 195392 kB' 'Slab: 725476 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530084 kB' 'KernelStack: 12800 kB' 'PageTables: 8316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143872 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.144 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.144 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.145 20:53:18 -- setup/common.sh@33 -- # echo 0 00:03:22.145 20:53:18 -- setup/common.sh@33 -- # return 0 00:03:22.145 20:53:18 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.145 20:53:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.145 20:53:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.145 20:53:18 -- setup/common.sh@18 -- # local node= 00:03:22.145 20:53:18 -- setup/common.sh@19 -- # local var val 00:03:22.145 20:53:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.145 20:53:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.145 20:53:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.145 20:53:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.145 20:53:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.145 20:53:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.145 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.145 20:53:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45201312 kB' 'MemAvailable: 48970020 kB' 'Buffers: 2708 kB' 'Cached: 10754056 kB' 'SwapCached: 0 kB' 'Active: 7469332 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068852 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480076 kB' 'Mapped: 216152 kB' 'Shmem: 6592172 kB' 'KReclaimable: 195392 kB' 'Slab: 725460 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530068 kB' 'KernelStack: 12816 kB' 'PageTables: 8300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.146 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.146 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.147 20:53:18 -- setup/common.sh@33 -- # echo 0 00:03:22.147 20:53:18 -- setup/common.sh@33 -- # return 0 00:03:22.147 20:53:18 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.147 20:53:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.147 nr_hugepages=1024 00:03:22.147 20:53:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.147 resv_hugepages=0 00:03:22.147 20:53:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.147 surplus_hugepages=0 00:03:22.147 20:53:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.147 anon_hugepages=0 00:03:22.147 20:53:18 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.147 20:53:18 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.147 20:53:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.147 20:53:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.147 20:53:18 -- setup/common.sh@18 -- # local node= 00:03:22.147 20:53:18 -- setup/common.sh@19 -- # local var val 00:03:22.147 20:53:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.147 20:53:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.147 20:53:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.147 20:53:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.147 20:53:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.147 20:53:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45201072 kB' 'MemAvailable: 48969780 kB' 'Buffers: 2708 kB' 'Cached: 10754076 kB' 'SwapCached: 0 kB' 'Active: 7468948 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068468 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479704 kB' 'Mapped: 216228 kB' 'Shmem: 6592192 kB' 'KReclaimable: 195392 kB' 'Slab: 725508 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530116 kB' 'KernelStack: 12784 kB' 'PageTables: 8236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.147 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.147 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.148 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.148 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.148 20:53:18 -- setup/common.sh@33 -- # echo 1024 00:03:22.148 20:53:18 -- setup/common.sh@33 -- # return 0 00:03:22.148 20:53:18 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.148 20:53:18 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.148 20:53:18 -- setup/hugepages.sh@27 -- # local node 00:03:22.148 20:53:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.148 20:53:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:22.148 20:53:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.148 20:53:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:22.148 20:53:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.148 20:53:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.148 20:53:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.148 20:53:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.148 20:53:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.148 20:53:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.148 20:53:18 -- setup/common.sh@18 -- # local node=0 00:03:22.148 20:53:18 -- setup/common.sh@19 -- # local var val 00:03:22.148 20:53:18 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.148 20:53:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.148 20:53:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.148 20:53:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.148 20:53:18 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.148 20:53:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27212492 kB' 'MemUsed: 5613364 kB' 'SwapCached: 0 kB' 'Active: 2289004 kB' 'Inactive: 176952 kB' 'Active(anon): 2132280 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118772 kB' 'Mapped: 82980 kB' 'AnonPages: 350332 kB' 'Shmem: 1785096 kB' 'KernelStack: 7016 kB' 'PageTables: 4484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415648 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304752 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # continue 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.149 20:53:18 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.149 20:53:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.149 20:53:18 -- setup/common.sh@33 -- # echo 0 00:03:22.149 20:53:18 -- setup/common.sh@33 -- # return 0 00:03:22.149 20:53:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.149 20:53:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.149 20:53:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.150 20:53:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.150 20:53:18 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:22.150 node0=1024 expecting 1024 00:03:22.150 20:53:18 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:22.150 00:03:22.150 real 0m2.528s 00:03:22.150 user 0m0.696s 00:03:22.150 sys 0m0.972s 00:03:22.150 20:53:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.150 20:53:18 -- common/autotest_common.sh@10 -- # set +x 00:03:22.150 ************************************ 00:03:22.150 END TEST default_setup 00:03:22.150 ************************************ 00:03:22.150 20:53:18 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:22.150 20:53:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.150 20:53:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.150 20:53:18 -- common/autotest_common.sh@10 -- # set +x 00:03:22.150 ************************************ 00:03:22.150 START TEST per_node_1G_alloc 00:03:22.150 ************************************ 00:03:22.150 20:53:18 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:22.150 20:53:18 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:22.150 20:53:18 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:22.150 20:53:18 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:22.150 20:53:18 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:22.150 20:53:18 -- setup/hugepages.sh@51 -- # shift 00:03:22.150 20:53:18 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:22.150 20:53:18 -- setup/hugepages.sh@52 -- # local node_ids 00:03:22.150 20:53:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.150 20:53:18 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:22.150 20:53:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:22.150 20:53:18 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:22.150 20:53:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.150 20:53:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:22.150 20:53:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.150 20:53:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.150 20:53:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.150 20:53:18 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:22.150 20:53:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:22.150 20:53:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:22.150 20:53:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:22.150 20:53:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:22.150 20:53:18 -- setup/hugepages.sh@73 -- # return 0 00:03:22.150 20:53:18 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:22.150 20:53:18 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:22.150 20:53:18 -- setup/hugepages.sh@146 -- # setup output 00:03:22.150 20:53:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.150 20:53:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.531 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.531 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.531 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.531 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.531 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.531 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.531 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.531 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.531 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.531 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.531 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.531 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.531 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.531 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.531 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.531 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.531 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.531 20:53:19 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:23.531 20:53:19 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:23.531 20:53:19 -- setup/hugepages.sh@89 -- # local node 00:03:23.531 20:53:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.531 20:53:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.531 20:53:19 -- setup/hugepages.sh@92 -- # local surp 00:03:23.531 20:53:19 -- setup/hugepages.sh@93 -- # local resv 00:03:23.531 20:53:19 -- setup/hugepages.sh@94 -- # local anon 00:03:23.531 20:53:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.531 20:53:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.531 20:53:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.531 20:53:19 -- setup/common.sh@18 -- # local node= 00:03:23.531 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.531 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.531 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.531 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.531 20:53:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.531 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.531 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.531 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.531 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45202120 kB' 'MemAvailable: 48970828 kB' 'Buffers: 2708 kB' 'Cached: 10754140 kB' 'SwapCached: 0 kB' 'Active: 7469700 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069220 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480236 kB' 'Mapped: 216236 kB' 'Shmem: 6592256 kB' 'KReclaimable: 195392 kB' 'Slab: 725556 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530164 kB' 'KernelStack: 12784 kB' 'PageTables: 8244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144080 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.532 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.532 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.533 20:53:19 -- setup/common.sh@33 -- # echo 0 00:03:23.533 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.533 20:53:19 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.533 20:53:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.533 20:53:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.533 20:53:19 -- setup/common.sh@18 -- # local node= 00:03:23.533 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.533 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.533 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.533 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.533 20:53:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.533 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.533 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45205116 kB' 'MemAvailable: 48973824 kB' 'Buffers: 2708 kB' 'Cached: 10754140 kB' 'SwapCached: 0 kB' 'Active: 7469996 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069516 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480492 kB' 'Mapped: 216236 kB' 'Shmem: 6592256 kB' 'KReclaimable: 195392 kB' 'Slab: 725532 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530140 kB' 'KernelStack: 12752 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.533 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.533 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.534 20:53:19 -- setup/common.sh@33 -- # echo 0 00:03:23.534 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.534 20:53:19 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.534 20:53:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.534 20:53:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.534 20:53:19 -- setup/common.sh@18 -- # local node= 00:03:23.534 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.534 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.534 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.534 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.534 20:53:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.534 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.534 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45205124 kB' 'MemAvailable: 48973832 kB' 'Buffers: 2708 kB' 'Cached: 10754140 kB' 'SwapCached: 0 kB' 'Active: 7469892 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069412 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480404 kB' 'Mapped: 216212 kB' 'Shmem: 6592256 kB' 'KReclaimable: 195392 kB' 'Slab: 725532 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530140 kB' 'KernelStack: 12784 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.534 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.534 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.535 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.535 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.535 20:53:19 -- setup/common.sh@33 -- # echo 0 00:03:23.535 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.535 20:53:19 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.535 20:53:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.535 nr_hugepages=1024 00:03:23.535 20:53:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.535 resv_hugepages=0 00:03:23.535 20:53:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.535 surplus_hugepages=0 00:03:23.535 20:53:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.536 anon_hugepages=0 00:03:23.536 20:53:19 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.536 20:53:19 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.536 20:53:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.536 20:53:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.536 20:53:19 -- setup/common.sh@18 -- # local node= 00:03:23.536 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.536 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.536 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.536 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.536 20:53:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.536 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.536 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45205216 kB' 'MemAvailable: 48973924 kB' 'Buffers: 2708 kB' 'Cached: 10754156 kB' 'SwapCached: 0 kB' 'Active: 7469208 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068728 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479676 kB' 'Mapped: 216212 kB' 'Shmem: 6592272 kB' 'KReclaimable: 195392 kB' 'Slab: 725564 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530172 kB' 'KernelStack: 12752 kB' 'PageTables: 8128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144120 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.536 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.536 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.537 20:53:19 -- setup/common.sh@33 -- # echo 1024 00:03:23.537 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.537 20:53:19 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.537 20:53:19 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.537 20:53:19 -- setup/hugepages.sh@27 -- # local node 00:03:23.537 20:53:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.537 20:53:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.537 20:53:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.537 20:53:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.537 20:53:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.537 20:53:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.537 20:53:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.537 20:53:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.537 20:53:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.537 20:53:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.537 20:53:19 -- setup/common.sh@18 -- # local node=0 00:03:23.537 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.537 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.537 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.537 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.537 20:53:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.537 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.537 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28271636 kB' 'MemUsed: 4554220 kB' 'SwapCached: 0 kB' 'Active: 2288812 kB' 'Inactive: 176952 kB' 'Active(anon): 2132088 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118776 kB' 'Mapped: 82964 kB' 'AnonPages: 350144 kB' 'Shmem: 1785100 kB' 'KernelStack: 7016 kB' 'PageTables: 4524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415808 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304912 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.537 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.537 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@33 -- # echo 0 00:03:23.538 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.538 20:53:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.538 20:53:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.538 20:53:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.538 20:53:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:23.538 20:53:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.538 20:53:19 -- setup/common.sh@18 -- # local node=1 00:03:23.538 20:53:19 -- setup/common.sh@19 -- # local var val 00:03:23.538 20:53:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.538 20:53:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.538 20:53:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:23.538 20:53:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:23.538 20:53:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.538 20:53:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16933832 kB' 'MemUsed: 10775960 kB' 'SwapCached: 0 kB' 'Active: 5180792 kB' 'Inactive: 3587160 kB' 'Active(anon): 4937036 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8638128 kB' 'Mapped: 133248 kB' 'AnonPages: 129924 kB' 'Shmem: 4807212 kB' 'KernelStack: 5784 kB' 'PageTables: 3760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84496 kB' 'Slab: 309756 kB' 'SReclaimable: 84496 kB' 'SUnreclaim: 225260 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.538 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.538 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # continue 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.539 20:53:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.539 20:53:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.539 20:53:19 -- setup/common.sh@33 -- # echo 0 00:03:23.539 20:53:19 -- setup/common.sh@33 -- # return 0 00:03:23.539 20:53:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.539 20:53:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.539 20:53:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.539 20:53:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.539 20:53:19 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:23.539 node0=512 expecting 512 00:03:23.539 20:53:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.539 20:53:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.539 20:53:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.539 20:53:19 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:23.539 node1=512 expecting 512 00:03:23.539 20:53:19 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:23.539 00:03:23.539 real 0m1.418s 00:03:23.539 user 0m0.586s 00:03:23.539 sys 0m0.788s 00:03:23.539 20:53:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.539 20:53:19 -- common/autotest_common.sh@10 -- # set +x 00:03:23.539 ************************************ 00:03:23.539 END TEST per_node_1G_alloc 00:03:23.539 ************************************ 00:03:23.539 20:53:19 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:23.539 20:53:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.539 20:53:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.539 20:53:19 -- common/autotest_common.sh@10 -- # set +x 00:03:23.539 ************************************ 00:03:23.539 START TEST even_2G_alloc 00:03:23.539 ************************************ 00:03:23.539 20:53:19 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:23.539 20:53:19 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:23.539 20:53:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:23.539 20:53:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:23.539 20:53:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.539 20:53:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:23.539 20:53:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:23.539 20:53:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:23.539 20:53:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.539 20:53:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:23.539 20:53:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.539 20:53:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.539 20:53:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.539 20:53:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:23.539 20:53:19 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:23.539 20:53:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.540 20:53:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:23.540 20:53:19 -- setup/hugepages.sh@83 -- # : 512 00:03:23.540 20:53:19 -- setup/hugepages.sh@84 -- # : 1 00:03:23.540 20:53:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.540 20:53:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:23.540 20:53:19 -- setup/hugepages.sh@83 -- # : 0 00:03:23.540 20:53:19 -- setup/hugepages.sh@84 -- # : 0 00:03:23.540 20:53:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.540 20:53:19 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:23.540 20:53:19 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:23.540 20:53:19 -- setup/hugepages.sh@153 -- # setup output 00:03:23.540 20:53:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.798 20:53:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.733 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.733 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:24.733 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.733 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.733 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.733 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.733 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.733 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.733 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.995 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.995 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.995 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.995 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.995 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.995 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.995 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.995 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.995 20:53:21 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:24.995 20:53:21 -- setup/hugepages.sh@89 -- # local node 00:03:24.995 20:53:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.995 20:53:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.995 20:53:21 -- setup/hugepages.sh@92 -- # local surp 00:03:24.995 20:53:21 -- setup/hugepages.sh@93 -- # local resv 00:03:24.995 20:53:21 -- setup/hugepages.sh@94 -- # local anon 00:03:24.995 20:53:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.995 20:53:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.995 20:53:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.995 20:53:21 -- setup/common.sh@18 -- # local node= 00:03:24.995 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:24.995 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.995 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.995 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.995 20:53:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.995 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.995 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45208288 kB' 'MemAvailable: 48976996 kB' 'Buffers: 2708 kB' 'Cached: 10754224 kB' 'SwapCached: 0 kB' 'Active: 7469012 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068532 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479388 kB' 'Mapped: 216252 kB' 'Shmem: 6592340 kB' 'KReclaimable: 195392 kB' 'Slab: 725656 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530264 kB' 'KernelStack: 12832 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.995 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.995 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.996 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.996 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.996 20:53:21 -- setup/common.sh@33 -- # echo 0 00:03:24.996 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:24.996 20:53:21 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.996 20:53:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.997 20:53:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.997 20:53:21 -- setup/common.sh@18 -- # local node= 00:03:24.997 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:24.997 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.997 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.997 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.997 20:53:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.997 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.997 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45210888 kB' 'MemAvailable: 48979596 kB' 'Buffers: 2708 kB' 'Cached: 10754228 kB' 'SwapCached: 0 kB' 'Active: 7468900 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068420 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479332 kB' 'Mapped: 216292 kB' 'Shmem: 6592344 kB' 'KReclaimable: 195392 kB' 'Slab: 725712 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530320 kB' 'KernelStack: 12832 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.997 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.997 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.998 20:53:21 -- setup/common.sh@33 -- # echo 0 00:03:24.998 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:24.998 20:53:21 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.998 20:53:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.998 20:53:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.998 20:53:21 -- setup/common.sh@18 -- # local node= 00:03:24.998 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:24.998 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.998 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.998 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.998 20:53:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.998 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.998 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45211616 kB' 'MemAvailable: 48980324 kB' 'Buffers: 2708 kB' 'Cached: 10754236 kB' 'SwapCached: 0 kB' 'Active: 7469004 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068524 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479436 kB' 'Mapped: 216216 kB' 'Shmem: 6592352 kB' 'KReclaimable: 195392 kB' 'Slab: 725740 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530348 kB' 'KernelStack: 12848 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.998 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.998 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.999 20:53:21 -- setup/common.sh@32 -- # continue 00:03:24.999 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.000 20:53:21 -- setup/common.sh@33 -- # echo 0 00:03:25.000 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:25.000 20:53:21 -- setup/hugepages.sh@100 -- # resv=0 00:03:25.000 20:53:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:25.000 nr_hugepages=1024 00:03:25.000 20:53:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:25.000 resv_hugepages=0 00:03:25.000 20:53:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:25.000 surplus_hugepages=0 00:03:25.000 20:53:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:25.000 anon_hugepages=0 00:03:25.000 20:53:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.000 20:53:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:25.000 20:53:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:25.000 20:53:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:25.000 20:53:21 -- setup/common.sh@18 -- # local node= 00:03:25.000 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:25.000 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.000 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.000 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.000 20:53:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.000 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.000 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45211628 kB' 'MemAvailable: 48980336 kB' 'Buffers: 2708 kB' 'Cached: 10754252 kB' 'SwapCached: 0 kB' 'Active: 7468704 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068224 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479060 kB' 'Mapped: 216216 kB' 'Shmem: 6592368 kB' 'KReclaimable: 195392 kB' 'Slab: 725740 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530348 kB' 'KernelStack: 12832 kB' 'PageTables: 8280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8144204 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.000 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.000 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.261 20:53:21 -- setup/common.sh@33 -- # echo 1024 00:03:25.261 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:25.261 20:53:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.261 20:53:21 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.261 20:53:21 -- setup/hugepages.sh@27 -- # local node 00:03:25.261 20:53:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.261 20:53:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.261 20:53:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.261 20:53:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.261 20:53:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.261 20:53:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.261 20:53:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.261 20:53:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.261 20:53:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.261 20:53:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.261 20:53:21 -- setup/common.sh@18 -- # local node=0 00:03:25.261 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:25.261 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.261 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.261 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.261 20:53:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.261 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.261 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.261 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.261 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28265776 kB' 'MemUsed: 4560080 kB' 'SwapCached: 0 kB' 'Active: 2288136 kB' 'Inactive: 176952 kB' 'Active(anon): 2131412 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118776 kB' 'Mapped: 82968 kB' 'AnonPages: 349384 kB' 'Shmem: 1785100 kB' 'KernelStack: 7032 kB' 'PageTables: 4480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415872 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304976 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.261 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.262 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.262 20:53:21 -- setup/common.sh@33 -- # echo 0 00:03:25.262 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:25.262 20:53:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.262 20:53:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.262 20:53:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.262 20:53:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:25.262 20:53:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.262 20:53:21 -- setup/common.sh@18 -- # local node=1 00:03:25.262 20:53:21 -- setup/common.sh@19 -- # local var val 00:03:25.262 20:53:21 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.262 20:53:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.262 20:53:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:25.262 20:53:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:25.262 20:53:21 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.262 20:53:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.262 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16946036 kB' 'MemUsed: 10763756 kB' 'SwapCached: 0 kB' 'Active: 5180412 kB' 'Inactive: 3587160 kB' 'Active(anon): 4936656 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8638212 kB' 'Mapped: 133248 kB' 'AnonPages: 129492 kB' 'Shmem: 4807296 kB' 'KernelStack: 5768 kB' 'PageTables: 3708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84496 kB' 'Slab: 309868 kB' 'SReclaimable: 84496 kB' 'SUnreclaim: 225372 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # continue 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.263 20:53:21 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.263 20:53:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.263 20:53:21 -- setup/common.sh@33 -- # echo 0 00:03:25.263 20:53:21 -- setup/common.sh@33 -- # return 0 00:03:25.263 20:53:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.263 20:53:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.264 20:53:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.264 20:53:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.264 20:53:21 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:25.264 node0=512 expecting 512 00:03:25.264 20:53:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.264 20:53:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.264 20:53:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.264 20:53:21 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:25.264 node1=512 expecting 512 00:03:25.264 20:53:21 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:25.264 00:03:25.264 real 0m1.529s 00:03:25.264 user 0m0.602s 00:03:25.264 sys 0m0.889s 00:03:25.264 20:53:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.264 20:53:21 -- common/autotest_common.sh@10 -- # set +x 00:03:25.264 ************************************ 00:03:25.264 END TEST even_2G_alloc 00:03:25.264 ************************************ 00:03:25.264 20:53:21 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:25.264 20:53:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.264 20:53:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.264 20:53:21 -- common/autotest_common.sh@10 -- # set +x 00:03:25.264 ************************************ 00:03:25.264 START TEST odd_alloc 00:03:25.264 ************************************ 00:03:25.264 20:53:21 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:25.264 20:53:21 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:25.264 20:53:21 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:25.264 20:53:21 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:25.264 20:53:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.264 20:53:21 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.264 20:53:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.264 20:53:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:25.264 20:53:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.264 20:53:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.264 20:53:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.264 20:53:21 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.264 20:53:21 -- setup/hugepages.sh@83 -- # : 513 00:03:25.264 20:53:21 -- setup/hugepages.sh@84 -- # : 1 00:03:25.264 20:53:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:25.264 20:53:21 -- setup/hugepages.sh@83 -- # : 0 00:03:25.264 20:53:21 -- setup/hugepages.sh@84 -- # : 0 00:03:25.264 20:53:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.264 20:53:21 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:25.264 20:53:21 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:25.264 20:53:21 -- setup/hugepages.sh@160 -- # setup output 00:03:25.264 20:53:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.264 20:53:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.200 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.200 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.200 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.200 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.200 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.201 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.201 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.201 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.201 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.201 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.201 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.201 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.201 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.201 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.201 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.201 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.201 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.464 20:53:22 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:26.464 20:53:22 -- setup/hugepages.sh@89 -- # local node 00:03:26.464 20:53:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.464 20:53:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.464 20:53:22 -- setup/hugepages.sh@92 -- # local surp 00:03:26.464 20:53:22 -- setup/hugepages.sh@93 -- # local resv 00:03:26.464 20:53:22 -- setup/hugepages.sh@94 -- # local anon 00:03:26.464 20:53:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.464 20:53:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.464 20:53:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.464 20:53:22 -- setup/common.sh@18 -- # local node= 00:03:26.464 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.464 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.464 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.464 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.464 20:53:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.464 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.464 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45185004 kB' 'MemAvailable: 48953712 kB' 'Buffers: 2708 kB' 'Cached: 10754320 kB' 'SwapCached: 0 kB' 'Active: 7474668 kB' 'Inactive: 3764112 kB' 'Active(anon): 7074188 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484668 kB' 'Mapped: 215592 kB' 'Shmem: 6592436 kB' 'KReclaimable: 195392 kB' 'Slab: 725624 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530232 kB' 'KernelStack: 12976 kB' 'PageTables: 9648 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8139716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198732 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.464 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.464 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.465 20:53:22 -- setup/common.sh@33 -- # echo 0 00:03:26.465 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.465 20:53:22 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.465 20:53:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.465 20:53:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.465 20:53:22 -- setup/common.sh@18 -- # local node= 00:03:26.465 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.465 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.465 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.465 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.465 20:53:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.465 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.465 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45202604 kB' 'MemAvailable: 48971312 kB' 'Buffers: 2708 kB' 'Cached: 10754320 kB' 'SwapCached: 0 kB' 'Active: 7468672 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068192 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479540 kB' 'Mapped: 215224 kB' 'Shmem: 6592436 kB' 'KReclaimable: 195392 kB' 'Slab: 725624 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530232 kB' 'KernelStack: 13152 kB' 'PageTables: 9764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8135876 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198568 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.465 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.465 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.466 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.466 20:53:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.467 20:53:22 -- setup/common.sh@33 -- # echo 0 00:03:26.467 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.467 20:53:22 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.467 20:53:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.467 20:53:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.467 20:53:22 -- setup/common.sh@18 -- # local node= 00:03:26.467 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.467 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.467 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.467 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.467 20:53:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.467 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.467 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45201888 kB' 'MemAvailable: 48970596 kB' 'Buffers: 2708 kB' 'Cached: 10754336 kB' 'SwapCached: 0 kB' 'Active: 7472148 kB' 'Inactive: 3764112 kB' 'Active(anon): 7071668 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482532 kB' 'Mapped: 216076 kB' 'Shmem: 6592452 kB' 'KReclaimable: 195392 kB' 'Slab: 725636 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530244 kB' 'KernelStack: 13296 kB' 'PageTables: 10300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8134472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198712 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.467 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.467 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.468 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.468 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.469 20:53:22 -- setup/common.sh@33 -- # echo 0 00:03:26.469 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.469 20:53:22 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.469 20:53:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:26.469 nr_hugepages=1025 00:03:26.469 20:53:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.469 resv_hugepages=0 00:03:26.469 20:53:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.469 surplus_hugepages=0 00:03:26.469 20:53:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.469 anon_hugepages=0 00:03:26.469 20:53:22 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.469 20:53:22 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:26.469 20:53:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.469 20:53:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.469 20:53:22 -- setup/common.sh@18 -- # local node= 00:03:26.469 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.469 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.469 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.469 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.469 20:53:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.469 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.469 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45201684 kB' 'MemAvailable: 48970392 kB' 'Buffers: 2708 kB' 'Cached: 10754336 kB' 'SwapCached: 0 kB' 'Active: 7472724 kB' 'Inactive: 3764112 kB' 'Active(anon): 7072244 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483036 kB' 'Mapped: 216012 kB' 'Shmem: 6592452 kB' 'KReclaimable: 195392 kB' 'Slab: 725400 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530008 kB' 'KernelStack: 12768 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8137108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198300 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.469 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.469 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.470 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.470 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.471 20:53:22 -- setup/common.sh@33 -- # echo 1025 00:03:26.471 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.471 20:53:22 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.471 20:53:22 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.471 20:53:22 -- setup/hugepages.sh@27 -- # local node 00:03:26.471 20:53:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.471 20:53:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.471 20:53:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.471 20:53:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:26.471 20:53:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.471 20:53:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.471 20:53:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.471 20:53:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.471 20:53:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.471 20:53:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.471 20:53:22 -- setup/common.sh@18 -- # local node=0 00:03:26.471 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.471 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.471 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.471 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.471 20:53:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.471 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.471 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.471 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.471 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28272072 kB' 'MemUsed: 4553784 kB' 'SwapCached: 0 kB' 'Active: 2293504 kB' 'Inactive: 176952 kB' 'Active(anon): 2136780 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118784 kB' 'Mapped: 82116 kB' 'AnonPages: 354776 kB' 'Shmem: 1785108 kB' 'KernelStack: 7064 kB' 'PageTables: 4532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415512 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304616 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.472 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.472 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@33 -- # echo 0 00:03:26.473 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.473 20:53:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.473 20:53:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.473 20:53:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.473 20:53:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:26.473 20:53:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.473 20:53:22 -- setup/common.sh@18 -- # local node=1 00:03:26.473 20:53:22 -- setup/common.sh@19 -- # local var val 00:03:26.473 20:53:22 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.473 20:53:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.473 20:53:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:26.473 20:53:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:26.473 20:53:22 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.473 20:53:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16930256 kB' 'MemUsed: 10779536 kB' 'SwapCached: 0 kB' 'Active: 5178444 kB' 'Inactive: 3587160 kB' 'Active(anon): 4934688 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8638260 kB' 'Mapped: 133500 kB' 'AnonPages: 127424 kB' 'Shmem: 4807344 kB' 'KernelStack: 5672 kB' 'PageTables: 3556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84496 kB' 'Slab: 309816 kB' 'SReclaimable: 84496 kB' 'SUnreclaim: 225320 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.473 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.473 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.474 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.474 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.732 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.732 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.732 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.732 20:53:22 -- setup/common.sh@32 -- # continue 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.732 20:53:22 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.732 20:53:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.732 20:53:22 -- setup/common.sh@33 -- # echo 0 00:03:26.732 20:53:22 -- setup/common.sh@33 -- # return 0 00:03:26.732 20:53:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.732 20:53:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.732 20:53:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.732 20:53:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.732 20:53:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:26.732 node0=512 expecting 513 00:03:26.732 20:53:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.732 20:53:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.732 20:53:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.732 20:53:22 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:26.732 node1=513 expecting 512 00:03:26.732 20:53:22 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:26.732 00:03:26.732 real 0m1.389s 00:03:26.732 user 0m0.589s 00:03:26.732 sys 0m0.760s 00:03:26.732 20:53:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.732 20:53:22 -- common/autotest_common.sh@10 -- # set +x 00:03:26.732 ************************************ 00:03:26.732 END TEST odd_alloc 00:03:26.732 ************************************ 00:03:26.732 20:53:22 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:26.732 20:53:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.732 20:53:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.732 20:53:22 -- common/autotest_common.sh@10 -- # set +x 00:03:26.732 ************************************ 00:03:26.732 START TEST custom_alloc 00:03:26.732 ************************************ 00:03:26.733 20:53:22 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:26.733 20:53:22 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:26.733 20:53:22 -- setup/hugepages.sh@169 -- # local node 00:03:26.733 20:53:22 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:26.733 20:53:22 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:26.733 20:53:22 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:26.733 20:53:22 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.733 20:53:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.733 20:53:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.733 20:53:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.733 20:53:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.733 20:53:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.733 20:53:22 -- setup/hugepages.sh@83 -- # : 256 00:03:26.733 20:53:22 -- setup/hugepages.sh@84 -- # : 1 00:03:26.733 20:53:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.733 20:53:22 -- setup/hugepages.sh@83 -- # : 0 00:03:26.733 20:53:22 -- setup/hugepages.sh@84 -- # : 0 00:03:26.733 20:53:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:26.733 20:53:22 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:26.733 20:53:22 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:26.733 20:53:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:26.733 20:53:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.733 20:53:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.733 20:53:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.733 20:53:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.733 20:53:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.733 20:53:22 -- setup/hugepages.sh@78 -- # return 0 00:03:26.733 20:53:22 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:26.733 20:53:22 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.733 20:53:22 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.733 20:53:22 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.733 20:53:22 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.733 20:53:22 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.733 20:53:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.733 20:53:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.733 20:53:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.733 20:53:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:26.733 20:53:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.733 20:53:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.733 20:53:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.733 20:53:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:26.733 20:53:22 -- setup/hugepages.sh@78 -- # return 0 00:03:26.733 20:53:22 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:26.733 20:53:22 -- setup/hugepages.sh@187 -- # setup output 00:03:26.733 20:53:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.733 20:53:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:27.669 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.669 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:27.669 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.669 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.669 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.669 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.669 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.669 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.669 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.669 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.930 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.930 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.930 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.930 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.930 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.930 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.930 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.930 20:53:24 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:27.930 20:53:24 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:27.930 20:53:24 -- setup/hugepages.sh@89 -- # local node 00:03:27.930 20:53:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:27.930 20:53:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:27.930 20:53:24 -- setup/hugepages.sh@92 -- # local surp 00:03:27.930 20:53:24 -- setup/hugepages.sh@93 -- # local resv 00:03:27.930 20:53:24 -- setup/hugepages.sh@94 -- # local anon 00:03:27.930 20:53:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:27.930 20:53:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:27.930 20:53:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:27.930 20:53:24 -- setup/common.sh@18 -- # local node= 00:03:27.930 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:27.930 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.930 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.930 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.930 20:53:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.930 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.930 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.930 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.930 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44139464 kB' 'MemAvailable: 47908172 kB' 'Buffers: 2708 kB' 'Cached: 10754420 kB' 'SwapCached: 0 kB' 'Active: 7467528 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067048 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477752 kB' 'Mapped: 215184 kB' 'Shmem: 6592536 kB' 'KReclaimable: 195392 kB' 'Slab: 725184 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529792 kB' 'KernelStack: 12784 kB' 'PageTables: 7860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8131048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.931 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.931 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.932 20:53:24 -- setup/common.sh@33 -- # echo 0 00:03:27.932 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:27.932 20:53:24 -- setup/hugepages.sh@97 -- # anon=0 00:03:27.932 20:53:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:27.932 20:53:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.932 20:53:24 -- setup/common.sh@18 -- # local node= 00:03:27.932 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:27.932 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.932 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.932 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.932 20:53:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.932 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.932 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44141460 kB' 'MemAvailable: 47910168 kB' 'Buffers: 2708 kB' 'Cached: 10754424 kB' 'SwapCached: 0 kB' 'Active: 7467596 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067116 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477852 kB' 'Mapped: 215184 kB' 'Shmem: 6592540 kB' 'KReclaimable: 195392 kB' 'Slab: 725176 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529784 kB' 'KernelStack: 12768 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8131060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.932 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.932 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.933 20:53:24 -- setup/common.sh@33 -- # echo 0 00:03:27.933 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:27.933 20:53:24 -- setup/hugepages.sh@99 -- # surp=0 00:03:27.933 20:53:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:27.933 20:53:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:27.933 20:53:24 -- setup/common.sh@18 -- # local node= 00:03:27.933 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:27.933 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.933 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.933 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.933 20:53:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.933 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.933 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44140848 kB' 'MemAvailable: 47909556 kB' 'Buffers: 2708 kB' 'Cached: 10754436 kB' 'SwapCached: 0 kB' 'Active: 7467340 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066860 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477512 kB' 'Mapped: 215176 kB' 'Shmem: 6592552 kB' 'KReclaimable: 195392 kB' 'Slab: 725240 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529848 kB' 'KernelStack: 12800 kB' 'PageTables: 7916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8131076 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.933 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.933 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.934 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.934 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.934 20:53:24 -- setup/common.sh@33 -- # echo 0 00:03:27.934 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:27.934 20:53:24 -- setup/hugepages.sh@100 -- # resv=0 00:03:27.934 20:53:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:27.934 nr_hugepages=1536 00:03:27.934 20:53:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:27.934 resv_hugepages=0 00:03:27.935 20:53:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:27.935 surplus_hugepages=0 00:03:27.935 20:53:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:27.935 anon_hugepages=0 00:03:27.935 20:53:24 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:27.935 20:53:24 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:27.935 20:53:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:27.935 20:53:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:27.935 20:53:24 -- setup/common.sh@18 -- # local node= 00:03:27.935 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:27.935 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.935 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.935 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.935 20:53:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.935 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.935 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44140596 kB' 'MemAvailable: 47909304 kB' 'Buffers: 2708 kB' 'Cached: 10754448 kB' 'SwapCached: 0 kB' 'Active: 7467368 kB' 'Inactive: 3764112 kB' 'Active(anon): 7066888 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477552 kB' 'Mapped: 215176 kB' 'Shmem: 6592564 kB' 'KReclaimable: 195392 kB' 'Slab: 725240 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529848 kB' 'KernelStack: 12816 kB' 'PageTables: 7968 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8131088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.935 20:53:24 -- setup/common.sh@32 -- # continue 00:03:27.935 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.195 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.195 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.196 20:53:24 -- setup/common.sh@33 -- # echo 1536 00:03:28.196 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:28.196 20:53:24 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:28.196 20:53:24 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.196 20:53:24 -- setup/hugepages.sh@27 -- # local node 00:03:28.196 20:53:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.196 20:53:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:28.196 20:53:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.196 20:53:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:28.196 20:53:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.196 20:53:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.196 20:53:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.196 20:53:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.196 20:53:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.196 20:53:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.196 20:53:24 -- setup/common.sh@18 -- # local node=0 00:03:28.196 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:28.196 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.196 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.196 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.196 20:53:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.196 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.196 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28267428 kB' 'MemUsed: 4558428 kB' 'SwapCached: 0 kB' 'Active: 2288964 kB' 'Inactive: 176952 kB' 'Active(anon): 2132240 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118848 kB' 'Mapped: 82004 kB' 'AnonPages: 350240 kB' 'Shmem: 1785172 kB' 'KernelStack: 7080 kB' 'PageTables: 4560 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415528 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304632 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.196 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.196 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@33 -- # echo 0 00:03:28.197 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:28.197 20:53:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.197 20:53:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.197 20:53:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.197 20:53:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:28.197 20:53:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.197 20:53:24 -- setup/common.sh@18 -- # local node=1 00:03:28.197 20:53:24 -- setup/common.sh@19 -- # local var val 00:03:28.197 20:53:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.197 20:53:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.197 20:53:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:28.197 20:53:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:28.197 20:53:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.197 20:53:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15874192 kB' 'MemUsed: 11835600 kB' 'SwapCached: 0 kB' 'Active: 5178420 kB' 'Inactive: 3587160 kB' 'Active(anon): 4934664 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8638324 kB' 'Mapped: 133172 kB' 'AnonPages: 127316 kB' 'Shmem: 4807408 kB' 'KernelStack: 5736 kB' 'PageTables: 3408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84496 kB' 'Slab: 309712 kB' 'SReclaimable: 84496 kB' 'SUnreclaim: 225216 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.197 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.197 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # continue 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.198 20:53:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.198 20:53:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.198 20:53:24 -- setup/common.sh@33 -- # echo 0 00:03:28.198 20:53:24 -- setup/common.sh@33 -- # return 0 00:03:28.198 20:53:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.198 20:53:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.198 20:53:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.198 20:53:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.198 20:53:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:28.198 node0=512 expecting 512 00:03:28.198 20:53:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.198 20:53:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.198 20:53:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.198 20:53:24 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:28.198 node1=1024 expecting 1024 00:03:28.198 20:53:24 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:28.198 00:03:28.198 real 0m1.496s 00:03:28.198 user 0m0.610s 00:03:28.198 sys 0m0.849s 00:03:28.198 20:53:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.198 20:53:24 -- common/autotest_common.sh@10 -- # set +x 00:03:28.198 ************************************ 00:03:28.198 END TEST custom_alloc 00:03:28.198 ************************************ 00:03:28.198 20:53:24 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:28.198 20:53:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.198 20:53:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.198 20:53:24 -- common/autotest_common.sh@10 -- # set +x 00:03:28.198 ************************************ 00:03:28.198 START TEST no_shrink_alloc 00:03:28.198 ************************************ 00:03:28.198 20:53:24 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:28.198 20:53:24 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:28.198 20:53:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:28.198 20:53:24 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:28.198 20:53:24 -- setup/hugepages.sh@51 -- # shift 00:03:28.198 20:53:24 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:28.198 20:53:24 -- setup/hugepages.sh@52 -- # local node_ids 00:03:28.198 20:53:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.198 20:53:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:28.198 20:53:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:28.198 20:53:24 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:28.198 20:53:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.198 20:53:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.198 20:53:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.198 20:53:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.198 20:53:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.198 20:53:24 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:28.198 20:53:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:28.198 20:53:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:28.198 20:53:24 -- setup/hugepages.sh@73 -- # return 0 00:03:28.198 20:53:24 -- setup/hugepages.sh@198 -- # setup output 00:03:28.199 20:53:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.199 20:53:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.133 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.134 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.134 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.134 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.134 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.134 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.134 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.134 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.134 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.134 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.134 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.134 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.134 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.134 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.397 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.397 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.397 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.397 20:53:25 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:29.397 20:53:25 -- setup/hugepages.sh@89 -- # local node 00:03:29.397 20:53:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.397 20:53:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.397 20:53:25 -- setup/hugepages.sh@92 -- # local surp 00:03:29.397 20:53:25 -- setup/hugepages.sh@93 -- # local resv 00:03:29.397 20:53:25 -- setup/hugepages.sh@94 -- # local anon 00:03:29.397 20:53:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.397 20:53:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.397 20:53:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.397 20:53:25 -- setup/common.sh@18 -- # local node= 00:03:29.397 20:53:25 -- setup/common.sh@19 -- # local var val 00:03:29.397 20:53:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.397 20:53:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.397 20:53:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.397 20:53:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.397 20:53:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.397 20:53:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.397 20:53:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45143552 kB' 'MemAvailable: 48912260 kB' 'Buffers: 2708 kB' 'Cached: 10754512 kB' 'SwapCached: 0 kB' 'Active: 7468944 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068464 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479000 kB' 'Mapped: 216080 kB' 'Shmem: 6592628 kB' 'KReclaimable: 195392 kB' 'Slab: 725240 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529848 kB' 'KernelStack: 12928 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8165652 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198552 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.397 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.397 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.398 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.398 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.399 20:53:25 -- setup/common.sh@33 -- # echo 0 00:03:29.399 20:53:25 -- setup/common.sh@33 -- # return 0 00:03:29.399 20:53:25 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.399 20:53:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.399 20:53:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.399 20:53:25 -- setup/common.sh@18 -- # local node= 00:03:29.399 20:53:25 -- setup/common.sh@19 -- # local var val 00:03:29.399 20:53:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.399 20:53:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.399 20:53:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.399 20:53:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.399 20:53:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.399 20:53:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45145296 kB' 'MemAvailable: 48914004 kB' 'Buffers: 2708 kB' 'Cached: 10754516 kB' 'SwapCached: 0 kB' 'Active: 7469272 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068792 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479348 kB' 'Mapped: 216080 kB' 'Shmem: 6592632 kB' 'KReclaimable: 195392 kB' 'Slab: 725240 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529848 kB' 'KernelStack: 12928 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8165664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.399 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.399 20:53:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.400 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.400 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.401 20:53:25 -- setup/common.sh@33 -- # echo 0 00:03:29.401 20:53:25 -- setup/common.sh@33 -- # return 0 00:03:29.401 20:53:25 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.401 20:53:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.401 20:53:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.401 20:53:25 -- setup/common.sh@18 -- # local node= 00:03:29.401 20:53:25 -- setup/common.sh@19 -- # local var val 00:03:29.401 20:53:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.401 20:53:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.401 20:53:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.401 20:53:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.401 20:53:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.401 20:53:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45145680 kB' 'MemAvailable: 48914388 kB' 'Buffers: 2708 kB' 'Cached: 10754528 kB' 'SwapCached: 0 kB' 'Active: 7468552 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068072 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478668 kB' 'Mapped: 216044 kB' 'Shmem: 6592644 kB' 'KReclaimable: 195392 kB' 'Slab: 725272 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529880 kB' 'KernelStack: 12944 kB' 'PageTables: 8080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8165680 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.401 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.401 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.402 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.402 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.403 20:53:25 -- setup/common.sh@33 -- # echo 0 00:03:29.403 20:53:25 -- setup/common.sh@33 -- # return 0 00:03:29.403 20:53:25 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.403 20:53:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.403 nr_hugepages=1024 00:03:29.403 20:53:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.403 resv_hugepages=0 00:03:29.403 20:53:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.403 surplus_hugepages=0 00:03:29.403 20:53:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.403 anon_hugepages=0 00:03:29.403 20:53:25 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.403 20:53:25 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.403 20:53:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.403 20:53:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.403 20:53:25 -- setup/common.sh@18 -- # local node= 00:03:29.403 20:53:25 -- setup/common.sh@19 -- # local var val 00:03:29.403 20:53:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.403 20:53:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.403 20:53:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.403 20:53:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.403 20:53:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.403 20:53:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45145680 kB' 'MemAvailable: 48914388 kB' 'Buffers: 2708 kB' 'Cached: 10754540 kB' 'SwapCached: 0 kB' 'Active: 7469040 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068560 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479172 kB' 'Mapped: 216044 kB' 'Shmem: 6592656 kB' 'KReclaimable: 195392 kB' 'Slab: 725272 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 529880 kB' 'KernelStack: 12960 kB' 'PageTables: 8140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8172292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.403 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.403 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.404 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.404 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.666 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.666 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.667 20:53:25 -- setup/common.sh@33 -- # echo 1024 00:03:29.667 20:53:25 -- setup/common.sh@33 -- # return 0 00:03:29.667 20:53:25 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.667 20:53:25 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.667 20:53:25 -- setup/hugepages.sh@27 -- # local node 00:03:29.667 20:53:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.667 20:53:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.667 20:53:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.667 20:53:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:29.667 20:53:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.667 20:53:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.667 20:53:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.667 20:53:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.667 20:53:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.667 20:53:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.667 20:53:25 -- setup/common.sh@18 -- # local node=0 00:03:29.667 20:53:25 -- setup/common.sh@19 -- # local var val 00:03:29.667 20:53:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.667 20:53:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.667 20:53:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.667 20:53:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.667 20:53:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.667 20:53:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27214708 kB' 'MemUsed: 5611148 kB' 'SwapCached: 0 kB' 'Active: 2289732 kB' 'Inactive: 176952 kB' 'Active(anon): 2133008 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2118948 kB' 'Mapped: 82028 kB' 'AnonPages: 350924 kB' 'Shmem: 1785272 kB' 'KernelStack: 7112 kB' 'PageTables: 4516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415516 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304620 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.667 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.667 20:53:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # continue 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.668 20:53:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.668 20:53:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.668 20:53:25 -- setup/common.sh@33 -- # echo 0 00:03:29.668 20:53:25 -- setup/common.sh@33 -- # return 0 00:03:29.668 20:53:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.668 20:53:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.668 20:53:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.668 20:53:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.668 20:53:25 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:29.668 node0=1024 expecting 1024 00:03:29.668 20:53:25 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:29.668 20:53:25 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:29.668 20:53:25 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:29.668 20:53:25 -- setup/hugepages.sh@202 -- # setup output 00:03:29.668 20:53:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.668 20:53:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.606 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.606 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.606 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.606 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.606 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.606 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.606 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.606 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.606 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.869 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.869 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.869 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.869 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.869 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.869 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.869 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.869 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.869 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:30.869 20:53:26 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:30.869 20:53:26 -- setup/hugepages.sh@89 -- # local node 00:03:30.869 20:53:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:30.869 20:53:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:30.869 20:53:26 -- setup/hugepages.sh@92 -- # local surp 00:03:30.869 20:53:26 -- setup/hugepages.sh@93 -- # local resv 00:03:30.869 20:53:26 -- setup/hugepages.sh@94 -- # local anon 00:03:30.869 20:53:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:30.869 20:53:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:30.869 20:53:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:30.869 20:53:26 -- setup/common.sh@18 -- # local node= 00:03:30.869 20:53:26 -- setup/common.sh@19 -- # local var val 00:03:30.869 20:53:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.869 20:53:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.869 20:53:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.869 20:53:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.869 20:53:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.869 20:53:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45126532 kB' 'MemAvailable: 48895240 kB' 'Buffers: 2708 kB' 'Cached: 10754596 kB' 'SwapCached: 0 kB' 'Active: 7469208 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068728 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479368 kB' 'Mapped: 216204 kB' 'Shmem: 6592712 kB' 'KReclaimable: 195392 kB' 'Slab: 725584 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530192 kB' 'KernelStack: 12992 kB' 'PageTables: 8192 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8165868 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.869 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.869 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.870 20:53:27 -- setup/common.sh@33 -- # echo 0 00:03:30.870 20:53:27 -- setup/common.sh@33 -- # return 0 00:03:30.870 20:53:27 -- setup/hugepages.sh@97 -- # anon=0 00:03:30.870 20:53:27 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:30.870 20:53:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.870 20:53:27 -- setup/common.sh@18 -- # local node= 00:03:30.870 20:53:27 -- setup/common.sh@19 -- # local var val 00:03:30.870 20:53:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.870 20:53:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.870 20:53:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.870 20:53:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.870 20:53:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.870 20:53:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45127220 kB' 'MemAvailable: 48895928 kB' 'Buffers: 2708 kB' 'Cached: 10754596 kB' 'SwapCached: 0 kB' 'Active: 7469240 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068760 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479352 kB' 'Mapped: 216128 kB' 'Shmem: 6592712 kB' 'KReclaimable: 195392 kB' 'Slab: 725584 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530192 kB' 'KernelStack: 13008 kB' 'PageTables: 8236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8165880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.870 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.870 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.871 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.871 20:53:27 -- setup/common.sh@33 -- # echo 0 00:03:30.871 20:53:27 -- setup/common.sh@33 -- # return 0 00:03:30.871 20:53:27 -- setup/hugepages.sh@99 -- # surp=0 00:03:30.871 20:53:27 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:30.871 20:53:27 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:30.871 20:53:27 -- setup/common.sh@18 -- # local node= 00:03:30.871 20:53:27 -- setup/common.sh@19 -- # local var val 00:03:30.871 20:53:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.871 20:53:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.871 20:53:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.871 20:53:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.871 20:53:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.871 20:53:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.871 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45130996 kB' 'MemAvailable: 48899704 kB' 'Buffers: 2708 kB' 'Cached: 10754608 kB' 'SwapCached: 0 kB' 'Active: 7469228 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068748 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479372 kB' 'Mapped: 216048 kB' 'Shmem: 6592724 kB' 'KReclaimable: 195392 kB' 'Slab: 725524 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530132 kB' 'KernelStack: 13040 kB' 'PageTables: 8308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8168432 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.872 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.872 20:53:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.873 20:53:27 -- setup/common.sh@33 -- # echo 0 00:03:30.873 20:53:27 -- setup/common.sh@33 -- # return 0 00:03:30.873 20:53:27 -- setup/hugepages.sh@100 -- # resv=0 00:03:30.873 20:53:27 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:30.873 nr_hugepages=1024 00:03:30.873 20:53:27 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:30.873 resv_hugepages=0 00:03:30.873 20:53:27 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:30.873 surplus_hugepages=0 00:03:30.873 20:53:27 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:30.873 anon_hugepages=0 00:03:30.873 20:53:27 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:30.873 20:53:27 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:30.873 20:53:27 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:30.873 20:53:27 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:30.873 20:53:27 -- setup/common.sh@18 -- # local node= 00:03:30.873 20:53:27 -- setup/common.sh@19 -- # local var val 00:03:30.873 20:53:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.873 20:53:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.873 20:53:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.873 20:53:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.873 20:53:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.873 20:53:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45132712 kB' 'MemAvailable: 48901420 kB' 'Buffers: 2708 kB' 'Cached: 10754624 kB' 'SwapCached: 0 kB' 'Active: 7468876 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068396 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479408 kB' 'Mapped: 216048 kB' 'Shmem: 6592740 kB' 'KReclaimable: 195392 kB' 'Slab: 725524 kB' 'SReclaimable: 195392 kB' 'SUnreclaim: 530132 kB' 'KernelStack: 12880 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8168568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 35712 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2063964 kB' 'DirectMap2M: 15681536 kB' 'DirectMap1G: 52428800 kB' 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.873 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.873 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # continue 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.874 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.874 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.874 20:53:27 -- setup/common.sh@33 -- # echo 1024 00:03:30.874 20:53:27 -- setup/common.sh@33 -- # return 0 00:03:30.874 20:53:27 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:30.874 20:53:27 -- setup/hugepages.sh@112 -- # get_nodes 00:03:30.874 20:53:27 -- setup/hugepages.sh@27 -- # local node 00:03:30.874 20:53:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:30.874 20:53:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:30.874 20:53:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:30.874 20:53:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:30.874 20:53:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:30.874 20:53:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:30.875 20:53:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:30.875 20:53:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:30.875 20:53:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:30.875 20:53:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.134 20:53:27 -- setup/common.sh@18 -- # local node=0 00:03:31.134 20:53:27 -- setup/common.sh@19 -- # local var val 00:03:31.134 20:53:27 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.134 20:53:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.134 20:53:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.134 20:53:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.134 20:53:27 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.134 20:53:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.134 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.134 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.134 20:53:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27202336 kB' 'MemUsed: 5623520 kB' 'SwapCached: 0 kB' 'Active: 2291484 kB' 'Inactive: 176952 kB' 'Active(anon): 2134760 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2119016 kB' 'Mapped: 82032 kB' 'AnonPages: 352560 kB' 'Shmem: 1785340 kB' 'KernelStack: 7352 kB' 'PageTables: 5036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 110896 kB' 'Slab: 415492 kB' 'SReclaimable: 110896 kB' 'SUnreclaim: 304596 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:31.134 20:53:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.134 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.134 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.134 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.134 20:53:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.134 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # continue 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.135 20:53:27 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.135 20:53:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.135 20:53:27 -- setup/common.sh@33 -- # echo 0 00:03:31.135 20:53:27 -- setup/common.sh@33 -- # return 0 00:03:31.135 20:53:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.135 20:53:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.135 20:53:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.135 20:53:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.135 20:53:27 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:31.135 node0=1024 expecting 1024 00:03:31.135 20:53:27 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:31.135 00:03:31.135 real 0m2.872s 00:03:31.135 user 0m1.206s 00:03:31.135 sys 0m1.591s 00:03:31.135 20:53:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.135 20:53:27 -- common/autotest_common.sh@10 -- # set +x 00:03:31.135 ************************************ 00:03:31.135 END TEST no_shrink_alloc 00:03:31.135 ************************************ 00:03:31.135 20:53:27 -- setup/hugepages.sh@217 -- # clear_hp 00:03:31.135 20:53:27 -- setup/hugepages.sh@37 -- # local node hp 00:03:31.135 20:53:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.135 20:53:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.135 20:53:27 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.135 20:53:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.135 20:53:27 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.135 20:53:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.136 20:53:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.136 20:53:27 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.136 20:53:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.136 20:53:27 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.136 20:53:27 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:31.136 20:53:27 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:31.136 00:03:31.136 real 0m11.592s 00:03:31.136 user 0m4.472s 00:03:31.136 sys 0m6.060s 00:03:31.136 20:53:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:31.136 20:53:27 -- common/autotest_common.sh@10 -- # set +x 00:03:31.136 ************************************ 00:03:31.136 END TEST hugepages 00:03:31.136 ************************************ 00:03:31.136 20:53:27 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.136 20:53:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:31.136 20:53:27 -- common/autotest_common.sh@10 -- # set +x 00:03:31.136 ************************************ 00:03:31.136 START TEST driver 00:03:31.136 ************************************ 00:03:31.136 20:53:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.136 * Looking for test storage... 00:03:31.136 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:31.136 20:53:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:31.136 20:53:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:31.136 20:53:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:31.136 20:53:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:31.136 20:53:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:31.136 20:53:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:31.136 20:53:27 -- scripts/common.sh@335 -- # IFS=.-: 00:03:31.136 20:53:27 -- scripts/common.sh@335 -- # read -ra ver1 00:03:31.136 20:53:27 -- scripts/common.sh@336 -- # IFS=.-: 00:03:31.136 20:53:27 -- scripts/common.sh@336 -- # read -ra ver2 00:03:31.136 20:53:27 -- scripts/common.sh@337 -- # local 'op=<' 00:03:31.136 20:53:27 -- scripts/common.sh@339 -- # ver1_l=2 00:03:31.136 20:53:27 -- scripts/common.sh@340 -- # ver2_l=1 00:03:31.136 20:53:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:31.136 20:53:27 -- scripts/common.sh@343 -- # case "$op" in 00:03:31.136 20:53:27 -- scripts/common.sh@344 -- # : 1 00:03:31.136 20:53:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:31.136 20:53:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:31.136 20:53:27 -- scripts/common.sh@364 -- # decimal 1 00:03:31.136 20:53:27 -- scripts/common.sh@352 -- # local d=1 00:03:31.136 20:53:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:31.136 20:53:27 -- scripts/common.sh@354 -- # echo 1 00:03:31.136 20:53:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:31.136 20:53:27 -- scripts/common.sh@365 -- # decimal 2 00:03:31.136 20:53:27 -- scripts/common.sh@352 -- # local d=2 00:03:31.136 20:53:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:31.136 20:53:27 -- scripts/common.sh@354 -- # echo 2 00:03:31.136 20:53:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:31.136 20:53:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:31.136 20:53:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:31.136 20:53:27 -- scripts/common.sh@367 -- # return 0 00:03:31.136 20:53:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:31.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.136 --rc genhtml_branch_coverage=1 00:03:31.136 --rc genhtml_function_coverage=1 00:03:31.136 --rc genhtml_legend=1 00:03:31.136 --rc geninfo_all_blocks=1 00:03:31.136 --rc geninfo_unexecuted_blocks=1 00:03:31.136 00:03:31.136 ' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:31.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.136 --rc genhtml_branch_coverage=1 00:03:31.136 --rc genhtml_function_coverage=1 00:03:31.136 --rc genhtml_legend=1 00:03:31.136 --rc geninfo_all_blocks=1 00:03:31.136 --rc geninfo_unexecuted_blocks=1 00:03:31.136 00:03:31.136 ' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:31.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.136 --rc genhtml_branch_coverage=1 00:03:31.136 --rc genhtml_function_coverage=1 00:03:31.136 --rc genhtml_legend=1 00:03:31.136 --rc geninfo_all_blocks=1 00:03:31.136 --rc geninfo_unexecuted_blocks=1 00:03:31.136 00:03:31.136 ' 00:03:31.136 20:53:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:31.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:31.136 --rc genhtml_branch_coverage=1 00:03:31.136 --rc genhtml_function_coverage=1 00:03:31.136 --rc genhtml_legend=1 00:03:31.136 --rc geninfo_all_blocks=1 00:03:31.136 --rc geninfo_unexecuted_blocks=1 00:03:31.136 00:03:31.136 ' 00:03:31.136 20:53:27 -- setup/driver.sh@68 -- # setup reset 00:03:31.136 20:53:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:31.136 20:53:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:33.668 20:53:29 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:33.668 20:53:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.668 20:53:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.668 20:53:29 -- common/autotest_common.sh@10 -- # set +x 00:03:33.668 ************************************ 00:03:33.668 START TEST guess_driver 00:03:33.668 ************************************ 00:03:33.668 20:53:29 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:33.668 20:53:29 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:33.668 20:53:29 -- setup/driver.sh@47 -- # local fail=0 00:03:33.668 20:53:29 -- setup/driver.sh@49 -- # pick_driver 00:03:33.668 20:53:29 -- setup/driver.sh@36 -- # vfio 00:03:33.668 20:53:29 -- setup/driver.sh@21 -- # local iommu_grups 00:03:33.668 20:53:29 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:33.668 20:53:29 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:33.668 20:53:29 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:33.668 20:53:29 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:33.668 20:53:29 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:33.668 20:53:29 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:33.668 20:53:29 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:33.668 20:53:29 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:33.668 20:53:29 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:33.668 20:53:29 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:33.668 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:33.668 20:53:29 -- setup/driver.sh@30 -- # return 0 00:03:33.668 20:53:29 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:33.668 20:53:29 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:33.668 20:53:29 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:33.668 20:53:29 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:33.668 Looking for driver=vfio-pci 00:03:33.668 20:53:29 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.668 20:53:29 -- setup/driver.sh@45 -- # setup output config 00:03:33.668 20:53:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.668 20:53:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.043 20:53:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:35.043 20:53:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:35.043 20:53:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.009 20:53:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:36.009 20:53:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:36.009 20:53:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.009 20:53:32 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:36.009 20:53:32 -- setup/driver.sh@65 -- # setup reset 00:03:36.009 20:53:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:36.009 20:53:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.541 00:03:38.541 real 0m4.772s 00:03:38.541 user 0m1.138s 00:03:38.541 sys 0m1.870s 00:03:38.541 20:53:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.541 20:53:34 -- common/autotest_common.sh@10 -- # set +x 00:03:38.541 ************************************ 00:03:38.541 END TEST guess_driver 00:03:38.541 ************************************ 00:03:38.541 00:03:38.541 real 0m7.420s 00:03:38.541 user 0m1.824s 00:03:38.541 sys 0m2.904s 00:03:38.541 20:53:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.541 20:53:34 -- common/autotest_common.sh@10 -- # set +x 00:03:38.541 ************************************ 00:03:38.541 END TEST driver 00:03:38.541 ************************************ 00:03:38.541 20:53:34 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:38.541 20:53:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.541 20:53:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.541 20:53:34 -- common/autotest_common.sh@10 -- # set +x 00:03:38.541 ************************************ 00:03:38.541 START TEST devices 00:03:38.541 ************************************ 00:03:38.541 20:53:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:38.541 * Looking for test storage... 00:03:38.541 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:38.541 20:53:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:38.541 20:53:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:38.541 20:53:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:38.541 20:53:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:38.541 20:53:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:38.541 20:53:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:38.541 20:53:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:38.541 20:53:34 -- scripts/common.sh@335 -- # IFS=.-: 00:03:38.541 20:53:34 -- scripts/common.sh@335 -- # read -ra ver1 00:03:38.541 20:53:34 -- scripts/common.sh@336 -- # IFS=.-: 00:03:38.541 20:53:34 -- scripts/common.sh@336 -- # read -ra ver2 00:03:38.541 20:53:34 -- scripts/common.sh@337 -- # local 'op=<' 00:03:38.541 20:53:34 -- scripts/common.sh@339 -- # ver1_l=2 00:03:38.541 20:53:34 -- scripts/common.sh@340 -- # ver2_l=1 00:03:38.541 20:53:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:38.541 20:53:34 -- scripts/common.sh@343 -- # case "$op" in 00:03:38.541 20:53:34 -- scripts/common.sh@344 -- # : 1 00:03:38.541 20:53:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:38.541 20:53:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:38.541 20:53:34 -- scripts/common.sh@364 -- # decimal 1 00:03:38.541 20:53:34 -- scripts/common.sh@352 -- # local d=1 00:03:38.541 20:53:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:38.541 20:53:34 -- scripts/common.sh@354 -- # echo 1 00:03:38.541 20:53:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:38.541 20:53:34 -- scripts/common.sh@365 -- # decimal 2 00:03:38.541 20:53:34 -- scripts/common.sh@352 -- # local d=2 00:03:38.541 20:53:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:38.541 20:53:34 -- scripts/common.sh@354 -- # echo 2 00:03:38.541 20:53:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:38.541 20:53:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:38.541 20:53:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:38.541 20:53:34 -- scripts/common.sh@367 -- # return 0 00:03:38.541 20:53:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:38.541 20:53:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:38.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.541 --rc genhtml_branch_coverage=1 00:03:38.541 --rc genhtml_function_coverage=1 00:03:38.541 --rc genhtml_legend=1 00:03:38.541 --rc geninfo_all_blocks=1 00:03:38.541 --rc geninfo_unexecuted_blocks=1 00:03:38.541 00:03:38.541 ' 00:03:38.541 20:53:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:38.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.541 --rc genhtml_branch_coverage=1 00:03:38.541 --rc genhtml_function_coverage=1 00:03:38.542 --rc genhtml_legend=1 00:03:38.542 --rc geninfo_all_blocks=1 00:03:38.542 --rc geninfo_unexecuted_blocks=1 00:03:38.542 00:03:38.542 ' 00:03:38.542 20:53:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:38.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.542 --rc genhtml_branch_coverage=1 00:03:38.542 --rc genhtml_function_coverage=1 00:03:38.542 --rc genhtml_legend=1 00:03:38.542 --rc geninfo_all_blocks=1 00:03:38.542 --rc geninfo_unexecuted_blocks=1 00:03:38.542 00:03:38.542 ' 00:03:38.542 20:53:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:38.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.542 --rc genhtml_branch_coverage=1 00:03:38.542 --rc genhtml_function_coverage=1 00:03:38.542 --rc genhtml_legend=1 00:03:38.542 --rc geninfo_all_blocks=1 00:03:38.542 --rc geninfo_unexecuted_blocks=1 00:03:38.542 00:03:38.542 ' 00:03:38.542 20:53:34 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:38.542 20:53:34 -- setup/devices.sh@192 -- # setup reset 00:03:38.542 20:53:34 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:38.542 20:53:34 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:39.976 20:53:36 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:39.976 20:53:36 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:39.976 20:53:36 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:39.976 20:53:36 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:39.976 20:53:36 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:39.976 20:53:36 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:39.976 20:53:36 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:39.976 20:53:36 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:39.976 20:53:36 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:39.976 20:53:36 -- setup/devices.sh@196 -- # blocks=() 00:03:39.976 20:53:36 -- setup/devices.sh@196 -- # declare -a blocks 00:03:39.976 20:53:36 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:39.976 20:53:36 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:39.976 20:53:36 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:39.976 20:53:36 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:39.976 20:53:36 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:39.976 20:53:36 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:39.976 20:53:36 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:39.976 20:53:36 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:39.976 20:53:36 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:39.976 20:53:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:39.976 20:53:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:40.234 No valid GPT data, bailing 00:03:40.234 20:53:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:40.234 20:53:36 -- scripts/common.sh@393 -- # pt= 00:03:40.234 20:53:36 -- scripts/common.sh@394 -- # return 1 00:03:40.234 20:53:36 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:40.234 20:53:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:40.234 20:53:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:40.234 20:53:36 -- setup/common.sh@80 -- # echo 1000204886016 00:03:40.234 20:53:36 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:40.234 20:53:36 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:40.234 20:53:36 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:40.234 20:53:36 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:40.234 20:53:36 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:40.234 20:53:36 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:40.234 20:53:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:40.234 20:53:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.234 20:53:36 -- common/autotest_common.sh@10 -- # set +x 00:03:40.234 ************************************ 00:03:40.234 START TEST nvme_mount 00:03:40.234 ************************************ 00:03:40.234 20:53:36 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:40.234 20:53:36 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:40.234 20:53:36 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:40.234 20:53:36 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.235 20:53:36 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:40.235 20:53:36 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:40.235 20:53:36 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:40.235 20:53:36 -- setup/common.sh@40 -- # local part_no=1 00:03:40.235 20:53:36 -- setup/common.sh@41 -- # local size=1073741824 00:03:40.235 20:53:36 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:40.235 20:53:36 -- setup/common.sh@44 -- # parts=() 00:03:40.235 20:53:36 -- setup/common.sh@44 -- # local parts 00:03:40.235 20:53:36 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:40.235 20:53:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.235 20:53:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:40.235 20:53:36 -- setup/common.sh@46 -- # (( part++ )) 00:03:40.235 20:53:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.235 20:53:36 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:40.235 20:53:36 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:40.235 20:53:36 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:41.170 Creating new GPT entries in memory. 00:03:41.170 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:41.170 other utilities. 00:03:41.170 20:53:37 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:41.170 20:53:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.170 20:53:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:41.170 20:53:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:41.170 20:53:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:42.104 Creating new GPT entries in memory. 00:03:42.104 The operation has completed successfully. 00:03:42.104 20:53:38 -- setup/common.sh@57 -- # (( part++ )) 00:03:42.104 20:53:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.104 20:53:38 -- setup/common.sh@62 -- # wait 3848821 00:03:42.104 20:53:38 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.104 20:53:38 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:42.104 20:53:38 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.104 20:53:38 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:42.104 20:53:38 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:42.362 20:53:38 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.362 20:53:38 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.362 20:53:38 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.362 20:53:38 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:42.362 20:53:38 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.362 20:53:38 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.362 20:53:38 -- setup/devices.sh@53 -- # local found=0 00:03:42.362 20:53:38 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.362 20:53:38 -- setup/devices.sh@56 -- # : 00:03:42.362 20:53:38 -- setup/devices.sh@59 -- # local pci status 00:03:42.362 20:53:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.362 20:53:38 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.362 20:53:38 -- setup/devices.sh@47 -- # setup output config 00:03:42.362 20:53:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.362 20:53:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:43.296 20:53:39 -- setup/devices.sh@63 -- # found=1 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.296 20:53:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.296 20:53:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.555 20:53:39 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:43.555 20:53:39 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:43.555 20:53:39 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.555 20:53:39 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:43.555 20:53:39 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.555 20:53:39 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:43.555 20:53:39 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.555 20:53:39 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.555 20:53:39 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:43.555 20:53:39 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:43.555 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:43.555 20:53:39 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:43.555 20:53:39 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:43.813 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:43.813 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:43.813 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:43.813 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:43.813 20:53:39 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:43.813 20:53:39 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:43.813 20:53:39 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.813 20:53:39 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:43.813 20:53:39 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:43.813 20:53:40 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.071 20:53:40 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.071 20:53:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.071 20:53:40 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:44.071 20:53:40 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.071 20:53:40 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.071 20:53:40 -- setup/devices.sh@53 -- # local found=0 00:03:44.071 20:53:40 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:44.071 20:53:40 -- setup/devices.sh@56 -- # : 00:03:44.071 20:53:40 -- setup/devices.sh@59 -- # local pci status 00:03:44.071 20:53:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.071 20:53:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.071 20:53:40 -- setup/devices.sh@47 -- # setup output config 00:03:44.071 20:53:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.071 20:53:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:45.006 20:53:41 -- setup/devices.sh@63 -- # found=1 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.006 20:53:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.006 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.264 20:53:41 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:45.264 20:53:41 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:45.264 20:53:41 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.264 20:53:41 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:45.264 20:53:41 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:45.264 20:53:41 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:45.264 20:53:41 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:45.264 20:53:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:45.264 20:53:41 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:45.264 20:53:41 -- setup/devices.sh@50 -- # local mount_point= 00:03:45.264 20:53:41 -- setup/devices.sh@51 -- # local test_file= 00:03:45.264 20:53:41 -- setup/devices.sh@53 -- # local found=0 00:03:45.264 20:53:41 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:45.264 20:53:41 -- setup/devices.sh@59 -- # local pci status 00:03:45.264 20:53:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.264 20:53:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:45.264 20:53:41 -- setup/devices.sh@47 -- # setup output config 00:03:45.264 20:53:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.264 20:53:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:46.638 20:53:42 -- setup/devices.sh@63 -- # found=1 00:03:46.638 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.638 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.638 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.638 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.638 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.638 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.639 20:53:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.639 20:53:42 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:46.639 20:53:42 -- setup/devices.sh@68 -- # return 0 00:03:46.639 20:53:42 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:46.639 20:53:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.639 20:53:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.639 20:53:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:46.639 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:46.639 00:03:46.639 real 0m6.433s 00:03:46.639 user 0m1.467s 00:03:46.639 sys 0m2.554s 00:03:46.639 20:53:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.639 20:53:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.639 ************************************ 00:03:46.639 END TEST nvme_mount 00:03:46.639 ************************************ 00:03:46.639 20:53:42 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:46.639 20:53:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.639 20:53:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.639 20:53:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.639 ************************************ 00:03:46.639 START TEST dm_mount 00:03:46.639 ************************************ 00:03:46.639 20:53:42 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:46.639 20:53:42 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:46.639 20:53:42 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:46.639 20:53:42 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:46.639 20:53:42 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:46.639 20:53:42 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:46.639 20:53:42 -- setup/common.sh@40 -- # local part_no=2 00:03:46.639 20:53:42 -- setup/common.sh@41 -- # local size=1073741824 00:03:46.639 20:53:42 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:46.639 20:53:42 -- setup/common.sh@44 -- # parts=() 00:03:46.639 20:53:42 -- setup/common.sh@44 -- # local parts 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.639 20:53:42 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part++ )) 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.639 20:53:42 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part++ )) 00:03:46.639 20:53:42 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:46.639 20:53:42 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:46.639 20:53:42 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:46.639 20:53:42 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:47.574 Creating new GPT entries in memory. 00:03:47.574 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:47.574 other utilities. 00:03:47.574 20:53:43 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:47.574 20:53:43 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:47.574 20:53:43 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:47.574 20:53:43 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:47.574 20:53:43 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:48.511 Creating new GPT entries in memory. 00:03:48.511 The operation has completed successfully. 00:03:48.511 20:53:44 -- setup/common.sh@57 -- # (( part++ )) 00:03:48.511 20:53:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:48.511 20:53:44 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:48.511 20:53:44 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:48.511 20:53:44 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:49.888 The operation has completed successfully. 00:03:49.888 20:53:45 -- setup/common.sh@57 -- # (( part++ )) 00:03:49.888 20:53:45 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:49.888 20:53:45 -- setup/common.sh@62 -- # wait 3851288 00:03:49.888 20:53:45 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:49.888 20:53:45 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.888 20:53:45 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:49.888 20:53:45 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:49.888 20:53:45 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:49.888 20:53:45 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:49.888 20:53:45 -- setup/devices.sh@161 -- # break 00:03:49.888 20:53:45 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:49.888 20:53:45 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:49.888 20:53:45 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:49.888 20:53:45 -- setup/devices.sh@166 -- # dm=dm-0 00:03:49.888 20:53:45 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:49.888 20:53:45 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:49.888 20:53:45 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.888 20:53:45 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:49.888 20:53:45 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.888 20:53:45 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:49.888 20:53:45 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:49.888 20:53:45 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.888 20:53:45 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:49.888 20:53:45 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:49.888 20:53:45 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:49.888 20:53:45 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:49.888 20:53:45 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:49.888 20:53:45 -- setup/devices.sh@53 -- # local found=0 00:03:49.888 20:53:45 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:49.888 20:53:45 -- setup/devices.sh@56 -- # : 00:03:49.888 20:53:45 -- setup/devices.sh@59 -- # local pci status 00:03:49.888 20:53:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.888 20:53:45 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:49.888 20:53:45 -- setup/devices.sh@47 -- # setup output config 00:03:49.888 20:53:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.888 20:53:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:50.824 20:53:47 -- setup/devices.sh@63 -- # found=1 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.824 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.824 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.082 20:53:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:51.082 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.083 20:53:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:51.083 20:53:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:51.083 20:53:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.083 20:53:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:51.083 20:53:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:51.083 20:53:47 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:51.083 20:53:47 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:51.083 20:53:47 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:51.083 20:53:47 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:51.083 20:53:47 -- setup/devices.sh@50 -- # local mount_point= 00:03:51.083 20:53:47 -- setup/devices.sh@51 -- # local test_file= 00:03:51.083 20:53:47 -- setup/devices.sh@53 -- # local found=0 00:03:51.083 20:53:47 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:51.083 20:53:47 -- setup/devices.sh@59 -- # local pci status 00:03:51.083 20:53:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:51.083 20:53:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:51.083 20:53:47 -- setup/devices.sh@47 -- # setup output config 00:03:51.083 20:53:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.083 20:53:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:52.459 20:53:48 -- setup/devices.sh@63 -- # found=1 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:52.459 20:53:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.459 20:53:48 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.459 20:53:48 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:52.459 20:53:48 -- setup/devices.sh@68 -- # return 0 00:03:52.459 20:53:48 -- setup/devices.sh@187 -- # cleanup_dm 00:03:52.460 20:53:48 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.460 20:53:48 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:52.460 20:53:48 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:52.460 20:53:48 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.460 20:53:48 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:52.460 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:52.460 20:53:48 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:52.460 20:53:48 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:52.460 00:03:52.460 real 0m5.927s 00:03:52.460 user 0m1.048s 00:03:52.460 sys 0m1.748s 00:03:52.460 20:53:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.460 20:53:48 -- common/autotest_common.sh@10 -- # set +x 00:03:52.460 ************************************ 00:03:52.460 END TEST dm_mount 00:03:52.460 ************************************ 00:03:52.460 20:53:48 -- setup/devices.sh@1 -- # cleanup 00:03:52.460 20:53:48 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:52.460 20:53:48 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.460 20:53:48 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.460 20:53:48 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:52.460 20:53:48 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.460 20:53:48 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:52.717 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:52.717 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:52.717 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:52.717 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:52.717 20:53:48 -- setup/devices.sh@12 -- # cleanup_dm 00:03:52.717 20:53:48 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.717 20:53:48 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:52.717 20:53:48 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.717 20:53:48 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:52.717 20:53:48 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.717 20:53:48 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:52.975 00:03:52.975 real 0m14.336s 00:03:52.975 user 0m3.213s 00:03:52.975 sys 0m5.345s 00:03:52.975 20:53:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.975 20:53:48 -- common/autotest_common.sh@10 -- # set +x 00:03:52.975 ************************************ 00:03:52.975 END TEST devices 00:03:52.975 ************************************ 00:03:52.975 00:03:52.975 real 0m44.401s 00:03:52.975 user 0m12.917s 00:03:52.975 sys 0m20.087s 00:03:52.975 20:53:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.975 20:53:48 -- common/autotest_common.sh@10 -- # set +x 00:03:52.975 ************************************ 00:03:52.975 END TEST setup.sh 00:03:52.975 ************************************ 00:03:52.975 20:53:48 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:53.905 Hugepages 00:03:53.905 node hugesize free / total 00:03:53.905 node0 1048576kB 0 / 0 00:03:53.905 node0 2048kB 2048 / 2048 00:03:53.905 node1 1048576kB 0 / 0 00:03:53.905 node1 2048kB 0 / 0 00:03:53.905 00:03:53.905 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:53.905 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:53.905 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:53.905 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:53.905 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:53.905 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:53.905 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:53.905 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:53.906 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:53.906 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:53.906 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:53.906 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:53.906 20:53:50 -- spdk/autotest.sh@128 -- # uname -s 00:03:53.906 20:53:50 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:53.906 20:53:50 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:53.906 20:53:50 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:55.276 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:55.276 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:55.276 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:56.210 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:56.469 20:53:52 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:57.405 20:53:53 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:57.405 20:53:53 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:57.405 20:53:53 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:57.405 20:53:53 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:57.405 20:53:53 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:57.405 20:53:53 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:57.405 20:53:53 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:57.405 20:53:53 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:57.405 20:53:53 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:57.405 20:53:53 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:57.405 20:53:53 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:57.405 20:53:53 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:58.781 Waiting for block devices as requested 00:03:58.781 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:58.781 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:58.781 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:59.040 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:59.040 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:59.040 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:59.298 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:59.298 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:59.298 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:59.298 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:59.557 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:59.557 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:59.557 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:59.557 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:59.816 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:59.816 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:59.816 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:00.074 20:53:56 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:00.074 20:53:56 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:00.074 20:53:56 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:00.074 20:53:56 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:00.074 20:53:56 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:00.074 20:53:56 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:00.074 20:53:56 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:00.074 20:53:56 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:00.074 20:53:56 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:00.074 20:53:56 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:00.074 20:53:56 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:00.074 20:53:56 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:00.074 20:53:56 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:00.074 20:53:56 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:00.074 20:53:56 -- common/autotest_common.sh@1552 -- # continue 00:04:00.074 20:53:56 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:00.074 20:53:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:00.074 20:53:56 -- common/autotest_common.sh@10 -- # set +x 00:04:00.074 20:53:56 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:00.074 20:53:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:00.074 20:53:56 -- common/autotest_common.sh@10 -- # set +x 00:04:00.074 20:53:56 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:01.449 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:01.449 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:01.449 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:02.383 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:02.383 20:53:58 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:02.383 20:53:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:02.383 20:53:58 -- common/autotest_common.sh@10 -- # set +x 00:04:02.383 20:53:58 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:02.383 20:53:58 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:02.383 20:53:58 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:02.383 20:53:58 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:02.383 20:53:58 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:02.383 20:53:58 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:02.383 20:53:58 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:02.383 20:53:58 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:02.383 20:53:58 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:02.383 20:53:58 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:02.383 20:53:58 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:02.383 20:53:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:02.383 20:53:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:02.383 20:53:58 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:02.383 20:53:58 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:02.642 20:53:58 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:02.642 20:53:58 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:02.642 20:53:58 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:02.642 20:53:58 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:02.642 20:53:58 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:02.642 20:53:58 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3856711 00:04:02.642 20:53:58 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:02.642 20:53:58 -- common/autotest_common.sh@1593 -- # waitforlisten 3856711 00:04:02.642 20:53:58 -- common/autotest_common.sh@829 -- # '[' -z 3856711 ']' 00:04:02.642 20:53:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:02.642 20:53:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:02.642 20:53:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:02.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:02.642 20:53:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:02.642 20:53:58 -- common/autotest_common.sh@10 -- # set +x 00:04:02.642 [2024-11-27 20:53:58.676301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:02.642 [2024-11-27 20:53:58.676390] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3856711 ] 00:04:02.642 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.642 [2024-11-27 20:53:58.738308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:02.642 [2024-11-27 20:53:58.851684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:02.642 [2024-11-27 20:53:58.851883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.575 20:53:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:03.575 20:53:59 -- common/autotest_common.sh@862 -- # return 0 00:04:03.575 20:53:59 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:03.575 20:53:59 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:03.576 20:53:59 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:06.857 nvme0n1 00:04:06.857 20:54:02 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:06.857 [2024-11-27 20:54:02.945368] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:06.857 [2024-11-27 20:54:02.945421] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:06.857 request: 00:04:06.857 { 00:04:06.857 "nvme_ctrlr_name": "nvme0", 00:04:06.857 "password": "test", 00:04:06.857 "method": "bdev_nvme_opal_revert", 00:04:06.857 "req_id": 1 00:04:06.857 } 00:04:06.857 Got JSON-RPC error response 00:04:06.857 response: 00:04:06.857 { 00:04:06.857 "code": -32603, 00:04:06.857 "message": "Internal error" 00:04:06.857 } 00:04:06.857 20:54:02 -- common/autotest_common.sh@1599 -- # true 00:04:06.857 20:54:02 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:06.857 20:54:02 -- common/autotest_common.sh@1603 -- # killprocess 3856711 00:04:06.857 20:54:02 -- common/autotest_common.sh@936 -- # '[' -z 3856711 ']' 00:04:06.857 20:54:02 -- common/autotest_common.sh@940 -- # kill -0 3856711 00:04:06.857 20:54:02 -- common/autotest_common.sh@941 -- # uname 00:04:06.857 20:54:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:06.857 20:54:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3856711 00:04:06.857 20:54:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:06.857 20:54:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:06.857 20:54:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3856711' 00:04:06.857 killing process with pid 3856711 00:04:06.857 20:54:03 -- common/autotest_common.sh@955 -- # kill 3856711 00:04:06.857 20:54:03 -- common/autotest_common.sh@960 -- # wait 3856711 00:04:08.757 20:54:04 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:08.757 20:54:04 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:08.757 20:54:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:08.757 20:54:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:08.757 20:54:04 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:08.757 20:54:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:08.757 20:54:04 -- common/autotest_common.sh@10 -- # set +x 00:04:08.757 20:54:04 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:08.757 20:54:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.757 20:54:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.757 20:54:04 -- common/autotest_common.sh@10 -- # set +x 00:04:08.757 ************************************ 00:04:08.757 START TEST env 00:04:08.757 ************************************ 00:04:08.757 20:54:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:08.757 * Looking for test storage... 00:04:08.757 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:08.757 20:54:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:08.757 20:54:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:08.757 20:54:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:08.757 20:54:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:08.757 20:54:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:08.757 20:54:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:08.757 20:54:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:08.757 20:54:04 -- scripts/common.sh@335 -- # IFS=.-: 00:04:08.757 20:54:04 -- scripts/common.sh@335 -- # read -ra ver1 00:04:08.757 20:54:04 -- scripts/common.sh@336 -- # IFS=.-: 00:04:08.757 20:54:04 -- scripts/common.sh@336 -- # read -ra ver2 00:04:08.757 20:54:04 -- scripts/common.sh@337 -- # local 'op=<' 00:04:08.757 20:54:04 -- scripts/common.sh@339 -- # ver1_l=2 00:04:08.757 20:54:04 -- scripts/common.sh@340 -- # ver2_l=1 00:04:08.757 20:54:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:08.757 20:54:04 -- scripts/common.sh@343 -- # case "$op" in 00:04:08.757 20:54:04 -- scripts/common.sh@344 -- # : 1 00:04:08.757 20:54:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:08.757 20:54:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:08.757 20:54:04 -- scripts/common.sh@364 -- # decimal 1 00:04:08.757 20:54:04 -- scripts/common.sh@352 -- # local d=1 00:04:08.757 20:54:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:08.757 20:54:04 -- scripts/common.sh@354 -- # echo 1 00:04:08.757 20:54:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:08.757 20:54:04 -- scripts/common.sh@365 -- # decimal 2 00:04:08.757 20:54:04 -- scripts/common.sh@352 -- # local d=2 00:04:08.757 20:54:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:08.757 20:54:04 -- scripts/common.sh@354 -- # echo 2 00:04:08.757 20:54:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:08.758 20:54:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:08.758 20:54:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:08.758 20:54:04 -- scripts/common.sh@367 -- # return 0 00:04:08.758 20:54:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:08.758 20:54:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:08.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.758 --rc genhtml_branch_coverage=1 00:04:08.758 --rc genhtml_function_coverage=1 00:04:08.758 --rc genhtml_legend=1 00:04:08.758 --rc geninfo_all_blocks=1 00:04:08.758 --rc geninfo_unexecuted_blocks=1 00:04:08.758 00:04:08.758 ' 00:04:08.758 20:54:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:08.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.758 --rc genhtml_branch_coverage=1 00:04:08.758 --rc genhtml_function_coverage=1 00:04:08.758 --rc genhtml_legend=1 00:04:08.758 --rc geninfo_all_blocks=1 00:04:08.758 --rc geninfo_unexecuted_blocks=1 00:04:08.758 00:04:08.758 ' 00:04:08.758 20:54:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:08.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.758 --rc genhtml_branch_coverage=1 00:04:08.758 --rc genhtml_function_coverage=1 00:04:08.758 --rc genhtml_legend=1 00:04:08.758 --rc geninfo_all_blocks=1 00:04:08.758 --rc geninfo_unexecuted_blocks=1 00:04:08.758 00:04:08.758 ' 00:04:08.758 20:54:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:08.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.758 --rc genhtml_branch_coverage=1 00:04:08.758 --rc genhtml_function_coverage=1 00:04:08.758 --rc genhtml_legend=1 00:04:08.758 --rc geninfo_all_blocks=1 00:04:08.758 --rc geninfo_unexecuted_blocks=1 00:04:08.758 00:04:08.758 ' 00:04:08.758 20:54:04 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:08.758 20:54:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.758 20:54:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.758 20:54:04 -- common/autotest_common.sh@10 -- # set +x 00:04:08.758 ************************************ 00:04:08.758 START TEST env_memory 00:04:08.758 ************************************ 00:04:08.758 20:54:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:08.758 00:04:08.758 00:04:08.758 CUnit - A unit testing framework for C - Version 2.1-3 00:04:08.758 http://cunit.sourceforge.net/ 00:04:08.758 00:04:08.758 00:04:08.758 Suite: memory 00:04:09.017 Test: alloc and free memory map ...[2024-11-27 20:54:05.008158] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:09.017 passed 00:04:09.017 Test: mem map translation ...[2024-11-27 20:54:05.033419] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:09.017 [2024-11-27 20:54:05.033446] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:09.017 [2024-11-27 20:54:05.033497] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:09.017 [2024-11-27 20:54:05.033532] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:09.017 passed 00:04:09.017 Test: mem map registration ...[2024-11-27 20:54:05.083463] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:09.017 [2024-11-27 20:54:05.083487] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:09.017 passed 00:04:09.017 Test: mem map adjacent registrations ...passed 00:04:09.017 00:04:09.017 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.017 suites 1 1 n/a 0 0 00:04:09.017 tests 4 4 4 0 0 00:04:09.017 asserts 152 152 152 0 n/a 00:04:09.017 00:04:09.017 Elapsed time = 0.170 seconds 00:04:09.017 00:04:09.017 real 0m0.177s 00:04:09.017 user 0m0.171s 00:04:09.017 sys 0m0.006s 00:04:09.017 20:54:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.017 20:54:05 -- common/autotest_common.sh@10 -- # set +x 00:04:09.017 ************************************ 00:04:09.017 END TEST env_memory 00:04:09.017 ************************************ 00:04:09.017 20:54:05 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:09.017 20:54:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.017 20:54:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.017 20:54:05 -- common/autotest_common.sh@10 -- # set +x 00:04:09.017 ************************************ 00:04:09.017 START TEST env_vtophys 00:04:09.017 ************************************ 00:04:09.017 20:54:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:09.017 EAL: lib.eal log level changed from notice to debug 00:04:09.017 EAL: Detected lcore 0 as core 0 on socket 0 00:04:09.018 EAL: Detected lcore 1 as core 1 on socket 0 00:04:09.018 EAL: Detected lcore 2 as core 2 on socket 0 00:04:09.018 EAL: Detected lcore 3 as core 3 on socket 0 00:04:09.018 EAL: Detected lcore 4 as core 4 on socket 0 00:04:09.018 EAL: Detected lcore 5 as core 5 on socket 0 00:04:09.018 EAL: Detected lcore 6 as core 8 on socket 0 00:04:09.018 EAL: Detected lcore 7 as core 9 on socket 0 00:04:09.018 EAL: Detected lcore 8 as core 10 on socket 0 00:04:09.018 EAL: Detected lcore 9 as core 11 on socket 0 00:04:09.018 EAL: Detected lcore 10 as core 12 on socket 0 00:04:09.018 EAL: Detected lcore 11 as core 13 on socket 0 00:04:09.018 EAL: Detected lcore 12 as core 0 on socket 1 00:04:09.018 EAL: Detected lcore 13 as core 1 on socket 1 00:04:09.018 EAL: Detected lcore 14 as core 2 on socket 1 00:04:09.018 EAL: Detected lcore 15 as core 3 on socket 1 00:04:09.018 EAL: Detected lcore 16 as core 4 on socket 1 00:04:09.018 EAL: Detected lcore 17 as core 5 on socket 1 00:04:09.018 EAL: Detected lcore 18 as core 8 on socket 1 00:04:09.018 EAL: Detected lcore 19 as core 9 on socket 1 00:04:09.018 EAL: Detected lcore 20 as core 10 on socket 1 00:04:09.018 EAL: Detected lcore 21 as core 11 on socket 1 00:04:09.018 EAL: Detected lcore 22 as core 12 on socket 1 00:04:09.018 EAL: Detected lcore 23 as core 13 on socket 1 00:04:09.018 EAL: Detected lcore 24 as core 0 on socket 0 00:04:09.018 EAL: Detected lcore 25 as core 1 on socket 0 00:04:09.018 EAL: Detected lcore 26 as core 2 on socket 0 00:04:09.018 EAL: Detected lcore 27 as core 3 on socket 0 00:04:09.018 EAL: Detected lcore 28 as core 4 on socket 0 00:04:09.018 EAL: Detected lcore 29 as core 5 on socket 0 00:04:09.018 EAL: Detected lcore 30 as core 8 on socket 0 00:04:09.018 EAL: Detected lcore 31 as core 9 on socket 0 00:04:09.018 EAL: Detected lcore 32 as core 10 on socket 0 00:04:09.018 EAL: Detected lcore 33 as core 11 on socket 0 00:04:09.018 EAL: Detected lcore 34 as core 12 on socket 0 00:04:09.018 EAL: Detected lcore 35 as core 13 on socket 0 00:04:09.018 EAL: Detected lcore 36 as core 0 on socket 1 00:04:09.018 EAL: Detected lcore 37 as core 1 on socket 1 00:04:09.018 EAL: Detected lcore 38 as core 2 on socket 1 00:04:09.018 EAL: Detected lcore 39 as core 3 on socket 1 00:04:09.018 EAL: Detected lcore 40 as core 4 on socket 1 00:04:09.018 EAL: Detected lcore 41 as core 5 on socket 1 00:04:09.018 EAL: Detected lcore 42 as core 8 on socket 1 00:04:09.018 EAL: Detected lcore 43 as core 9 on socket 1 00:04:09.018 EAL: Detected lcore 44 as core 10 on socket 1 00:04:09.018 EAL: Detected lcore 45 as core 11 on socket 1 00:04:09.018 EAL: Detected lcore 46 as core 12 on socket 1 00:04:09.018 EAL: Detected lcore 47 as core 13 on socket 1 00:04:09.018 EAL: Maximum logical cores by configuration: 128 00:04:09.018 EAL: Detected CPU lcores: 48 00:04:09.018 EAL: Detected NUMA nodes: 2 00:04:09.018 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:09.018 EAL: Detected shared linkage of DPDK 00:04:09.018 EAL: No shared files mode enabled, IPC will be disabled 00:04:09.018 EAL: Bus pci wants IOVA as 'DC' 00:04:09.018 EAL: Buses did not request a specific IOVA mode. 00:04:09.018 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:09.018 EAL: Selected IOVA mode 'VA' 00:04:09.018 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.018 EAL: Probing VFIO support... 00:04:09.018 EAL: IOMMU type 1 (Type 1) is supported 00:04:09.018 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:09.018 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:09.018 EAL: VFIO support initialized 00:04:09.018 EAL: Ask a virtual area of 0x2e000 bytes 00:04:09.018 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:09.018 EAL: Setting up physically contiguous memory... 00:04:09.018 EAL: Setting maximum number of open files to 524288 00:04:09.018 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:09.018 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:09.018 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:09.018 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:09.018 EAL: Ask a virtual area of 0x61000 bytes 00:04:09.018 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:09.018 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:09.018 EAL: Ask a virtual area of 0x400000000 bytes 00:04:09.018 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:09.018 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:09.018 EAL: Hugepages will be freed exactly as allocated. 00:04:09.018 EAL: No shared files mode enabled, IPC is disabled 00:04:09.018 EAL: No shared files mode enabled, IPC is disabled 00:04:09.018 EAL: TSC frequency is ~2700000 KHz 00:04:09.018 EAL: Main lcore 0 is ready (tid=7fa962649a00;cpuset=[0]) 00:04:09.018 EAL: Trying to obtain current memory policy. 00:04:09.018 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.018 EAL: Restoring previous memory policy: 0 00:04:09.018 EAL: request: mp_malloc_sync 00:04:09.018 EAL: No shared files mode enabled, IPC is disabled 00:04:09.018 EAL: Heap on socket 0 was expanded by 2MB 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:09.019 EAL: Mem event callback 'spdk:(nil)' registered 00:04:09.019 00:04:09.019 00:04:09.019 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.019 http://cunit.sourceforge.net/ 00:04:09.019 00:04:09.019 00:04:09.019 Suite: components_suite 00:04:09.019 Test: vtophys_malloc_test ...passed 00:04:09.019 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:09.019 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.019 EAL: Restoring previous memory policy: 4 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.019 EAL: request: mp_malloc_sync 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: Heap on socket 0 was expanded by 4MB 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.019 EAL: request: mp_malloc_sync 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: Heap on socket 0 was shrunk by 4MB 00:04:09.019 EAL: Trying to obtain current memory policy. 00:04:09.019 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.019 EAL: Restoring previous memory policy: 4 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.019 EAL: request: mp_malloc_sync 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: Heap on socket 0 was expanded by 6MB 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.019 EAL: request: mp_malloc_sync 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: Heap on socket 0 was shrunk by 6MB 00:04:09.019 EAL: Trying to obtain current memory policy. 00:04:09.019 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.019 EAL: Restoring previous memory policy: 4 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.019 EAL: request: mp_malloc_sync 00:04:09.019 EAL: No shared files mode enabled, IPC is disabled 00:04:09.019 EAL: Heap on socket 0 was expanded by 10MB 00:04:09.019 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was shrunk by 10MB 00:04:09.287 EAL: Trying to obtain current memory policy. 00:04:09.287 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.287 EAL: Restoring previous memory policy: 4 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was expanded by 18MB 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was shrunk by 18MB 00:04:09.287 EAL: Trying to obtain current memory policy. 00:04:09.287 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.287 EAL: Restoring previous memory policy: 4 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was expanded by 34MB 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was shrunk by 34MB 00:04:09.287 EAL: Trying to obtain current memory policy. 00:04:09.287 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.287 EAL: Restoring previous memory policy: 4 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was expanded by 66MB 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.287 EAL: Heap on socket 0 was shrunk by 66MB 00:04:09.287 EAL: Trying to obtain current memory policy. 00:04:09.287 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.287 EAL: Restoring previous memory policy: 4 00:04:09.287 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.287 EAL: request: mp_malloc_sync 00:04:09.287 EAL: No shared files mode enabled, IPC is disabled 00:04:09.288 EAL: Heap on socket 0 was expanded by 130MB 00:04:09.288 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.288 EAL: request: mp_malloc_sync 00:04:09.288 EAL: No shared files mode enabled, IPC is disabled 00:04:09.288 EAL: Heap on socket 0 was shrunk by 130MB 00:04:09.288 EAL: Trying to obtain current memory policy. 00:04:09.288 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.288 EAL: Restoring previous memory policy: 4 00:04:09.288 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.288 EAL: request: mp_malloc_sync 00:04:09.288 EAL: No shared files mode enabled, IPC is disabled 00:04:09.288 EAL: Heap on socket 0 was expanded by 258MB 00:04:09.593 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.593 EAL: request: mp_malloc_sync 00:04:09.593 EAL: No shared files mode enabled, IPC is disabled 00:04:09.593 EAL: Heap on socket 0 was shrunk by 258MB 00:04:09.593 EAL: Trying to obtain current memory policy. 00:04:09.593 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:09.593 EAL: Restoring previous memory policy: 4 00:04:09.593 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.593 EAL: request: mp_malloc_sync 00:04:09.593 EAL: No shared files mode enabled, IPC is disabled 00:04:09.593 EAL: Heap on socket 0 was expanded by 514MB 00:04:09.852 EAL: Calling mem event callback 'spdk:(nil)' 00:04:09.852 EAL: request: mp_malloc_sync 00:04:09.852 EAL: No shared files mode enabled, IPC is disabled 00:04:09.852 EAL: Heap on socket 0 was shrunk by 514MB 00:04:09.852 EAL: Trying to obtain current memory policy. 00:04:09.852 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:10.110 EAL: Restoring previous memory policy: 4 00:04:10.110 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.110 EAL: request: mp_malloc_sync 00:04:10.110 EAL: No shared files mode enabled, IPC is disabled 00:04:10.110 EAL: Heap on socket 0 was expanded by 1026MB 00:04:10.400 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.658 EAL: request: mp_malloc_sync 00:04:10.658 EAL: No shared files mode enabled, IPC is disabled 00:04:10.658 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:10.658 passed 00:04:10.658 00:04:10.658 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.658 suites 1 1 n/a 0 0 00:04:10.659 tests 2 2 2 0 0 00:04:10.659 asserts 497 497 497 0 n/a 00:04:10.659 00:04:10.659 Elapsed time = 1.376 seconds 00:04:10.659 EAL: Calling mem event callback 'spdk:(nil)' 00:04:10.659 EAL: request: mp_malloc_sync 00:04:10.659 EAL: No shared files mode enabled, IPC is disabled 00:04:10.659 EAL: Heap on socket 0 was shrunk by 2MB 00:04:10.659 EAL: No shared files mode enabled, IPC is disabled 00:04:10.659 EAL: No shared files mode enabled, IPC is disabled 00:04:10.659 EAL: No shared files mode enabled, IPC is disabled 00:04:10.659 00:04:10.659 real 0m1.496s 00:04:10.659 user 0m0.854s 00:04:10.659 sys 0m0.604s 00:04:10.659 20:54:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.659 20:54:06 -- common/autotest_common.sh@10 -- # set +x 00:04:10.659 ************************************ 00:04:10.659 END TEST env_vtophys 00:04:10.659 ************************************ 00:04:10.659 20:54:06 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:10.659 20:54:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.659 20:54:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.659 20:54:06 -- common/autotest_common.sh@10 -- # set +x 00:04:10.659 ************************************ 00:04:10.659 START TEST env_pci 00:04:10.659 ************************************ 00:04:10.659 20:54:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:10.659 00:04:10.659 00:04:10.659 CUnit - A unit testing framework for C - Version 2.1-3 00:04:10.659 http://cunit.sourceforge.net/ 00:04:10.659 00:04:10.659 00:04:10.659 Suite: pci 00:04:10.659 Test: pci_hook ...[2024-11-27 20:54:06.705859] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3857870 has claimed it 00:04:10.659 EAL: Cannot find device (10000:00:01.0) 00:04:10.659 EAL: Failed to attach device on primary process 00:04:10.659 passed 00:04:10.659 00:04:10.659 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.659 suites 1 1 n/a 0 0 00:04:10.659 tests 1 1 1 0 0 00:04:10.659 asserts 25 25 25 0 n/a 00:04:10.659 00:04:10.659 Elapsed time = 0.022 seconds 00:04:10.659 00:04:10.659 real 0m0.034s 00:04:10.659 user 0m0.013s 00:04:10.659 sys 0m0.020s 00:04:10.659 20:54:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.659 20:54:06 -- common/autotest_common.sh@10 -- # set +x 00:04:10.659 ************************************ 00:04:10.659 END TEST env_pci 00:04:10.659 ************************************ 00:04:10.659 20:54:06 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:10.659 20:54:06 -- env/env.sh@15 -- # uname 00:04:10.659 20:54:06 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:10.659 20:54:06 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:10.659 20:54:06 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:10.659 20:54:06 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:10.659 20:54:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.659 20:54:06 -- common/autotest_common.sh@10 -- # set +x 00:04:10.659 ************************************ 00:04:10.659 START TEST env_dpdk_post_init 00:04:10.659 ************************************ 00:04:10.659 20:54:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:10.659 EAL: Detected CPU lcores: 48 00:04:10.659 EAL: Detected NUMA nodes: 2 00:04:10.659 EAL: Detected shared linkage of DPDK 00:04:10.659 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:10.659 EAL: Selected IOVA mode 'VA' 00:04:10.659 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.659 EAL: VFIO support initialized 00:04:10.659 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:10.659 EAL: Using IOMMU type 1 (Type 1) 00:04:10.659 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:10.659 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:10.918 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:11.853 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:15.134 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:15.134 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:15.134 Starting DPDK initialization... 00:04:15.134 Starting SPDK post initialization... 00:04:15.134 SPDK NVMe probe 00:04:15.134 Attaching to 0000:88:00.0 00:04:15.134 Attached to 0000:88:00.0 00:04:15.134 Cleaning up... 00:04:15.134 00:04:15.134 real 0m4.399s 00:04:15.134 user 0m3.280s 00:04:15.134 sys 0m0.175s 00:04:15.134 20:54:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.134 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.134 ************************************ 00:04:15.134 END TEST env_dpdk_post_init 00:04:15.134 ************************************ 00:04:15.134 20:54:11 -- env/env.sh@26 -- # uname 00:04:15.134 20:54:11 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:15.134 20:54:11 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:15.134 20:54:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.134 20:54:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.134 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.134 ************************************ 00:04:15.134 START TEST env_mem_callbacks 00:04:15.134 ************************************ 00:04:15.134 20:54:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:15.134 EAL: Detected CPU lcores: 48 00:04:15.134 EAL: Detected NUMA nodes: 2 00:04:15.134 EAL: Detected shared linkage of DPDK 00:04:15.134 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:15.134 EAL: Selected IOVA mode 'VA' 00:04:15.134 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.134 EAL: VFIO support initialized 00:04:15.134 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:15.134 00:04:15.134 00:04:15.134 CUnit - A unit testing framework for C - Version 2.1-3 00:04:15.134 http://cunit.sourceforge.net/ 00:04:15.134 00:04:15.134 00:04:15.134 Suite: memory 00:04:15.134 Test: test ... 00:04:15.134 register 0x200000200000 2097152 00:04:15.134 malloc 3145728 00:04:15.134 register 0x200000400000 4194304 00:04:15.134 buf 0x200000500000 len 3145728 PASSED 00:04:15.134 malloc 64 00:04:15.134 buf 0x2000004fff40 len 64 PASSED 00:04:15.134 malloc 4194304 00:04:15.134 register 0x200000800000 6291456 00:04:15.134 buf 0x200000a00000 len 4194304 PASSED 00:04:15.134 free 0x200000500000 3145728 00:04:15.134 free 0x2000004fff40 64 00:04:15.134 unregister 0x200000400000 4194304 PASSED 00:04:15.134 free 0x200000a00000 4194304 00:04:15.134 unregister 0x200000800000 6291456 PASSED 00:04:15.134 malloc 8388608 00:04:15.134 register 0x200000400000 10485760 00:04:15.134 buf 0x200000600000 len 8388608 PASSED 00:04:15.134 free 0x200000600000 8388608 00:04:15.134 unregister 0x200000400000 10485760 PASSED 00:04:15.134 passed 00:04:15.134 00:04:15.134 Run Summary: Type Total Ran Passed Failed Inactive 00:04:15.134 suites 1 1 n/a 0 0 00:04:15.134 tests 1 1 1 0 0 00:04:15.134 asserts 15 15 15 0 n/a 00:04:15.134 00:04:15.134 Elapsed time = 0.005 seconds 00:04:15.134 00:04:15.134 real 0m0.050s 00:04:15.134 user 0m0.010s 00:04:15.134 sys 0m0.040s 00:04:15.134 20:54:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.134 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.134 ************************************ 00:04:15.134 END TEST env_mem_callbacks 00:04:15.134 ************************************ 00:04:15.134 00:04:15.134 real 0m6.426s 00:04:15.134 user 0m4.464s 00:04:15.134 sys 0m1.009s 00:04:15.134 20:54:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.134 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.134 ************************************ 00:04:15.134 END TEST env 00:04:15.134 ************************************ 00:04:15.134 20:54:11 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:15.134 20:54:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.134 20:54:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.134 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.134 ************************************ 00:04:15.134 START TEST rpc 00:04:15.135 ************************************ 00:04:15.135 20:54:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:15.135 * Looking for test storage... 00:04:15.135 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:15.135 20:54:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:15.135 20:54:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:15.135 20:54:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:15.394 20:54:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:15.394 20:54:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:15.394 20:54:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:15.394 20:54:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:15.394 20:54:11 -- scripts/common.sh@335 -- # IFS=.-: 00:04:15.394 20:54:11 -- scripts/common.sh@335 -- # read -ra ver1 00:04:15.394 20:54:11 -- scripts/common.sh@336 -- # IFS=.-: 00:04:15.394 20:54:11 -- scripts/common.sh@336 -- # read -ra ver2 00:04:15.394 20:54:11 -- scripts/common.sh@337 -- # local 'op=<' 00:04:15.394 20:54:11 -- scripts/common.sh@339 -- # ver1_l=2 00:04:15.394 20:54:11 -- scripts/common.sh@340 -- # ver2_l=1 00:04:15.394 20:54:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:15.394 20:54:11 -- scripts/common.sh@343 -- # case "$op" in 00:04:15.394 20:54:11 -- scripts/common.sh@344 -- # : 1 00:04:15.394 20:54:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:15.394 20:54:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:15.394 20:54:11 -- scripts/common.sh@364 -- # decimal 1 00:04:15.394 20:54:11 -- scripts/common.sh@352 -- # local d=1 00:04:15.394 20:54:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:15.394 20:54:11 -- scripts/common.sh@354 -- # echo 1 00:04:15.394 20:54:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:15.394 20:54:11 -- scripts/common.sh@365 -- # decimal 2 00:04:15.394 20:54:11 -- scripts/common.sh@352 -- # local d=2 00:04:15.394 20:54:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:15.394 20:54:11 -- scripts/common.sh@354 -- # echo 2 00:04:15.394 20:54:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:15.394 20:54:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:15.394 20:54:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:15.394 20:54:11 -- scripts/common.sh@367 -- # return 0 00:04:15.394 20:54:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:15.394 20:54:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:15.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.394 --rc genhtml_branch_coverage=1 00:04:15.394 --rc genhtml_function_coverage=1 00:04:15.394 --rc genhtml_legend=1 00:04:15.394 --rc geninfo_all_blocks=1 00:04:15.394 --rc geninfo_unexecuted_blocks=1 00:04:15.394 00:04:15.394 ' 00:04:15.394 20:54:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:15.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.394 --rc genhtml_branch_coverage=1 00:04:15.394 --rc genhtml_function_coverage=1 00:04:15.394 --rc genhtml_legend=1 00:04:15.394 --rc geninfo_all_blocks=1 00:04:15.394 --rc geninfo_unexecuted_blocks=1 00:04:15.394 00:04:15.394 ' 00:04:15.394 20:54:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:15.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.394 --rc genhtml_branch_coverage=1 00:04:15.394 --rc genhtml_function_coverage=1 00:04:15.394 --rc genhtml_legend=1 00:04:15.394 --rc geninfo_all_blocks=1 00:04:15.394 --rc geninfo_unexecuted_blocks=1 00:04:15.394 00:04:15.394 ' 00:04:15.394 20:54:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:15.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.394 --rc genhtml_branch_coverage=1 00:04:15.394 --rc genhtml_function_coverage=1 00:04:15.394 --rc genhtml_legend=1 00:04:15.394 --rc geninfo_all_blocks=1 00:04:15.394 --rc geninfo_unexecuted_blocks=1 00:04:15.394 00:04:15.394 ' 00:04:15.394 20:54:11 -- rpc/rpc.sh@65 -- # spdk_pid=3859047 00:04:15.394 20:54:11 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:15.394 20:54:11 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:15.394 20:54:11 -- rpc/rpc.sh@67 -- # waitforlisten 3859047 00:04:15.394 20:54:11 -- common/autotest_common.sh@829 -- # '[' -z 3859047 ']' 00:04:15.394 20:54:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:15.394 20:54:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:15.394 20:54:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:15.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:15.394 20:54:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:15.394 20:54:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.394 [2024-11-27 20:54:11.464091] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:15.394 [2024-11-27 20:54:11.464178] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3859047 ] 00:04:15.394 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.394 [2024-11-27 20:54:11.524824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.653 [2024-11-27 20:54:11.638947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:15.653 [2024-11-27 20:54:11.639112] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:15.653 [2024-11-27 20:54:11.639132] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3859047' to capture a snapshot of events at runtime. 00:04:15.653 [2024-11-27 20:54:11.639144] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3859047 for offline analysis/debug. 00:04:15.653 [2024-11-27 20:54:11.639171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.219 20:54:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:16.219 20:54:12 -- common/autotest_common.sh@862 -- # return 0 00:04:16.219 20:54:12 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:16.219 20:54:12 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:16.219 20:54:12 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:16.219 20:54:12 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:16.219 20:54:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.219 20:54:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.219 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.219 ************************************ 00:04:16.219 START TEST rpc_integrity 00:04:16.219 ************************************ 00:04:16.219 20:54:12 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:16.219 20:54:12 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:16.219 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.219 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.219 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.219 20:54:12 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:16.219 20:54:12 -- rpc/rpc.sh@13 -- # jq length 00:04:16.477 20:54:12 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:16.477 20:54:12 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:16.477 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.477 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.477 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.477 20:54:12 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:16.477 20:54:12 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:16.477 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.477 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.477 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.477 20:54:12 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:16.477 { 00:04:16.477 "name": "Malloc0", 00:04:16.477 "aliases": [ 00:04:16.477 "d611ccd0-50d4-43f0-9b80-e68931dc4c6a" 00:04:16.477 ], 00:04:16.477 "product_name": "Malloc disk", 00:04:16.477 "block_size": 512, 00:04:16.477 "num_blocks": 16384, 00:04:16.477 "uuid": "d611ccd0-50d4-43f0-9b80-e68931dc4c6a", 00:04:16.477 "assigned_rate_limits": { 00:04:16.477 "rw_ios_per_sec": 0, 00:04:16.477 "rw_mbytes_per_sec": 0, 00:04:16.477 "r_mbytes_per_sec": 0, 00:04:16.477 "w_mbytes_per_sec": 0 00:04:16.477 }, 00:04:16.477 "claimed": false, 00:04:16.477 "zoned": false, 00:04:16.477 "supported_io_types": { 00:04:16.477 "read": true, 00:04:16.477 "write": true, 00:04:16.477 "unmap": true, 00:04:16.477 "write_zeroes": true, 00:04:16.477 "flush": true, 00:04:16.477 "reset": true, 00:04:16.477 "compare": false, 00:04:16.477 "compare_and_write": false, 00:04:16.477 "abort": true, 00:04:16.477 "nvme_admin": false, 00:04:16.477 "nvme_io": false 00:04:16.477 }, 00:04:16.477 "memory_domains": [ 00:04:16.477 { 00:04:16.477 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.477 "dma_device_type": 2 00:04:16.477 } 00:04:16.477 ], 00:04:16.477 "driver_specific": {} 00:04:16.477 } 00:04:16.477 ]' 00:04:16.477 20:54:12 -- rpc/rpc.sh@17 -- # jq length 00:04:16.477 20:54:12 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:16.477 20:54:12 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:16.477 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.477 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 [2024-11-27 20:54:12.526261] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:16.478 [2024-11-27 20:54:12.526312] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:16.478 [2024-11-27 20:54:12.526338] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1eabcb0 00:04:16.478 [2024-11-27 20:54:12.526368] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:16.478 [2024-11-27 20:54:12.527757] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:16.478 [2024-11-27 20:54:12.527783] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:16.478 Passthru0 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:16.478 { 00:04:16.478 "name": "Malloc0", 00:04:16.478 "aliases": [ 00:04:16.478 "d611ccd0-50d4-43f0-9b80-e68931dc4c6a" 00:04:16.478 ], 00:04:16.478 "product_name": "Malloc disk", 00:04:16.478 "block_size": 512, 00:04:16.478 "num_blocks": 16384, 00:04:16.478 "uuid": "d611ccd0-50d4-43f0-9b80-e68931dc4c6a", 00:04:16.478 "assigned_rate_limits": { 00:04:16.478 "rw_ios_per_sec": 0, 00:04:16.478 "rw_mbytes_per_sec": 0, 00:04:16.478 "r_mbytes_per_sec": 0, 00:04:16.478 "w_mbytes_per_sec": 0 00:04:16.478 }, 00:04:16.478 "claimed": true, 00:04:16.478 "claim_type": "exclusive_write", 00:04:16.478 "zoned": false, 00:04:16.478 "supported_io_types": { 00:04:16.478 "read": true, 00:04:16.478 "write": true, 00:04:16.478 "unmap": true, 00:04:16.478 "write_zeroes": true, 00:04:16.478 "flush": true, 00:04:16.478 "reset": true, 00:04:16.478 "compare": false, 00:04:16.478 "compare_and_write": false, 00:04:16.478 "abort": true, 00:04:16.478 "nvme_admin": false, 00:04:16.478 "nvme_io": false 00:04:16.478 }, 00:04:16.478 "memory_domains": [ 00:04:16.478 { 00:04:16.478 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.478 "dma_device_type": 2 00:04:16.478 } 00:04:16.478 ], 00:04:16.478 "driver_specific": {} 00:04:16.478 }, 00:04:16.478 { 00:04:16.478 "name": "Passthru0", 00:04:16.478 "aliases": [ 00:04:16.478 "a4b4cf84-c87c-5655-9c01-9df1eb40a4ed" 00:04:16.478 ], 00:04:16.478 "product_name": "passthru", 00:04:16.478 "block_size": 512, 00:04:16.478 "num_blocks": 16384, 00:04:16.478 "uuid": "a4b4cf84-c87c-5655-9c01-9df1eb40a4ed", 00:04:16.478 "assigned_rate_limits": { 00:04:16.478 "rw_ios_per_sec": 0, 00:04:16.478 "rw_mbytes_per_sec": 0, 00:04:16.478 "r_mbytes_per_sec": 0, 00:04:16.478 "w_mbytes_per_sec": 0 00:04:16.478 }, 00:04:16.478 "claimed": false, 00:04:16.478 "zoned": false, 00:04:16.478 "supported_io_types": { 00:04:16.478 "read": true, 00:04:16.478 "write": true, 00:04:16.478 "unmap": true, 00:04:16.478 "write_zeroes": true, 00:04:16.478 "flush": true, 00:04:16.478 "reset": true, 00:04:16.478 "compare": false, 00:04:16.478 "compare_and_write": false, 00:04:16.478 "abort": true, 00:04:16.478 "nvme_admin": false, 00:04:16.478 "nvme_io": false 00:04:16.478 }, 00:04:16.478 "memory_domains": [ 00:04:16.478 { 00:04:16.478 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.478 "dma_device_type": 2 00:04:16.478 } 00:04:16.478 ], 00:04:16.478 "driver_specific": { 00:04:16.478 "passthru": { 00:04:16.478 "name": "Passthru0", 00:04:16.478 "base_bdev_name": "Malloc0" 00:04:16.478 } 00:04:16.478 } 00:04:16.478 } 00:04:16.478 ]' 00:04:16.478 20:54:12 -- rpc/rpc.sh@21 -- # jq length 00:04:16.478 20:54:12 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:16.478 20:54:12 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:16.478 20:54:12 -- rpc/rpc.sh@26 -- # jq length 00:04:16.478 20:54:12 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:16.478 00:04:16.478 real 0m0.230s 00:04:16.478 user 0m0.151s 00:04:16.478 sys 0m0.019s 00:04:16.478 20:54:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 ************************************ 00:04:16.478 END TEST rpc_integrity 00:04:16.478 ************************************ 00:04:16.478 20:54:12 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:16.478 20:54:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.478 20:54:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 ************************************ 00:04:16.478 START TEST rpc_plugins 00:04:16.478 ************************************ 00:04:16.478 20:54:12 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:16.478 20:54:12 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:16.478 20:54:12 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:16.478 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.478 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.478 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.478 20:54:12 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:16.478 { 00:04:16.478 "name": "Malloc1", 00:04:16.478 "aliases": [ 00:04:16.478 "fb3831cb-9414-4cee-9d2e-89c4c2a52049" 00:04:16.478 ], 00:04:16.478 "product_name": "Malloc disk", 00:04:16.478 "block_size": 4096, 00:04:16.478 "num_blocks": 256, 00:04:16.478 "uuid": "fb3831cb-9414-4cee-9d2e-89c4c2a52049", 00:04:16.478 "assigned_rate_limits": { 00:04:16.478 "rw_ios_per_sec": 0, 00:04:16.479 "rw_mbytes_per_sec": 0, 00:04:16.479 "r_mbytes_per_sec": 0, 00:04:16.479 "w_mbytes_per_sec": 0 00:04:16.479 }, 00:04:16.479 "claimed": false, 00:04:16.479 "zoned": false, 00:04:16.479 "supported_io_types": { 00:04:16.479 "read": true, 00:04:16.479 "write": true, 00:04:16.479 "unmap": true, 00:04:16.479 "write_zeroes": true, 00:04:16.479 "flush": true, 00:04:16.479 "reset": true, 00:04:16.479 "compare": false, 00:04:16.479 "compare_and_write": false, 00:04:16.479 "abort": true, 00:04:16.479 "nvme_admin": false, 00:04:16.479 "nvme_io": false 00:04:16.479 }, 00:04:16.479 "memory_domains": [ 00:04:16.479 { 00:04:16.479 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.479 "dma_device_type": 2 00:04:16.479 } 00:04:16.479 ], 00:04:16.479 "driver_specific": {} 00:04:16.479 } 00:04:16.479 ]' 00:04:16.479 20:54:12 -- rpc/rpc.sh@32 -- # jq length 00:04:16.736 20:54:12 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:16.736 20:54:12 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:16.736 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.736 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.736 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.736 20:54:12 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:16.736 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.737 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.737 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.737 20:54:12 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:16.737 20:54:12 -- rpc/rpc.sh@36 -- # jq length 00:04:16.737 20:54:12 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:16.737 00:04:16.737 real 0m0.117s 00:04:16.737 user 0m0.077s 00:04:16.737 sys 0m0.009s 00:04:16.737 20:54:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.737 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.737 ************************************ 00:04:16.737 END TEST rpc_plugins 00:04:16.737 ************************************ 00:04:16.737 20:54:12 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:16.737 20:54:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.737 20:54:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.737 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.737 ************************************ 00:04:16.737 START TEST rpc_trace_cmd_test 00:04:16.737 ************************************ 00:04:16.737 20:54:12 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:16.737 20:54:12 -- rpc/rpc.sh@40 -- # local info 00:04:16.737 20:54:12 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:16.737 20:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.737 20:54:12 -- common/autotest_common.sh@10 -- # set +x 00:04:16.737 20:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.737 20:54:12 -- rpc/rpc.sh@42 -- # info='{ 00:04:16.737 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3859047", 00:04:16.737 "tpoint_group_mask": "0x8", 00:04:16.737 "iscsi_conn": { 00:04:16.737 "mask": "0x2", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "scsi": { 00:04:16.737 "mask": "0x4", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "bdev": { 00:04:16.737 "mask": "0x8", 00:04:16.737 "tpoint_mask": "0xffffffffffffffff" 00:04:16.737 }, 00:04:16.737 "nvmf_rdma": { 00:04:16.737 "mask": "0x10", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "nvmf_tcp": { 00:04:16.737 "mask": "0x20", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "ftl": { 00:04:16.737 "mask": "0x40", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "blobfs": { 00:04:16.737 "mask": "0x80", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "dsa": { 00:04:16.737 "mask": "0x200", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "thread": { 00:04:16.737 "mask": "0x400", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "nvme_pcie": { 00:04:16.737 "mask": "0x800", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "iaa": { 00:04:16.737 "mask": "0x1000", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "nvme_tcp": { 00:04:16.737 "mask": "0x2000", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 }, 00:04:16.737 "bdev_nvme": { 00:04:16.737 "mask": "0x4000", 00:04:16.737 "tpoint_mask": "0x0" 00:04:16.737 } 00:04:16.737 }' 00:04:16.737 20:54:12 -- rpc/rpc.sh@43 -- # jq length 00:04:16.737 20:54:12 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:16.737 20:54:12 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:16.737 20:54:12 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:16.737 20:54:12 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:16.737 20:54:12 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:16.737 20:54:12 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:16.737 20:54:12 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:16.737 20:54:12 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:16.995 20:54:13 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:16.995 00:04:16.995 real 0m0.196s 00:04:16.995 user 0m0.173s 00:04:16.995 sys 0m0.017s 00:04:16.995 20:54:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 ************************************ 00:04:16.995 END TEST rpc_trace_cmd_test 00:04:16.995 ************************************ 00:04:16.995 20:54:13 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:16.995 20:54:13 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:16.995 20:54:13 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:16.995 20:54:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.995 20:54:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 ************************************ 00:04:16.995 START TEST rpc_daemon_integrity 00:04:16.995 ************************************ 00:04:16.995 20:54:13 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:16.995 20:54:13 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:16.995 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.995 20:54:13 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:16.995 20:54:13 -- rpc/rpc.sh@13 -- # jq length 00:04:16.995 20:54:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:16.995 20:54:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:16.995 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.995 20:54:13 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:16.995 20:54:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:16.995 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.995 20:54:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:16.995 { 00:04:16.995 "name": "Malloc2", 00:04:16.995 "aliases": [ 00:04:16.995 "6380e6d7-7f57-464f-aaca-8f5ceb714567" 00:04:16.995 ], 00:04:16.995 "product_name": "Malloc disk", 00:04:16.995 "block_size": 512, 00:04:16.995 "num_blocks": 16384, 00:04:16.995 "uuid": "6380e6d7-7f57-464f-aaca-8f5ceb714567", 00:04:16.995 "assigned_rate_limits": { 00:04:16.995 "rw_ios_per_sec": 0, 00:04:16.995 "rw_mbytes_per_sec": 0, 00:04:16.995 "r_mbytes_per_sec": 0, 00:04:16.995 "w_mbytes_per_sec": 0 00:04:16.995 }, 00:04:16.995 "claimed": false, 00:04:16.995 "zoned": false, 00:04:16.995 "supported_io_types": { 00:04:16.995 "read": true, 00:04:16.995 "write": true, 00:04:16.995 "unmap": true, 00:04:16.995 "write_zeroes": true, 00:04:16.995 "flush": true, 00:04:16.995 "reset": true, 00:04:16.995 "compare": false, 00:04:16.995 "compare_and_write": false, 00:04:16.995 "abort": true, 00:04:16.995 "nvme_admin": false, 00:04:16.995 "nvme_io": false 00:04:16.995 }, 00:04:16.995 "memory_domains": [ 00:04:16.995 { 00:04:16.995 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.995 "dma_device_type": 2 00:04:16.995 } 00:04:16.995 ], 00:04:16.995 "driver_specific": {} 00:04:16.995 } 00:04:16.995 ]' 00:04:16.995 20:54:13 -- rpc/rpc.sh@17 -- # jq length 00:04:16.995 20:54:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:16.995 20:54:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:16.995 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.995 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.995 [2024-11-27 20:54:13.140456] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:16.995 [2024-11-27 20:54:13.140507] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:16.996 [2024-11-27 20:54:13.140541] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1ead590 00:04:16.996 [2024-11-27 20:54:13.140558] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:16.996 [2024-11-27 20:54:13.141894] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:16.996 [2024-11-27 20:54:13.141922] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:16.996 Passthru0 00:04:16.996 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.996 20:54:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:16.996 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.996 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.996 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.996 20:54:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:16.996 { 00:04:16.996 "name": "Malloc2", 00:04:16.996 "aliases": [ 00:04:16.996 "6380e6d7-7f57-464f-aaca-8f5ceb714567" 00:04:16.996 ], 00:04:16.996 "product_name": "Malloc disk", 00:04:16.996 "block_size": 512, 00:04:16.996 "num_blocks": 16384, 00:04:16.996 "uuid": "6380e6d7-7f57-464f-aaca-8f5ceb714567", 00:04:16.996 "assigned_rate_limits": { 00:04:16.996 "rw_ios_per_sec": 0, 00:04:16.996 "rw_mbytes_per_sec": 0, 00:04:16.996 "r_mbytes_per_sec": 0, 00:04:16.996 "w_mbytes_per_sec": 0 00:04:16.996 }, 00:04:16.996 "claimed": true, 00:04:16.996 "claim_type": "exclusive_write", 00:04:16.996 "zoned": false, 00:04:16.996 "supported_io_types": { 00:04:16.996 "read": true, 00:04:16.996 "write": true, 00:04:16.996 "unmap": true, 00:04:16.996 "write_zeroes": true, 00:04:16.996 "flush": true, 00:04:16.996 "reset": true, 00:04:16.996 "compare": false, 00:04:16.996 "compare_and_write": false, 00:04:16.996 "abort": true, 00:04:16.996 "nvme_admin": false, 00:04:16.996 "nvme_io": false 00:04:16.996 }, 00:04:16.996 "memory_domains": [ 00:04:16.996 { 00:04:16.996 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.996 "dma_device_type": 2 00:04:16.996 } 00:04:16.996 ], 00:04:16.996 "driver_specific": {} 00:04:16.996 }, 00:04:16.996 { 00:04:16.996 "name": "Passthru0", 00:04:16.996 "aliases": [ 00:04:16.996 "87c247d2-1da2-55ed-823a-fa68cb1535dd" 00:04:16.996 ], 00:04:16.996 "product_name": "passthru", 00:04:16.996 "block_size": 512, 00:04:16.996 "num_blocks": 16384, 00:04:16.996 "uuid": "87c247d2-1da2-55ed-823a-fa68cb1535dd", 00:04:16.996 "assigned_rate_limits": { 00:04:16.996 "rw_ios_per_sec": 0, 00:04:16.996 "rw_mbytes_per_sec": 0, 00:04:16.996 "r_mbytes_per_sec": 0, 00:04:16.996 "w_mbytes_per_sec": 0 00:04:16.996 }, 00:04:16.996 "claimed": false, 00:04:16.996 "zoned": false, 00:04:16.996 "supported_io_types": { 00:04:16.996 "read": true, 00:04:16.996 "write": true, 00:04:16.996 "unmap": true, 00:04:16.996 "write_zeroes": true, 00:04:16.996 "flush": true, 00:04:16.996 "reset": true, 00:04:16.996 "compare": false, 00:04:16.996 "compare_and_write": false, 00:04:16.996 "abort": true, 00:04:16.996 "nvme_admin": false, 00:04:16.996 "nvme_io": false 00:04:16.996 }, 00:04:16.996 "memory_domains": [ 00:04:16.996 { 00:04:16.996 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.996 "dma_device_type": 2 00:04:16.996 } 00:04:16.996 ], 00:04:16.996 "driver_specific": { 00:04:16.996 "passthru": { 00:04:16.996 "name": "Passthru0", 00:04:16.996 "base_bdev_name": "Malloc2" 00:04:16.996 } 00:04:16.996 } 00:04:16.996 } 00:04:16.996 ]' 00:04:16.996 20:54:13 -- rpc/rpc.sh@21 -- # jq length 00:04:16.996 20:54:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:16.996 20:54:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:16.996 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.996 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.996 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.996 20:54:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:16.996 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.996 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.996 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.996 20:54:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:16.996 20:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.996 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.996 20:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.996 20:54:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:16.996 20:54:13 -- rpc/rpc.sh@26 -- # jq length 00:04:17.254 20:54:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:17.254 00:04:17.254 real 0m0.224s 00:04:17.254 user 0m0.146s 00:04:17.254 sys 0m0.021s 00:04:17.254 20:54:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.254 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.254 ************************************ 00:04:17.254 END TEST rpc_daemon_integrity 00:04:17.254 ************************************ 00:04:17.254 20:54:13 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:17.254 20:54:13 -- rpc/rpc.sh@84 -- # killprocess 3859047 00:04:17.254 20:54:13 -- common/autotest_common.sh@936 -- # '[' -z 3859047 ']' 00:04:17.254 20:54:13 -- common/autotest_common.sh@940 -- # kill -0 3859047 00:04:17.254 20:54:13 -- common/autotest_common.sh@941 -- # uname 00:04:17.254 20:54:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:17.254 20:54:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3859047 00:04:17.254 20:54:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:17.254 20:54:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:17.254 20:54:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3859047' 00:04:17.254 killing process with pid 3859047 00:04:17.254 20:54:13 -- common/autotest_common.sh@955 -- # kill 3859047 00:04:17.254 20:54:13 -- common/autotest_common.sh@960 -- # wait 3859047 00:04:17.819 00:04:17.819 real 0m2.491s 00:04:17.819 user 0m3.144s 00:04:17.819 sys 0m0.585s 00:04:17.819 20:54:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.819 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.819 ************************************ 00:04:17.819 END TEST rpc 00:04:17.819 ************************************ 00:04:17.819 20:54:13 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:17.819 20:54:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.819 20:54:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.819 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.819 ************************************ 00:04:17.819 START TEST rpc_client 00:04:17.819 ************************************ 00:04:17.819 20:54:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:17.819 * Looking for test storage... 00:04:17.819 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:17.819 20:54:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:17.819 20:54:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:17.819 20:54:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:17.819 20:54:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:17.819 20:54:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:17.819 20:54:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:17.819 20:54:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:17.819 20:54:13 -- scripts/common.sh@335 -- # IFS=.-: 00:04:17.819 20:54:13 -- scripts/common.sh@335 -- # read -ra ver1 00:04:17.819 20:54:13 -- scripts/common.sh@336 -- # IFS=.-: 00:04:17.819 20:54:13 -- scripts/common.sh@336 -- # read -ra ver2 00:04:17.819 20:54:13 -- scripts/common.sh@337 -- # local 'op=<' 00:04:17.819 20:54:13 -- scripts/common.sh@339 -- # ver1_l=2 00:04:17.819 20:54:13 -- scripts/common.sh@340 -- # ver2_l=1 00:04:17.819 20:54:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:17.819 20:54:13 -- scripts/common.sh@343 -- # case "$op" in 00:04:17.819 20:54:13 -- scripts/common.sh@344 -- # : 1 00:04:17.819 20:54:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:17.819 20:54:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:17.820 20:54:13 -- scripts/common.sh@364 -- # decimal 1 00:04:17.820 20:54:13 -- scripts/common.sh@352 -- # local d=1 00:04:17.820 20:54:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:17.820 20:54:13 -- scripts/common.sh@354 -- # echo 1 00:04:17.820 20:54:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:17.820 20:54:13 -- scripts/common.sh@365 -- # decimal 2 00:04:17.820 20:54:13 -- scripts/common.sh@352 -- # local d=2 00:04:17.820 20:54:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:17.820 20:54:13 -- scripts/common.sh@354 -- # echo 2 00:04:17.820 20:54:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:17.820 20:54:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:17.820 20:54:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:17.820 20:54:13 -- scripts/common.sh@367 -- # return 0 00:04:17.820 20:54:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:17.820 20:54:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:17.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.820 --rc genhtml_branch_coverage=1 00:04:17.820 --rc genhtml_function_coverage=1 00:04:17.820 --rc genhtml_legend=1 00:04:17.820 --rc geninfo_all_blocks=1 00:04:17.820 --rc geninfo_unexecuted_blocks=1 00:04:17.820 00:04:17.820 ' 00:04:17.820 20:54:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:17.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.820 --rc genhtml_branch_coverage=1 00:04:17.820 --rc genhtml_function_coverage=1 00:04:17.820 --rc genhtml_legend=1 00:04:17.820 --rc geninfo_all_blocks=1 00:04:17.820 --rc geninfo_unexecuted_blocks=1 00:04:17.820 00:04:17.820 ' 00:04:17.820 20:54:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:17.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.820 --rc genhtml_branch_coverage=1 00:04:17.820 --rc genhtml_function_coverage=1 00:04:17.820 --rc genhtml_legend=1 00:04:17.820 --rc geninfo_all_blocks=1 00:04:17.820 --rc geninfo_unexecuted_blocks=1 00:04:17.820 00:04:17.820 ' 00:04:17.820 20:54:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:17.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:17.820 --rc genhtml_branch_coverage=1 00:04:17.820 --rc genhtml_function_coverage=1 00:04:17.820 --rc genhtml_legend=1 00:04:17.820 --rc geninfo_all_blocks=1 00:04:17.820 --rc geninfo_unexecuted_blocks=1 00:04:17.820 00:04:17.820 ' 00:04:17.820 20:54:13 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:17.820 OK 00:04:17.820 20:54:13 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:17.820 00:04:17.820 real 0m0.153s 00:04:17.820 user 0m0.089s 00:04:17.820 sys 0m0.073s 00:04:17.820 20:54:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.820 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.820 ************************************ 00:04:17.820 END TEST rpc_client 00:04:17.820 ************************************ 00:04:17.820 20:54:13 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:17.820 20:54:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.820 20:54:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.820 20:54:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.820 ************************************ 00:04:17.820 START TEST json_config 00:04:17.820 ************************************ 00:04:17.820 20:54:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:17.820 20:54:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:17.820 20:54:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:17.820 20:54:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:18.079 20:54:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:18.079 20:54:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:18.079 20:54:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:18.079 20:54:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:18.079 20:54:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:18.079 20:54:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:18.079 20:54:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:18.079 20:54:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:18.079 20:54:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:18.079 20:54:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:18.079 20:54:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:18.079 20:54:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:18.079 20:54:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:18.079 20:54:14 -- scripts/common.sh@344 -- # : 1 00:04:18.079 20:54:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:18.079 20:54:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:18.079 20:54:14 -- scripts/common.sh@364 -- # decimal 1 00:04:18.079 20:54:14 -- scripts/common.sh@352 -- # local d=1 00:04:18.079 20:54:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:18.079 20:54:14 -- scripts/common.sh@354 -- # echo 1 00:04:18.079 20:54:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:18.079 20:54:14 -- scripts/common.sh@365 -- # decimal 2 00:04:18.079 20:54:14 -- scripts/common.sh@352 -- # local d=2 00:04:18.079 20:54:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:18.079 20:54:14 -- scripts/common.sh@354 -- # echo 2 00:04:18.079 20:54:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:18.079 20:54:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:18.079 20:54:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:18.079 20:54:14 -- scripts/common.sh@367 -- # return 0 00:04:18.079 20:54:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:18.079 20:54:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:18.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.079 --rc genhtml_branch_coverage=1 00:04:18.079 --rc genhtml_function_coverage=1 00:04:18.079 --rc genhtml_legend=1 00:04:18.079 --rc geninfo_all_blocks=1 00:04:18.079 --rc geninfo_unexecuted_blocks=1 00:04:18.079 00:04:18.079 ' 00:04:18.079 20:54:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:18.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.079 --rc genhtml_branch_coverage=1 00:04:18.079 --rc genhtml_function_coverage=1 00:04:18.079 --rc genhtml_legend=1 00:04:18.079 --rc geninfo_all_blocks=1 00:04:18.079 --rc geninfo_unexecuted_blocks=1 00:04:18.079 00:04:18.079 ' 00:04:18.079 20:54:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:18.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.079 --rc genhtml_branch_coverage=1 00:04:18.079 --rc genhtml_function_coverage=1 00:04:18.079 --rc genhtml_legend=1 00:04:18.079 --rc geninfo_all_blocks=1 00:04:18.079 --rc geninfo_unexecuted_blocks=1 00:04:18.079 00:04:18.079 ' 00:04:18.079 20:54:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:18.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.079 --rc genhtml_branch_coverage=1 00:04:18.079 --rc genhtml_function_coverage=1 00:04:18.079 --rc genhtml_legend=1 00:04:18.079 --rc geninfo_all_blocks=1 00:04:18.079 --rc geninfo_unexecuted_blocks=1 00:04:18.079 00:04:18.079 ' 00:04:18.079 20:54:14 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:18.079 20:54:14 -- nvmf/common.sh@7 -- # uname -s 00:04:18.079 20:54:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:18.079 20:54:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:18.079 20:54:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:18.079 20:54:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:18.079 20:54:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:18.079 20:54:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:18.079 20:54:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:18.079 20:54:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:18.079 20:54:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:18.079 20:54:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:18.079 20:54:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:18.079 20:54:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:18.079 20:54:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:18.079 20:54:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:18.079 20:54:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:18.079 20:54:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:18.079 20:54:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:18.079 20:54:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:18.079 20:54:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:18.079 20:54:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.079 20:54:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.079 20:54:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.079 20:54:14 -- paths/export.sh@5 -- # export PATH 00:04:18.079 20:54:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:18.079 20:54:14 -- nvmf/common.sh@46 -- # : 0 00:04:18.079 20:54:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:18.079 20:54:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:18.079 20:54:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:18.079 20:54:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:18.079 20:54:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:18.079 20:54:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:18.079 20:54:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:18.079 20:54:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:18.079 20:54:14 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:18.079 20:54:14 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:18.079 20:54:14 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:18.079 20:54:14 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:18.080 20:54:14 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:18.080 20:54:14 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:18.080 20:54:14 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:18.080 20:54:14 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:18.080 20:54:14 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:18.080 20:54:14 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:18.080 20:54:14 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:18.080 20:54:14 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:18.080 20:54:14 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:18.080 20:54:14 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:18.080 20:54:14 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:18.080 INFO: JSON configuration test init 00:04:18.080 20:54:14 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:18.080 20:54:14 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:18.080 20:54:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:18.080 20:54:14 -- common/autotest_common.sh@10 -- # set +x 00:04:18.080 20:54:14 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:18.080 20:54:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:18.080 20:54:14 -- common/autotest_common.sh@10 -- # set +x 00:04:18.080 20:54:14 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:18.080 20:54:14 -- json_config/json_config.sh@98 -- # local app=target 00:04:18.080 20:54:14 -- json_config/json_config.sh@99 -- # shift 00:04:18.080 20:54:14 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:18.080 20:54:14 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:18.080 20:54:14 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:18.080 20:54:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.080 20:54:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:18.080 20:54:14 -- json_config/json_config.sh@111 -- # app_pid[$app]=3859569 00:04:18.080 20:54:14 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:18.080 20:54:14 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:18.080 Waiting for target to run... 00:04:18.080 20:54:14 -- json_config/json_config.sh@114 -- # waitforlisten 3859569 /var/tmp/spdk_tgt.sock 00:04:18.080 20:54:14 -- common/autotest_common.sh@829 -- # '[' -z 3859569 ']' 00:04:18.080 20:54:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:18.080 20:54:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:18.080 20:54:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:18.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:18.080 20:54:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:18.080 20:54:14 -- common/autotest_common.sh@10 -- # set +x 00:04:18.080 [2024-11-27 20:54:14.164771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:18.080 [2024-11-27 20:54:14.164876] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3859569 ] 00:04:18.080 EAL: No free 2048 kB hugepages reported on node 1 00:04:18.338 [2024-11-27 20:54:14.519138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:18.596 [2024-11-27 20:54:14.606649] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:18.596 [2024-11-27 20:54:14.606831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.163 20:54:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.163 20:54:15 -- common/autotest_common.sh@862 -- # return 0 00:04:19.163 20:54:15 -- json_config/json_config.sh@115 -- # echo '' 00:04:19.163 00:04:19.163 20:54:15 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:19.163 20:54:15 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:19.163 20:54:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:19.163 20:54:15 -- common/autotest_common.sh@10 -- # set +x 00:04:19.163 20:54:15 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:19.163 20:54:15 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:19.163 20:54:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.163 20:54:15 -- common/autotest_common.sh@10 -- # set +x 00:04:19.163 20:54:15 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:19.163 20:54:15 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:19.163 20:54:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:22.446 20:54:18 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:22.446 20:54:18 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:22.446 20:54:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:22.446 20:54:18 -- common/autotest_common.sh@10 -- # set +x 00:04:22.446 20:54:18 -- json_config/json_config.sh@48 -- # local ret=0 00:04:22.446 20:54:18 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:22.446 20:54:18 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:22.446 20:54:18 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:22.446 20:54:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:22.446 20:54:18 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:22.446 20:54:18 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:22.446 20:54:18 -- json_config/json_config.sh@51 -- # local get_types 00:04:22.446 20:54:18 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:22.446 20:54:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:22.446 20:54:18 -- common/autotest_common.sh@10 -- # set +x 00:04:22.446 20:54:18 -- json_config/json_config.sh@58 -- # return 0 00:04:22.446 20:54:18 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:22.446 20:54:18 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:22.446 20:54:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:22.446 20:54:18 -- common/autotest_common.sh@10 -- # set +x 00:04:22.446 20:54:18 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:22.446 20:54:18 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:22.446 20:54:18 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:22.446 20:54:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:22.705 MallocForNvmf0 00:04:22.705 20:54:18 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:22.705 20:54:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:22.963 MallocForNvmf1 00:04:22.963 20:54:19 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:22.963 20:54:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:23.219 [2024-11-27 20:54:19.340078] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:23.219 20:54:19 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:23.219 20:54:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:23.475 20:54:19 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:23.475 20:54:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:23.732 20:54:19 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:23.732 20:54:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:23.991 20:54:20 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:23.991 20:54:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:24.250 [2024-11-27 20:54:20.363468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:24.250 20:54:20 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:24.250 20:54:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.250 20:54:20 -- common/autotest_common.sh@10 -- # set +x 00:04:24.250 20:54:20 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:24.250 20:54:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.250 20:54:20 -- common/autotest_common.sh@10 -- # set +x 00:04:24.250 20:54:20 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:24.250 20:54:20 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:24.250 20:54:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:24.507 MallocBdevForConfigChangeCheck 00:04:24.507 20:54:20 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:24.507 20:54:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.507 20:54:20 -- common/autotest_common.sh@10 -- # set +x 00:04:24.507 20:54:20 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:24.508 20:54:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:25.095 20:54:21 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:25.095 INFO: shutting down applications... 00:04:25.095 20:54:21 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:25.095 20:54:21 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:25.095 20:54:21 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:25.095 20:54:21 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:26.469 Calling clear_iscsi_subsystem 00:04:26.469 Calling clear_nvmf_subsystem 00:04:26.469 Calling clear_nbd_subsystem 00:04:26.469 Calling clear_ublk_subsystem 00:04:26.469 Calling clear_vhost_blk_subsystem 00:04:26.469 Calling clear_vhost_scsi_subsystem 00:04:26.469 Calling clear_scheduler_subsystem 00:04:26.469 Calling clear_bdev_subsystem 00:04:26.469 Calling clear_accel_subsystem 00:04:26.469 Calling clear_vmd_subsystem 00:04:26.469 Calling clear_sock_subsystem 00:04:26.469 Calling clear_iobuf_subsystem 00:04:26.469 20:54:22 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:26.469 20:54:22 -- json_config/json_config.sh@396 -- # count=100 00:04:26.469 20:54:22 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:26.469 20:54:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.469 20:54:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:26.469 20:54:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:27.034 20:54:23 -- json_config/json_config.sh@398 -- # break 00:04:27.034 20:54:23 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:27.034 20:54:23 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:27.034 20:54:23 -- json_config/json_config.sh@120 -- # local app=target 00:04:27.034 20:54:23 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:27.034 20:54:23 -- json_config/json_config.sh@124 -- # [[ -n 3859569 ]] 00:04:27.034 20:54:23 -- json_config/json_config.sh@127 -- # kill -SIGINT 3859569 00:04:27.034 20:54:23 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:27.034 20:54:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:27.034 20:54:23 -- json_config/json_config.sh@130 -- # kill -0 3859569 00:04:27.034 20:54:23 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:27.602 20:54:23 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:27.602 20:54:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:27.602 20:54:23 -- json_config/json_config.sh@130 -- # kill -0 3859569 00:04:27.602 20:54:23 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:27.602 20:54:23 -- json_config/json_config.sh@132 -- # break 00:04:27.602 20:54:23 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:27.602 20:54:23 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:27.602 SPDK target shutdown done 00:04:27.602 20:54:23 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:27.602 INFO: relaunching applications... 00:04:27.602 20:54:23 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.602 20:54:23 -- json_config/json_config.sh@98 -- # local app=target 00:04:27.602 20:54:23 -- json_config/json_config.sh@99 -- # shift 00:04:27.602 20:54:23 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:27.602 20:54:23 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:27.602 20:54:23 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:27.602 20:54:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:27.602 20:54:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:27.602 20:54:23 -- json_config/json_config.sh@111 -- # app_pid[$app]=3860890 00:04:27.602 20:54:23 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.602 20:54:23 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:27.602 Waiting for target to run... 00:04:27.602 20:54:23 -- json_config/json_config.sh@114 -- # waitforlisten 3860890 /var/tmp/spdk_tgt.sock 00:04:27.602 20:54:23 -- common/autotest_common.sh@829 -- # '[' -z 3860890 ']' 00:04:27.602 20:54:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:27.602 20:54:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:27.602 20:54:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:27.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:27.602 20:54:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:27.602 20:54:23 -- common/autotest_common.sh@10 -- # set +x 00:04:27.602 [2024-11-27 20:54:23.614011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:27.602 [2024-11-27 20:54:23.614104] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3860890 ] 00:04:27.602 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.861 [2024-11-27 20:54:23.966983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:27.861 [2024-11-27 20:54:24.053632] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:27.861 [2024-11-27 20:54:24.053820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.144 [2024-11-27 20:54:27.089384] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:31.144 [2024-11-27 20:54:27.121897] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:31.401 20:54:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.401 20:54:27 -- common/autotest_common.sh@862 -- # return 0 00:04:31.401 20:54:27 -- json_config/json_config.sh@115 -- # echo '' 00:04:31.401 00:04:31.401 20:54:27 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:31.401 20:54:27 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:31.401 INFO: Checking if target configuration is the same... 00:04:31.401 20:54:27 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.401 20:54:27 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:31.401 20:54:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:31.401 + '[' 2 -ne 2 ']' 00:04:31.401 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:31.401 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:31.401 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:31.401 +++ basename /dev/fd/62 00:04:31.401 ++ mktemp /tmp/62.XXX 00:04:31.401 + tmp_file_1=/tmp/62.0Tt 00:04:31.401 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.401 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:31.401 + tmp_file_2=/tmp/spdk_tgt_config.json.Gfo 00:04:31.401 + ret=0 00:04:31.401 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:31.967 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:31.967 + diff -u /tmp/62.0Tt /tmp/spdk_tgt_config.json.Gfo 00:04:31.967 + echo 'INFO: JSON config files are the same' 00:04:31.967 INFO: JSON config files are the same 00:04:31.967 + rm /tmp/62.0Tt /tmp/spdk_tgt_config.json.Gfo 00:04:31.967 + exit 0 00:04:31.967 20:54:28 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:31.967 20:54:28 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:31.967 INFO: changing configuration and checking if this can be detected... 00:04:31.967 20:54:28 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:31.967 20:54:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:32.225 20:54:28 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.225 20:54:28 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:32.225 20:54:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:32.225 + '[' 2 -ne 2 ']' 00:04:32.225 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:32.225 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:32.225 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:32.225 +++ basename /dev/fd/62 00:04:32.225 ++ mktemp /tmp/62.XXX 00:04:32.225 + tmp_file_1=/tmp/62.6Xb 00:04:32.225 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:32.225 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:32.225 + tmp_file_2=/tmp/spdk_tgt_config.json.9Ar 00:04:32.225 + ret=0 00:04:32.225 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.482 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:32.740 + diff -u /tmp/62.6Xb /tmp/spdk_tgt_config.json.9Ar 00:04:32.740 + ret=1 00:04:32.740 + echo '=== Start of file: /tmp/62.6Xb ===' 00:04:32.740 + cat /tmp/62.6Xb 00:04:32.740 + echo '=== End of file: /tmp/62.6Xb ===' 00:04:32.740 + echo '' 00:04:32.740 + echo '=== Start of file: /tmp/spdk_tgt_config.json.9Ar ===' 00:04:32.740 + cat /tmp/spdk_tgt_config.json.9Ar 00:04:32.740 + echo '=== End of file: /tmp/spdk_tgt_config.json.9Ar ===' 00:04:32.740 + echo '' 00:04:32.740 + rm /tmp/62.6Xb /tmp/spdk_tgt_config.json.9Ar 00:04:32.740 + exit 1 00:04:32.740 20:54:28 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:32.740 INFO: configuration change detected. 00:04:32.740 20:54:28 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:32.740 20:54:28 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:32.740 20:54:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.740 20:54:28 -- common/autotest_common.sh@10 -- # set +x 00:04:32.740 20:54:28 -- json_config/json_config.sh@360 -- # local ret=0 00:04:32.740 20:54:28 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:32.740 20:54:28 -- json_config/json_config.sh@370 -- # [[ -n 3860890 ]] 00:04:32.740 20:54:28 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:32.740 20:54:28 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:32.740 20:54:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.740 20:54:28 -- common/autotest_common.sh@10 -- # set +x 00:04:32.740 20:54:28 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:32.740 20:54:28 -- json_config/json_config.sh@246 -- # uname -s 00:04:32.740 20:54:28 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:32.740 20:54:28 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:32.740 20:54:28 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:32.740 20:54:28 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:32.740 20:54:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:32.740 20:54:28 -- common/autotest_common.sh@10 -- # set +x 00:04:32.740 20:54:28 -- json_config/json_config.sh@376 -- # killprocess 3860890 00:04:32.740 20:54:28 -- common/autotest_common.sh@936 -- # '[' -z 3860890 ']' 00:04:32.740 20:54:28 -- common/autotest_common.sh@940 -- # kill -0 3860890 00:04:32.740 20:54:28 -- common/autotest_common.sh@941 -- # uname 00:04:32.740 20:54:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:32.741 20:54:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3860890 00:04:32.741 20:54:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:32.741 20:54:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:32.741 20:54:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3860890' 00:04:32.741 killing process with pid 3860890 00:04:32.741 20:54:28 -- common/autotest_common.sh@955 -- # kill 3860890 00:04:32.741 20:54:28 -- common/autotest_common.sh@960 -- # wait 3860890 00:04:34.638 20:54:30 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.638 20:54:30 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:34.638 20:54:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:34.638 20:54:30 -- common/autotest_common.sh@10 -- # set +x 00:04:34.638 20:54:30 -- json_config/json_config.sh@381 -- # return 0 00:04:34.638 20:54:30 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:34.638 INFO: Success 00:04:34.638 00:04:34.638 real 0m16.510s 00:04:34.638 user 0m19.305s 00:04:34.638 sys 0m1.979s 00:04:34.638 20:54:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.638 20:54:30 -- common/autotest_common.sh@10 -- # set +x 00:04:34.638 ************************************ 00:04:34.638 END TEST json_config 00:04:34.638 ************************************ 00:04:34.638 20:54:30 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:34.638 20:54:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.638 20:54:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.638 20:54:30 -- common/autotest_common.sh@10 -- # set +x 00:04:34.638 ************************************ 00:04:34.638 START TEST json_config_extra_key 00:04:34.638 ************************************ 00:04:34.638 20:54:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:34.638 20:54:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.638 20:54:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.638 20:54:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.638 20:54:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.638 20:54:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.639 20:54:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.639 20:54:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.639 20:54:30 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.639 20:54:30 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.639 20:54:30 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.639 20:54:30 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.639 20:54:30 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.639 20:54:30 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.639 20:54:30 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.639 20:54:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.639 20:54:30 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.639 20:54:30 -- scripts/common.sh@344 -- # : 1 00:04:34.639 20:54:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.639 20:54:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.639 20:54:30 -- scripts/common.sh@364 -- # decimal 1 00:04:34.639 20:54:30 -- scripts/common.sh@352 -- # local d=1 00:04:34.639 20:54:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.639 20:54:30 -- scripts/common.sh@354 -- # echo 1 00:04:34.639 20:54:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.639 20:54:30 -- scripts/common.sh@365 -- # decimal 2 00:04:34.639 20:54:30 -- scripts/common.sh@352 -- # local d=2 00:04:34.639 20:54:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.639 20:54:30 -- scripts/common.sh@354 -- # echo 2 00:04:34.639 20:54:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.639 20:54:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.639 20:54:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.639 20:54:30 -- scripts/common.sh@367 -- # return 0 00:04:34.639 20:54:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.639 20:54:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.639 --rc genhtml_branch_coverage=1 00:04:34.639 --rc genhtml_function_coverage=1 00:04:34.639 --rc genhtml_legend=1 00:04:34.639 --rc geninfo_all_blocks=1 00:04:34.639 --rc geninfo_unexecuted_blocks=1 00:04:34.639 00:04:34.639 ' 00:04:34.639 20:54:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.639 --rc genhtml_branch_coverage=1 00:04:34.639 --rc genhtml_function_coverage=1 00:04:34.639 --rc genhtml_legend=1 00:04:34.639 --rc geninfo_all_blocks=1 00:04:34.639 --rc geninfo_unexecuted_blocks=1 00:04:34.639 00:04:34.639 ' 00:04:34.639 20:54:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.639 --rc genhtml_branch_coverage=1 00:04:34.639 --rc genhtml_function_coverage=1 00:04:34.639 --rc genhtml_legend=1 00:04:34.639 --rc geninfo_all_blocks=1 00:04:34.639 --rc geninfo_unexecuted_blocks=1 00:04:34.639 00:04:34.639 ' 00:04:34.639 20:54:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.639 --rc genhtml_branch_coverage=1 00:04:34.639 --rc genhtml_function_coverage=1 00:04:34.639 --rc genhtml_legend=1 00:04:34.639 --rc geninfo_all_blocks=1 00:04:34.639 --rc geninfo_unexecuted_blocks=1 00:04:34.639 00:04:34.639 ' 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:34.639 20:54:30 -- nvmf/common.sh@7 -- # uname -s 00:04:34.639 20:54:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:34.639 20:54:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:34.639 20:54:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:34.639 20:54:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:34.639 20:54:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:34.639 20:54:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:34.639 20:54:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:34.639 20:54:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:34.639 20:54:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:34.639 20:54:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:34.639 20:54:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:34.639 20:54:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:34.639 20:54:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:34.639 20:54:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:34.639 20:54:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:34.639 20:54:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:34.639 20:54:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:34.639 20:54:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:34.639 20:54:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:34.639 20:54:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.639 20:54:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.639 20:54:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.639 20:54:30 -- paths/export.sh@5 -- # export PATH 00:04:34.639 20:54:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.639 20:54:30 -- nvmf/common.sh@46 -- # : 0 00:04:34.639 20:54:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:34.639 20:54:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:34.639 20:54:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:34.639 20:54:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:34.639 20:54:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:34.639 20:54:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:34.639 20:54:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:34.639 20:54:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:34.639 INFO: launching applications... 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3861848 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:34.639 Waiting for target to run... 00:04:34.639 20:54:30 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3861848 /var/tmp/spdk_tgt.sock 00:04:34.639 20:54:30 -- common/autotest_common.sh@829 -- # '[' -z 3861848 ']' 00:04:34.639 20:54:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:34.639 20:54:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.639 20:54:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:34.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:34.639 20:54:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.639 20:54:30 -- common/autotest_common.sh@10 -- # set +x 00:04:34.639 [2024-11-27 20:54:30.687558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.639 [2024-11-27 20:54:30.687643] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3861848 ] 00:04:34.639 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.205 [2024-11-27 20:54:31.179395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.205 [2024-11-27 20:54:31.284258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.205 [2024-11-27 20:54:31.284478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.463 20:54:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.463 20:54:31 -- common/autotest_common.sh@862 -- # return 0 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:35.463 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:35.463 INFO: shutting down applications... 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3861848 ]] 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3861848 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3861848 00:04:35.463 20:54:31 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:36.030 20:54:32 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:36.030 20:54:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:36.030 20:54:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3861848 00:04:36.030 20:54:32 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3861848 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:36.597 SPDK target shutdown done 00:04:36.597 20:54:32 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:36.597 Success 00:04:36.597 00:04:36.597 real 0m2.140s 00:04:36.597 user 0m1.501s 00:04:36.597 sys 0m0.613s 00:04:36.597 20:54:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.597 20:54:32 -- common/autotest_common.sh@10 -- # set +x 00:04:36.597 ************************************ 00:04:36.597 END TEST json_config_extra_key 00:04:36.597 ************************************ 00:04:36.597 20:54:32 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:36.597 20:54:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.597 20:54:32 -- common/autotest_common.sh@10 -- # set +x 00:04:36.597 ************************************ 00:04:36.597 START TEST alias_rpc 00:04:36.597 ************************************ 00:04:36.597 20:54:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:36.597 * Looking for test storage... 00:04:36.597 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:36.597 20:54:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:36.597 20:54:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:36.597 20:54:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:36.597 20:54:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:36.597 20:54:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:36.597 20:54:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:36.597 20:54:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:36.597 20:54:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:36.597 20:54:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:36.597 20:54:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:36.597 20:54:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:36.597 20:54:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:36.597 20:54:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:36.597 20:54:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:36.597 20:54:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:36.597 20:54:32 -- scripts/common.sh@344 -- # : 1 00:04:36.597 20:54:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:36.597 20:54:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:36.597 20:54:32 -- scripts/common.sh@364 -- # decimal 1 00:04:36.597 20:54:32 -- scripts/common.sh@352 -- # local d=1 00:04:36.597 20:54:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:36.597 20:54:32 -- scripts/common.sh@354 -- # echo 1 00:04:36.597 20:54:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:36.597 20:54:32 -- scripts/common.sh@365 -- # decimal 2 00:04:36.597 20:54:32 -- scripts/common.sh@352 -- # local d=2 00:04:36.597 20:54:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:36.597 20:54:32 -- scripts/common.sh@354 -- # echo 2 00:04:36.597 20:54:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:36.597 20:54:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:36.597 20:54:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:36.597 20:54:32 -- scripts/common.sh@367 -- # return 0 00:04:36.597 20:54:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:36.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.597 --rc genhtml_branch_coverage=1 00:04:36.597 --rc genhtml_function_coverage=1 00:04:36.597 --rc genhtml_legend=1 00:04:36.597 --rc geninfo_all_blocks=1 00:04:36.597 --rc geninfo_unexecuted_blocks=1 00:04:36.597 00:04:36.597 ' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:36.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.597 --rc genhtml_branch_coverage=1 00:04:36.597 --rc genhtml_function_coverage=1 00:04:36.597 --rc genhtml_legend=1 00:04:36.597 --rc geninfo_all_blocks=1 00:04:36.597 --rc geninfo_unexecuted_blocks=1 00:04:36.597 00:04:36.597 ' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:36.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.597 --rc genhtml_branch_coverage=1 00:04:36.597 --rc genhtml_function_coverage=1 00:04:36.597 --rc genhtml_legend=1 00:04:36.597 --rc geninfo_all_blocks=1 00:04:36.597 --rc geninfo_unexecuted_blocks=1 00:04:36.597 00:04:36.597 ' 00:04:36.597 20:54:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:36.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.597 --rc genhtml_branch_coverage=1 00:04:36.597 --rc genhtml_function_coverage=1 00:04:36.597 --rc genhtml_legend=1 00:04:36.597 --rc geninfo_all_blocks=1 00:04:36.597 --rc geninfo_unexecuted_blocks=1 00:04:36.597 00:04:36.597 ' 00:04:36.597 20:54:32 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:36.597 20:54:32 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3862174 00:04:36.597 20:54:32 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:36.597 20:54:32 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3862174 00:04:36.597 20:54:32 -- common/autotest_common.sh@829 -- # '[' -z 3862174 ']' 00:04:36.597 20:54:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:36.597 20:54:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:36.598 20:54:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:36.598 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:36.598 20:54:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:36.598 20:54:32 -- common/autotest_common.sh@10 -- # set +x 00:04:36.856 [2024-11-27 20:54:32.852560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.856 [2024-11-27 20:54:32.852670] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3862174 ] 00:04:36.856 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.856 [2024-11-27 20:54:32.913600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.856 [2024-11-27 20:54:33.032210] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.856 [2024-11-27 20:54:33.032408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.789 20:54:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:37.789 20:54:33 -- common/autotest_common.sh@862 -- # return 0 00:04:37.789 20:54:33 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:38.071 20:54:34 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3862174 00:04:38.071 20:54:34 -- common/autotest_common.sh@936 -- # '[' -z 3862174 ']' 00:04:38.071 20:54:34 -- common/autotest_common.sh@940 -- # kill -0 3862174 00:04:38.071 20:54:34 -- common/autotest_common.sh@941 -- # uname 00:04:38.071 20:54:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.071 20:54:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3862174 00:04:38.071 20:54:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.071 20:54:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.071 20:54:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3862174' 00:04:38.071 killing process with pid 3862174 00:04:38.071 20:54:34 -- common/autotest_common.sh@955 -- # kill 3862174 00:04:38.071 20:54:34 -- common/autotest_common.sh@960 -- # wait 3862174 00:04:38.638 00:04:38.638 real 0m1.956s 00:04:38.638 user 0m2.263s 00:04:38.638 sys 0m0.507s 00:04:38.638 20:54:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.638 20:54:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.638 ************************************ 00:04:38.638 END TEST alias_rpc 00:04:38.638 ************************************ 00:04:38.638 20:54:34 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:38.638 20:54:34 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:38.638 20:54:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.638 20:54:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.638 20:54:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.638 ************************************ 00:04:38.638 START TEST spdkcli_tcp 00:04:38.638 ************************************ 00:04:38.638 20:54:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:38.638 * Looking for test storage... 00:04:38.638 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:38.638 20:54:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.638 20:54:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.638 20:54:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.638 20:54:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.638 20:54:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.638 20:54:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.638 20:54:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.638 20:54:34 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.638 20:54:34 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.638 20:54:34 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.638 20:54:34 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.638 20:54:34 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.638 20:54:34 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.638 20:54:34 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.638 20:54:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.638 20:54:34 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.638 20:54:34 -- scripts/common.sh@344 -- # : 1 00:04:38.638 20:54:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.638 20:54:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.638 20:54:34 -- scripts/common.sh@364 -- # decimal 1 00:04:38.638 20:54:34 -- scripts/common.sh@352 -- # local d=1 00:04:38.638 20:54:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.638 20:54:34 -- scripts/common.sh@354 -- # echo 1 00:04:38.638 20:54:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.639 20:54:34 -- scripts/common.sh@365 -- # decimal 2 00:04:38.639 20:54:34 -- scripts/common.sh@352 -- # local d=2 00:04:38.639 20:54:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.639 20:54:34 -- scripts/common.sh@354 -- # echo 2 00:04:38.639 20:54:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.639 20:54:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.639 20:54:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.639 20:54:34 -- scripts/common.sh@367 -- # return 0 00:04:38.639 20:54:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.639 20:54:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.639 --rc genhtml_branch_coverage=1 00:04:38.639 --rc genhtml_function_coverage=1 00:04:38.639 --rc genhtml_legend=1 00:04:38.639 --rc geninfo_all_blocks=1 00:04:38.639 --rc geninfo_unexecuted_blocks=1 00:04:38.639 00:04:38.639 ' 00:04:38.639 20:54:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.639 --rc genhtml_branch_coverage=1 00:04:38.639 --rc genhtml_function_coverage=1 00:04:38.639 --rc genhtml_legend=1 00:04:38.639 --rc geninfo_all_blocks=1 00:04:38.639 --rc geninfo_unexecuted_blocks=1 00:04:38.639 00:04:38.639 ' 00:04:38.639 20:54:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.639 --rc genhtml_branch_coverage=1 00:04:38.639 --rc genhtml_function_coverage=1 00:04:38.639 --rc genhtml_legend=1 00:04:38.639 --rc geninfo_all_blocks=1 00:04:38.639 --rc geninfo_unexecuted_blocks=1 00:04:38.639 00:04:38.639 ' 00:04:38.639 20:54:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.639 --rc genhtml_branch_coverage=1 00:04:38.639 --rc genhtml_function_coverage=1 00:04:38.639 --rc genhtml_legend=1 00:04:38.639 --rc geninfo_all_blocks=1 00:04:38.639 --rc geninfo_unexecuted_blocks=1 00:04:38.639 00:04:38.639 ' 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:38.639 20:54:34 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:38.639 20:54:34 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:38.639 20:54:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:38.639 20:54:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3862499 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:38.639 20:54:34 -- spdkcli/tcp.sh@27 -- # waitforlisten 3862499 00:04:38.639 20:54:34 -- common/autotest_common.sh@829 -- # '[' -z 3862499 ']' 00:04:38.639 20:54:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:38.639 20:54:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.639 20:54:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:38.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:38.639 20:54:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.639 20:54:34 -- common/autotest_common.sh@10 -- # set +x 00:04:38.639 [2024-11-27 20:54:34.847473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.639 [2024-11-27 20:54:34.847576] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3862499 ] 00:04:38.639 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.898 [2024-11-27 20:54:34.907000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:38.898 [2024-11-27 20:54:35.026271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.898 [2024-11-27 20:54:35.026522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:38.898 [2024-11-27 20:54:35.026548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.857 20:54:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.857 20:54:35 -- common/autotest_common.sh@862 -- # return 0 00:04:39.857 20:54:35 -- spdkcli/tcp.sh@31 -- # socat_pid=3862640 00:04:39.857 20:54:35 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:39.857 20:54:35 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:39.857 [ 00:04:39.857 "bdev_malloc_delete", 00:04:39.857 "bdev_malloc_create", 00:04:39.857 "bdev_null_resize", 00:04:39.857 "bdev_null_delete", 00:04:39.857 "bdev_null_create", 00:04:39.857 "bdev_nvme_cuse_unregister", 00:04:39.857 "bdev_nvme_cuse_register", 00:04:39.857 "bdev_opal_new_user", 00:04:39.857 "bdev_opal_set_lock_state", 00:04:39.857 "bdev_opal_delete", 00:04:39.857 "bdev_opal_get_info", 00:04:39.857 "bdev_opal_create", 00:04:39.857 "bdev_nvme_opal_revert", 00:04:39.857 "bdev_nvme_opal_init", 00:04:39.857 "bdev_nvme_send_cmd", 00:04:39.857 "bdev_nvme_get_path_iostat", 00:04:39.857 "bdev_nvme_get_mdns_discovery_info", 00:04:39.857 "bdev_nvme_stop_mdns_discovery", 00:04:39.857 "bdev_nvme_start_mdns_discovery", 00:04:39.857 "bdev_nvme_set_multipath_policy", 00:04:39.857 "bdev_nvme_set_preferred_path", 00:04:39.857 "bdev_nvme_get_io_paths", 00:04:39.857 "bdev_nvme_remove_error_injection", 00:04:39.857 "bdev_nvme_add_error_injection", 00:04:39.857 "bdev_nvme_get_discovery_info", 00:04:39.857 "bdev_nvme_stop_discovery", 00:04:39.857 "bdev_nvme_start_discovery", 00:04:39.857 "bdev_nvme_get_controller_health_info", 00:04:39.857 "bdev_nvme_disable_controller", 00:04:39.857 "bdev_nvme_enable_controller", 00:04:39.857 "bdev_nvme_reset_controller", 00:04:39.857 "bdev_nvme_get_transport_statistics", 00:04:39.857 "bdev_nvme_apply_firmware", 00:04:39.857 "bdev_nvme_detach_controller", 00:04:39.857 "bdev_nvme_get_controllers", 00:04:39.857 "bdev_nvme_attach_controller", 00:04:39.857 "bdev_nvme_set_hotplug", 00:04:39.857 "bdev_nvme_set_options", 00:04:39.857 "bdev_passthru_delete", 00:04:39.857 "bdev_passthru_create", 00:04:39.857 "bdev_lvol_grow_lvstore", 00:04:39.857 "bdev_lvol_get_lvols", 00:04:39.857 "bdev_lvol_get_lvstores", 00:04:39.857 "bdev_lvol_delete", 00:04:39.857 "bdev_lvol_set_read_only", 00:04:39.857 "bdev_lvol_resize", 00:04:39.857 "bdev_lvol_decouple_parent", 00:04:39.857 "bdev_lvol_inflate", 00:04:39.857 "bdev_lvol_rename", 00:04:39.857 "bdev_lvol_clone_bdev", 00:04:39.857 "bdev_lvol_clone", 00:04:39.857 "bdev_lvol_snapshot", 00:04:39.857 "bdev_lvol_create", 00:04:39.857 "bdev_lvol_delete_lvstore", 00:04:39.857 "bdev_lvol_rename_lvstore", 00:04:39.857 "bdev_lvol_create_lvstore", 00:04:39.857 "bdev_raid_set_options", 00:04:39.857 "bdev_raid_remove_base_bdev", 00:04:39.857 "bdev_raid_add_base_bdev", 00:04:39.857 "bdev_raid_delete", 00:04:39.857 "bdev_raid_create", 00:04:39.857 "bdev_raid_get_bdevs", 00:04:39.857 "bdev_error_inject_error", 00:04:39.857 "bdev_error_delete", 00:04:39.857 "bdev_error_create", 00:04:39.857 "bdev_split_delete", 00:04:39.857 "bdev_split_create", 00:04:39.857 "bdev_delay_delete", 00:04:39.857 "bdev_delay_create", 00:04:39.857 "bdev_delay_update_latency", 00:04:39.857 "bdev_zone_block_delete", 00:04:39.857 "bdev_zone_block_create", 00:04:39.857 "blobfs_create", 00:04:39.857 "blobfs_detect", 00:04:39.857 "blobfs_set_cache_size", 00:04:39.857 "bdev_aio_delete", 00:04:39.857 "bdev_aio_rescan", 00:04:39.857 "bdev_aio_create", 00:04:39.857 "bdev_ftl_set_property", 00:04:39.857 "bdev_ftl_get_properties", 00:04:39.857 "bdev_ftl_get_stats", 00:04:39.857 "bdev_ftl_unmap", 00:04:39.857 "bdev_ftl_unload", 00:04:39.857 "bdev_ftl_delete", 00:04:39.857 "bdev_ftl_load", 00:04:39.857 "bdev_ftl_create", 00:04:39.857 "bdev_virtio_attach_controller", 00:04:39.857 "bdev_virtio_scsi_get_devices", 00:04:39.857 "bdev_virtio_detach_controller", 00:04:39.857 "bdev_virtio_blk_set_hotplug", 00:04:39.857 "bdev_iscsi_delete", 00:04:39.857 "bdev_iscsi_create", 00:04:39.857 "bdev_iscsi_set_options", 00:04:39.857 "accel_error_inject_error", 00:04:39.857 "ioat_scan_accel_module", 00:04:39.857 "dsa_scan_accel_module", 00:04:39.857 "iaa_scan_accel_module", 00:04:39.857 "iscsi_set_options", 00:04:39.857 "iscsi_get_auth_groups", 00:04:39.857 "iscsi_auth_group_remove_secret", 00:04:39.857 "iscsi_auth_group_add_secret", 00:04:39.857 "iscsi_delete_auth_group", 00:04:39.857 "iscsi_create_auth_group", 00:04:39.857 "iscsi_set_discovery_auth", 00:04:39.857 "iscsi_get_options", 00:04:39.857 "iscsi_target_node_request_logout", 00:04:39.857 "iscsi_target_node_set_redirect", 00:04:39.857 "iscsi_target_node_set_auth", 00:04:39.857 "iscsi_target_node_add_lun", 00:04:39.857 "iscsi_get_connections", 00:04:39.857 "iscsi_portal_group_set_auth", 00:04:39.857 "iscsi_start_portal_group", 00:04:39.857 "iscsi_delete_portal_group", 00:04:39.857 "iscsi_create_portal_group", 00:04:39.857 "iscsi_get_portal_groups", 00:04:39.857 "iscsi_delete_target_node", 00:04:39.857 "iscsi_target_node_remove_pg_ig_maps", 00:04:39.857 "iscsi_target_node_add_pg_ig_maps", 00:04:39.857 "iscsi_create_target_node", 00:04:39.857 "iscsi_get_target_nodes", 00:04:39.857 "iscsi_delete_initiator_group", 00:04:39.857 "iscsi_initiator_group_remove_initiators", 00:04:39.857 "iscsi_initiator_group_add_initiators", 00:04:39.857 "iscsi_create_initiator_group", 00:04:39.857 "iscsi_get_initiator_groups", 00:04:39.857 "nvmf_set_crdt", 00:04:39.857 "nvmf_set_config", 00:04:39.857 "nvmf_set_max_subsystems", 00:04:39.857 "nvmf_subsystem_get_listeners", 00:04:39.857 "nvmf_subsystem_get_qpairs", 00:04:39.857 "nvmf_subsystem_get_controllers", 00:04:39.857 "nvmf_get_stats", 00:04:39.857 "nvmf_get_transports", 00:04:39.857 "nvmf_create_transport", 00:04:39.857 "nvmf_get_targets", 00:04:39.857 "nvmf_delete_target", 00:04:39.857 "nvmf_create_target", 00:04:39.857 "nvmf_subsystem_allow_any_host", 00:04:39.857 "nvmf_subsystem_remove_host", 00:04:39.857 "nvmf_subsystem_add_host", 00:04:39.857 "nvmf_subsystem_remove_ns", 00:04:39.857 "nvmf_subsystem_add_ns", 00:04:39.857 "nvmf_subsystem_listener_set_ana_state", 00:04:39.857 "nvmf_discovery_get_referrals", 00:04:39.857 "nvmf_discovery_remove_referral", 00:04:39.857 "nvmf_discovery_add_referral", 00:04:39.857 "nvmf_subsystem_remove_listener", 00:04:39.857 "nvmf_subsystem_add_listener", 00:04:39.857 "nvmf_delete_subsystem", 00:04:39.857 "nvmf_create_subsystem", 00:04:39.857 "nvmf_get_subsystems", 00:04:39.857 "env_dpdk_get_mem_stats", 00:04:39.857 "nbd_get_disks", 00:04:39.857 "nbd_stop_disk", 00:04:39.857 "nbd_start_disk", 00:04:39.857 "ublk_recover_disk", 00:04:39.857 "ublk_get_disks", 00:04:39.857 "ublk_stop_disk", 00:04:39.857 "ublk_start_disk", 00:04:39.857 "ublk_destroy_target", 00:04:39.857 "ublk_create_target", 00:04:39.857 "virtio_blk_create_transport", 00:04:39.857 "virtio_blk_get_transports", 00:04:39.857 "vhost_controller_set_coalescing", 00:04:39.857 "vhost_get_controllers", 00:04:39.857 "vhost_delete_controller", 00:04:39.857 "vhost_create_blk_controller", 00:04:39.857 "vhost_scsi_controller_remove_target", 00:04:39.857 "vhost_scsi_controller_add_target", 00:04:39.857 "vhost_start_scsi_controller", 00:04:39.857 "vhost_create_scsi_controller", 00:04:39.857 "thread_set_cpumask", 00:04:39.857 "framework_get_scheduler", 00:04:39.857 "framework_set_scheduler", 00:04:39.857 "framework_get_reactors", 00:04:39.857 "thread_get_io_channels", 00:04:39.857 "thread_get_pollers", 00:04:39.857 "thread_get_stats", 00:04:39.857 "framework_monitor_context_switch", 00:04:39.857 "spdk_kill_instance", 00:04:39.857 "log_enable_timestamps", 00:04:39.857 "log_get_flags", 00:04:39.857 "log_clear_flag", 00:04:39.857 "log_set_flag", 00:04:39.857 "log_get_level", 00:04:39.857 "log_set_level", 00:04:39.857 "log_get_print_level", 00:04:39.857 "log_set_print_level", 00:04:39.857 "framework_enable_cpumask_locks", 00:04:39.857 "framework_disable_cpumask_locks", 00:04:39.857 "framework_wait_init", 00:04:39.857 "framework_start_init", 00:04:39.857 "scsi_get_devices", 00:04:39.857 "bdev_get_histogram", 00:04:39.857 "bdev_enable_histogram", 00:04:39.857 "bdev_set_qos_limit", 00:04:39.857 "bdev_set_qd_sampling_period", 00:04:39.857 "bdev_get_bdevs", 00:04:39.857 "bdev_reset_iostat", 00:04:39.857 "bdev_get_iostat", 00:04:39.858 "bdev_examine", 00:04:39.858 "bdev_wait_for_examine", 00:04:39.858 "bdev_set_options", 00:04:39.858 "notify_get_notifications", 00:04:39.858 "notify_get_types", 00:04:39.858 "accel_get_stats", 00:04:39.858 "accel_set_options", 00:04:39.858 "accel_set_driver", 00:04:39.858 "accel_crypto_key_destroy", 00:04:39.858 "accel_crypto_keys_get", 00:04:39.858 "accel_crypto_key_create", 00:04:39.858 "accel_assign_opc", 00:04:39.858 "accel_get_module_info", 00:04:39.858 "accel_get_opc_assignments", 00:04:39.858 "vmd_rescan", 00:04:39.858 "vmd_remove_device", 00:04:39.858 "vmd_enable", 00:04:39.858 "sock_set_default_impl", 00:04:39.858 "sock_impl_set_options", 00:04:39.858 "sock_impl_get_options", 00:04:39.858 "iobuf_get_stats", 00:04:39.858 "iobuf_set_options", 00:04:39.858 "framework_get_pci_devices", 00:04:39.858 "framework_get_config", 00:04:39.858 "framework_get_subsystems", 00:04:39.858 "trace_get_info", 00:04:39.858 "trace_get_tpoint_group_mask", 00:04:39.858 "trace_disable_tpoint_group", 00:04:39.858 "trace_enable_tpoint_group", 00:04:39.858 "trace_clear_tpoint_mask", 00:04:39.858 "trace_set_tpoint_mask", 00:04:39.858 "spdk_get_version", 00:04:39.858 "rpc_get_methods" 00:04:39.858 ] 00:04:39.858 20:54:36 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:39.858 20:54:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:39.858 20:54:36 -- common/autotest_common.sh@10 -- # set +x 00:04:39.858 20:54:36 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:39.858 20:54:36 -- spdkcli/tcp.sh@38 -- # killprocess 3862499 00:04:39.858 20:54:36 -- common/autotest_common.sh@936 -- # '[' -z 3862499 ']' 00:04:39.858 20:54:36 -- common/autotest_common.sh@940 -- # kill -0 3862499 00:04:39.858 20:54:36 -- common/autotest_common.sh@941 -- # uname 00:04:39.858 20:54:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.858 20:54:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3862499 00:04:40.115 20:54:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.116 20:54:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.116 20:54:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3862499' 00:04:40.116 killing process with pid 3862499 00:04:40.116 20:54:36 -- common/autotest_common.sh@955 -- # kill 3862499 00:04:40.116 20:54:36 -- common/autotest_common.sh@960 -- # wait 3862499 00:04:40.374 00:04:40.374 real 0m1.900s 00:04:40.374 user 0m3.552s 00:04:40.374 sys 0m0.518s 00:04:40.374 20:54:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.374 20:54:36 -- common/autotest_common.sh@10 -- # set +x 00:04:40.374 ************************************ 00:04:40.374 END TEST spdkcli_tcp 00:04:40.374 ************************************ 00:04:40.374 20:54:36 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:40.374 20:54:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.374 20:54:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.374 20:54:36 -- common/autotest_common.sh@10 -- # set +x 00:04:40.374 ************************************ 00:04:40.374 START TEST dpdk_mem_utility 00:04:40.374 ************************************ 00:04:40.374 20:54:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:40.633 * Looking for test storage... 00:04:40.633 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:40.633 20:54:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.633 20:54:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.633 20:54:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.633 20:54:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.633 20:54:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.633 20:54:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.633 20:54:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.633 20:54:36 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.633 20:54:36 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.633 20:54:36 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.633 20:54:36 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.633 20:54:36 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.633 20:54:36 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.633 20:54:36 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.633 20:54:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.633 20:54:36 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.633 20:54:36 -- scripts/common.sh@344 -- # : 1 00:04:40.633 20:54:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.633 20:54:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.633 20:54:36 -- scripts/common.sh@364 -- # decimal 1 00:04:40.633 20:54:36 -- scripts/common.sh@352 -- # local d=1 00:04:40.633 20:54:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.633 20:54:36 -- scripts/common.sh@354 -- # echo 1 00:04:40.633 20:54:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.633 20:54:36 -- scripts/common.sh@365 -- # decimal 2 00:04:40.633 20:54:36 -- scripts/common.sh@352 -- # local d=2 00:04:40.633 20:54:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.633 20:54:36 -- scripts/common.sh@354 -- # echo 2 00:04:40.633 20:54:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.633 20:54:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.633 20:54:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.633 20:54:36 -- scripts/common.sh@367 -- # return 0 00:04:40.633 20:54:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.633 20:54:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.634 --rc genhtml_branch_coverage=1 00:04:40.634 --rc genhtml_function_coverage=1 00:04:40.634 --rc genhtml_legend=1 00:04:40.634 --rc geninfo_all_blocks=1 00:04:40.634 --rc geninfo_unexecuted_blocks=1 00:04:40.634 00:04:40.634 ' 00:04:40.634 20:54:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.634 --rc genhtml_branch_coverage=1 00:04:40.634 --rc genhtml_function_coverage=1 00:04:40.634 --rc genhtml_legend=1 00:04:40.634 --rc geninfo_all_blocks=1 00:04:40.634 --rc geninfo_unexecuted_blocks=1 00:04:40.634 00:04:40.634 ' 00:04:40.634 20:54:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.634 --rc genhtml_branch_coverage=1 00:04:40.634 --rc genhtml_function_coverage=1 00:04:40.634 --rc genhtml_legend=1 00:04:40.634 --rc geninfo_all_blocks=1 00:04:40.634 --rc geninfo_unexecuted_blocks=1 00:04:40.634 00:04:40.634 ' 00:04:40.634 20:54:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.634 --rc genhtml_branch_coverage=1 00:04:40.634 --rc genhtml_function_coverage=1 00:04:40.634 --rc genhtml_legend=1 00:04:40.634 --rc geninfo_all_blocks=1 00:04:40.634 --rc geninfo_unexecuted_blocks=1 00:04:40.634 00:04:40.634 ' 00:04:40.634 20:54:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:40.634 20:54:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3862828 00:04:40.634 20:54:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:40.634 20:54:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3862828 00:04:40.634 20:54:36 -- common/autotest_common.sh@829 -- # '[' -z 3862828 ']' 00:04:40.634 20:54:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.634 20:54:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.634 20:54:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.634 20:54:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.634 20:54:36 -- common/autotest_common.sh@10 -- # set +x 00:04:40.634 [2024-11-27 20:54:36.769290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.634 [2024-11-27 20:54:36.769373] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3862828 ] 00:04:40.634 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.634 [2024-11-27 20:54:36.825329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.892 [2024-11-27 20:54:36.933351] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.892 [2024-11-27 20:54:36.933558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.826 20:54:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:41.826 20:54:37 -- common/autotest_common.sh@862 -- # return 0 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:41.826 20:54:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.826 20:54:37 -- common/autotest_common.sh@10 -- # set +x 00:04:41.826 { 00:04:41.826 "filename": "/tmp/spdk_mem_dump.txt" 00:04:41.826 } 00:04:41.826 20:54:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:41.826 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:41.826 1 heaps totaling size 814.000000 MiB 00:04:41.826 size: 814.000000 MiB heap id: 0 00:04:41.826 end heaps---------- 00:04:41.826 8 mempools totaling size 598.116089 MiB 00:04:41.826 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:41.826 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:41.826 size: 84.521057 MiB name: bdev_io_3862828 00:04:41.826 size: 51.011292 MiB name: evtpool_3862828 00:04:41.826 size: 50.003479 MiB name: msgpool_3862828 00:04:41.826 size: 21.763794 MiB name: PDU_Pool 00:04:41.826 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:41.826 size: 0.026123 MiB name: Session_Pool 00:04:41.826 end mempools------- 00:04:41.826 6 memzones totaling size 4.142822 MiB 00:04:41.826 size: 1.000366 MiB name: RG_ring_0_3862828 00:04:41.826 size: 1.000366 MiB name: RG_ring_1_3862828 00:04:41.826 size: 1.000366 MiB name: RG_ring_4_3862828 00:04:41.826 size: 1.000366 MiB name: RG_ring_5_3862828 00:04:41.826 size: 0.125366 MiB name: RG_ring_2_3862828 00:04:41.826 size: 0.015991 MiB name: RG_ring_3_3862828 00:04:41.826 end memzones------- 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:41.826 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:41.826 list of free elements. size: 12.519348 MiB 00:04:41.826 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:41.826 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:41.826 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:41.826 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:41.826 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:41.826 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:41.826 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:41.826 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:41.826 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:41.826 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:41.826 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:41.826 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:41.826 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:41.826 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:41.826 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:41.826 list of standard malloc elements. size: 199.218079 MiB 00:04:41.826 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:41.826 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:41.826 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:41.826 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:41.826 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:41.826 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:41.826 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:41.826 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:41.826 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:41.826 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:41.826 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:41.826 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:41.826 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:41.826 list of memzone associated elements. size: 602.262573 MiB 00:04:41.826 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:41.826 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:41.826 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:41.826 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:41.826 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:41.826 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3862828_0 00:04:41.826 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:41.826 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3862828_0 00:04:41.826 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:41.826 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3862828_0 00:04:41.826 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:41.826 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:41.826 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:41.826 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:41.826 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:41.826 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3862828 00:04:41.826 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:41.826 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3862828 00:04:41.826 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:41.826 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3862828 00:04:41.826 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:41.826 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:41.826 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:41.826 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:41.826 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:41.826 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:41.826 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:41.826 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:41.826 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:41.826 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3862828 00:04:41.826 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:41.826 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3862828 00:04:41.826 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:41.826 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3862828 00:04:41.826 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:41.826 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3862828 00:04:41.826 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:41.826 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3862828 00:04:41.826 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:41.826 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:41.826 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:41.826 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:41.826 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:41.826 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:41.826 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:41.826 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3862828 00:04:41.826 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:41.826 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:41.826 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:41.826 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:41.826 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:41.826 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3862828 00:04:41.826 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:41.826 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:41.826 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:41.826 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3862828 00:04:41.826 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:41.826 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3862828 00:04:41.826 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:41.826 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:41.826 20:54:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3862828 00:04:41.826 20:54:37 -- common/autotest_common.sh@936 -- # '[' -z 3862828 ']' 00:04:41.826 20:54:37 -- common/autotest_common.sh@940 -- # kill -0 3862828 00:04:41.826 20:54:37 -- common/autotest_common.sh@941 -- # uname 00:04:41.826 20:54:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.826 20:54:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3862828 00:04:41.826 20:54:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.826 20:54:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.826 20:54:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3862828' 00:04:41.826 killing process with pid 3862828 00:04:41.826 20:54:37 -- common/autotest_common.sh@955 -- # kill 3862828 00:04:41.826 20:54:37 -- common/autotest_common.sh@960 -- # wait 3862828 00:04:42.392 00:04:42.392 real 0m1.756s 00:04:42.392 user 0m1.911s 00:04:42.392 sys 0m0.478s 00:04:42.392 20:54:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.392 20:54:38 -- common/autotest_common.sh@10 -- # set +x 00:04:42.392 ************************************ 00:04:42.392 END TEST dpdk_mem_utility 00:04:42.392 ************************************ 00:04:42.392 20:54:38 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:42.392 20:54:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.392 20:54:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.392 20:54:38 -- common/autotest_common.sh@10 -- # set +x 00:04:42.392 ************************************ 00:04:42.392 START TEST event 00:04:42.392 ************************************ 00:04:42.392 20:54:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:42.392 * Looking for test storage... 00:04:42.392 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:42.392 20:54:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.392 20:54:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.392 20:54:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.392 20:54:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.392 20:54:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.393 20:54:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.393 20:54:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.393 20:54:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.393 20:54:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.393 20:54:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.393 20:54:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.393 20:54:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.393 20:54:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.393 20:54:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.393 20:54:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.393 20:54:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.393 20:54:38 -- scripts/common.sh@344 -- # : 1 00:04:42.393 20:54:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.393 20:54:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.393 20:54:38 -- scripts/common.sh@364 -- # decimal 1 00:04:42.393 20:54:38 -- scripts/common.sh@352 -- # local d=1 00:04:42.393 20:54:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.393 20:54:38 -- scripts/common.sh@354 -- # echo 1 00:04:42.393 20:54:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.393 20:54:38 -- scripts/common.sh@365 -- # decimal 2 00:04:42.393 20:54:38 -- scripts/common.sh@352 -- # local d=2 00:04:42.393 20:54:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.393 20:54:38 -- scripts/common.sh@354 -- # echo 2 00:04:42.393 20:54:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.393 20:54:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.393 20:54:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.393 20:54:38 -- scripts/common.sh@367 -- # return 0 00:04:42.393 20:54:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.393 20:54:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.393 --rc genhtml_branch_coverage=1 00:04:42.393 --rc genhtml_function_coverage=1 00:04:42.393 --rc genhtml_legend=1 00:04:42.393 --rc geninfo_all_blocks=1 00:04:42.393 --rc geninfo_unexecuted_blocks=1 00:04:42.393 00:04:42.393 ' 00:04:42.393 20:54:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.393 --rc genhtml_branch_coverage=1 00:04:42.393 --rc genhtml_function_coverage=1 00:04:42.393 --rc genhtml_legend=1 00:04:42.393 --rc geninfo_all_blocks=1 00:04:42.393 --rc geninfo_unexecuted_blocks=1 00:04:42.393 00:04:42.393 ' 00:04:42.393 20:54:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.393 --rc genhtml_branch_coverage=1 00:04:42.393 --rc genhtml_function_coverage=1 00:04:42.393 --rc genhtml_legend=1 00:04:42.393 --rc geninfo_all_blocks=1 00:04:42.393 --rc geninfo_unexecuted_blocks=1 00:04:42.393 00:04:42.393 ' 00:04:42.393 20:54:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.393 --rc genhtml_branch_coverage=1 00:04:42.393 --rc genhtml_function_coverage=1 00:04:42.393 --rc genhtml_legend=1 00:04:42.393 --rc geninfo_all_blocks=1 00:04:42.393 --rc geninfo_unexecuted_blocks=1 00:04:42.393 00:04:42.393 ' 00:04:42.393 20:54:38 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:42.393 20:54:38 -- bdev/nbd_common.sh@6 -- # set -e 00:04:42.393 20:54:38 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:42.393 20:54:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:42.393 20:54:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.393 20:54:38 -- common/autotest_common.sh@10 -- # set +x 00:04:42.393 ************************************ 00:04:42.393 START TEST event_perf 00:04:42.393 ************************************ 00:04:42.393 20:54:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:42.393 Running I/O for 1 seconds...[2024-11-27 20:54:38.522090] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.393 [2024-11-27 20:54:38.522162] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3863060 ] 00:04:42.393 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.393 [2024-11-27 20:54:38.578681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:42.652 [2024-11-27 20:54:38.695342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.652 [2024-11-27 20:54:38.695413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:42.652 [2024-11-27 20:54:38.695509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:42.652 [2024-11-27 20:54:38.695512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.586 Running I/O for 1 seconds... 00:04:43.586 lcore 0: 229112 00:04:43.586 lcore 1: 229109 00:04:43.586 lcore 2: 229110 00:04:43.586 lcore 3: 229110 00:04:43.586 done. 00:04:43.586 00:04:43.586 real 0m1.311s 00:04:43.586 user 0m4.221s 00:04:43.586 sys 0m0.085s 00:04:43.586 20:54:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.586 20:54:39 -- common/autotest_common.sh@10 -- # set +x 00:04:43.586 ************************************ 00:04:43.586 END TEST event_perf 00:04:43.586 ************************************ 00:04:43.845 20:54:39 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:43.845 20:54:39 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:43.845 20:54:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.845 20:54:39 -- common/autotest_common.sh@10 -- # set +x 00:04:43.845 ************************************ 00:04:43.845 START TEST event_reactor 00:04:43.845 ************************************ 00:04:43.845 20:54:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:43.845 [2024-11-27 20:54:39.863708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.845 [2024-11-27 20:54:39.863785] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3863219 ] 00:04:43.845 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.845 [2024-11-27 20:54:39.929161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.845 [2024-11-27 20:54:40.049759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.218 test_start 00:04:45.218 oneshot 00:04:45.218 tick 100 00:04:45.218 tick 100 00:04:45.218 tick 250 00:04:45.218 tick 100 00:04:45.218 tick 100 00:04:45.218 tick 100 00:04:45.218 tick 250 00:04:45.218 tick 500 00:04:45.218 tick 100 00:04:45.218 tick 100 00:04:45.218 tick 250 00:04:45.218 tick 100 00:04:45.218 tick 100 00:04:45.218 test_end 00:04:45.218 00:04:45.218 real 0m1.323s 00:04:45.218 user 0m1.234s 00:04:45.218 sys 0m0.083s 00:04:45.218 20:54:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.218 20:54:41 -- common/autotest_common.sh@10 -- # set +x 00:04:45.218 ************************************ 00:04:45.218 END TEST event_reactor 00:04:45.218 ************************************ 00:04:45.218 20:54:41 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:45.218 20:54:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:45.218 20:54:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.218 20:54:41 -- common/autotest_common.sh@10 -- # set +x 00:04:45.218 ************************************ 00:04:45.218 START TEST event_reactor_perf 00:04:45.218 ************************************ 00:04:45.218 20:54:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:45.218 [2024-11-27 20:54:41.213427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.218 [2024-11-27 20:54:41.213506] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3863399 ] 00:04:45.218 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.218 [2024-11-27 20:54:41.279130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.218 [2024-11-27 20:54:41.395008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.590 test_start 00:04:46.590 test_end 00:04:46.590 Performance: 350372 events per second 00:04:46.590 00:04:46.590 real 0m1.317s 00:04:46.590 user 0m1.229s 00:04:46.590 sys 0m0.082s 00:04:46.590 20:54:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.590 20:54:42 -- common/autotest_common.sh@10 -- # set +x 00:04:46.590 ************************************ 00:04:46.590 END TEST event_reactor_perf 00:04:46.590 ************************************ 00:04:46.590 20:54:42 -- event/event.sh@49 -- # uname -s 00:04:46.590 20:54:42 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:46.590 20:54:42 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:46.590 20:54:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.591 20:54:42 -- common/autotest_common.sh@10 -- # set +x 00:04:46.591 ************************************ 00:04:46.591 START TEST event_scheduler 00:04:46.591 ************************************ 00:04:46.591 20:54:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:46.591 * Looking for test storage... 00:04:46.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:46.591 20:54:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:46.591 20:54:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:46.591 20:54:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:46.591 20:54:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:46.591 20:54:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:46.591 20:54:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:46.591 20:54:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:46.591 20:54:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:46.591 20:54:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:46.591 20:54:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:46.591 20:54:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:46.591 20:54:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:46.591 20:54:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:46.591 20:54:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:46.591 20:54:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:46.591 20:54:42 -- scripts/common.sh@344 -- # : 1 00:04:46.591 20:54:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:46.591 20:54:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:46.591 20:54:42 -- scripts/common.sh@364 -- # decimal 1 00:04:46.591 20:54:42 -- scripts/common.sh@352 -- # local d=1 00:04:46.591 20:54:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:46.591 20:54:42 -- scripts/common.sh@354 -- # echo 1 00:04:46.591 20:54:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:46.591 20:54:42 -- scripts/common.sh@365 -- # decimal 2 00:04:46.591 20:54:42 -- scripts/common.sh@352 -- # local d=2 00:04:46.591 20:54:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:46.591 20:54:42 -- scripts/common.sh@354 -- # echo 2 00:04:46.591 20:54:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:46.591 20:54:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:46.591 20:54:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:46.591 20:54:42 -- scripts/common.sh@367 -- # return 0 00:04:46.591 20:54:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:46.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.591 --rc genhtml_branch_coverage=1 00:04:46.591 --rc genhtml_function_coverage=1 00:04:46.591 --rc genhtml_legend=1 00:04:46.591 --rc geninfo_all_blocks=1 00:04:46.591 --rc geninfo_unexecuted_blocks=1 00:04:46.591 00:04:46.591 ' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:46.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.591 --rc genhtml_branch_coverage=1 00:04:46.591 --rc genhtml_function_coverage=1 00:04:46.591 --rc genhtml_legend=1 00:04:46.591 --rc geninfo_all_blocks=1 00:04:46.591 --rc geninfo_unexecuted_blocks=1 00:04:46.591 00:04:46.591 ' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:46.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.591 --rc genhtml_branch_coverage=1 00:04:46.591 --rc genhtml_function_coverage=1 00:04:46.591 --rc genhtml_legend=1 00:04:46.591 --rc geninfo_all_blocks=1 00:04:46.591 --rc geninfo_unexecuted_blocks=1 00:04:46.591 00:04:46.591 ' 00:04:46.591 20:54:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:46.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.591 --rc genhtml_branch_coverage=1 00:04:46.591 --rc genhtml_function_coverage=1 00:04:46.591 --rc genhtml_legend=1 00:04:46.591 --rc geninfo_all_blocks=1 00:04:46.591 --rc geninfo_unexecuted_blocks=1 00:04:46.591 00:04:46.591 ' 00:04:46.591 20:54:42 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:46.591 20:54:42 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3863687 00:04:46.591 20:54:42 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:46.591 20:54:42 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:46.591 20:54:42 -- scheduler/scheduler.sh@37 -- # waitforlisten 3863687 00:04:46.591 20:54:42 -- common/autotest_common.sh@829 -- # '[' -z 3863687 ']' 00:04:46.591 20:54:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.591 20:54:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.591 20:54:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.591 20:54:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.591 20:54:42 -- common/autotest_common.sh@10 -- # set +x 00:04:46.591 [2024-11-27 20:54:42.721641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.591 [2024-11-27 20:54:42.721734] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3863687 ] 00:04:46.591 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.591 [2024-11-27 20:54:42.781969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:46.850 [2024-11-27 20:54:42.900476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.850 [2024-11-27 20:54:42.900539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.850 [2024-11-27 20:54:42.900599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:46.850 [2024-11-27 20:54:42.900602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:46.850 20:54:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.850 20:54:42 -- common/autotest_common.sh@862 -- # return 0 00:04:46.850 20:54:42 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:46.850 20:54:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.850 20:54:42 -- common/autotest_common.sh@10 -- # set +x 00:04:46.850 POWER: Env isn't set yet! 00:04:46.850 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:46.850 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:46.850 POWER: Cannot get available frequencies of lcore 0 00:04:46.850 POWER: Attempting to initialise PSTAT power management... 00:04:46.850 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:46.850 POWER: Initialized successfully for lcore 0 power management 00:04:46.850 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:46.850 POWER: Initialized successfully for lcore 1 power management 00:04:46.850 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:46.850 POWER: Initialized successfully for lcore 2 power management 00:04:46.850 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:46.850 POWER: Initialized successfully for lcore 3 power management 00:04:46.850 [2024-11-27 20:54:43.005740] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:46.851 [2024-11-27 20:54:43.005758] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:46.851 [2024-11-27 20:54:43.005768] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:46.851 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:46.851 20:54:43 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:46.851 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:46.851 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 [2024-11-27 20:54:43.108838] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:47.109 20:54:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.109 20:54:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 ************************************ 00:04:47.109 START TEST scheduler_create_thread 00:04:47.109 ************************************ 00:04:47.109 20:54:43 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 2 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 3 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 4 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 5 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 6 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 7 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 8 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 9 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 10 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 20:54:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:47.109 20:54:43 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:47.109 20:54:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:47.109 20:54:43 -- common/autotest_common.sh@10 -- # set +x 00:04:48.483 20:54:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.483 20:54:44 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:48.483 20:54:44 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:48.483 20:54:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.483 20:54:44 -- common/autotest_common.sh@10 -- # set +x 00:04:49.856 20:54:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.857 00:04:49.857 real 0m2.621s 00:04:49.857 user 0m0.011s 00:04:49.857 sys 0m0.003s 00:04:49.857 20:54:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.857 20:54:45 -- common/autotest_common.sh@10 -- # set +x 00:04:49.857 ************************************ 00:04:49.857 END TEST scheduler_create_thread 00:04:49.857 ************************************ 00:04:49.857 20:54:45 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:49.857 20:54:45 -- scheduler/scheduler.sh@46 -- # killprocess 3863687 00:04:49.857 20:54:45 -- common/autotest_common.sh@936 -- # '[' -z 3863687 ']' 00:04:49.857 20:54:45 -- common/autotest_common.sh@940 -- # kill -0 3863687 00:04:49.857 20:54:45 -- common/autotest_common.sh@941 -- # uname 00:04:49.857 20:54:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.857 20:54:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3863687 00:04:49.857 20:54:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:49.857 20:54:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:49.857 20:54:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3863687' 00:04:49.857 killing process with pid 3863687 00:04:49.857 20:54:45 -- common/autotest_common.sh@955 -- # kill 3863687 00:04:49.857 20:54:45 -- common/autotest_common.sh@960 -- # wait 3863687 00:04:50.114 [2024-11-27 20:54:46.215812] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:50.373 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:50.373 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:50.373 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:50.373 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:50.373 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:50.373 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:50.373 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:50.373 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:50.373 00:04:50.373 real 0m3.938s 00:04:50.373 user 0m5.925s 00:04:50.373 sys 0m0.346s 00:04:50.373 20:54:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.373 20:54:46 -- common/autotest_common.sh@10 -- # set +x 00:04:50.373 ************************************ 00:04:50.373 END TEST event_scheduler 00:04:50.373 ************************************ 00:04:50.373 20:54:46 -- event/event.sh@51 -- # modprobe -n nbd 00:04:50.373 20:54:46 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:50.373 20:54:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.373 20:54:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.373 20:54:46 -- common/autotest_common.sh@10 -- # set +x 00:04:50.374 ************************************ 00:04:50.374 START TEST app_repeat 00:04:50.374 ************************************ 00:04:50.374 20:54:46 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:50.374 20:54:46 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.374 20:54:46 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.374 20:54:46 -- event/event.sh@13 -- # local nbd_list 00:04:50.374 20:54:46 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.374 20:54:46 -- event/event.sh@14 -- # local bdev_list 00:04:50.374 20:54:46 -- event/event.sh@15 -- # local repeat_times=4 00:04:50.374 20:54:46 -- event/event.sh@17 -- # modprobe nbd 00:04:50.374 20:54:46 -- event/event.sh@19 -- # repeat_pid=3864152 00:04:50.374 20:54:46 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:50.374 20:54:46 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:50.374 20:54:46 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3864152' 00:04:50.374 Process app_repeat pid: 3864152 00:04:50.374 20:54:46 -- event/event.sh@23 -- # for i in {0..2} 00:04:50.374 20:54:46 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:50.374 spdk_app_start Round 0 00:04:50.374 20:54:46 -- event/event.sh@25 -- # waitforlisten 3864152 /var/tmp/spdk-nbd.sock 00:04:50.374 20:54:46 -- common/autotest_common.sh@829 -- # '[' -z 3864152 ']' 00:04:50.374 20:54:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:50.374 20:54:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.374 20:54:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:50.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:50.374 20:54:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.374 20:54:46 -- common/autotest_common.sh@10 -- # set +x 00:04:50.374 [2024-11-27 20:54:46.539794] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:50.374 [2024-11-27 20:54:46.539903] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3864152 ] 00:04:50.374 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.374 [2024-11-27 20:54:46.603583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:50.632 [2024-11-27 20:54:46.717559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.632 [2024-11-27 20:54:46.717564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.564 20:54:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.564 20:54:47 -- common/autotest_common.sh@862 -- # return 0 00:04:51.564 20:54:47 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.564 Malloc0 00:04:51.564 20:54:47 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.822 Malloc1 00:04:51.823 20:54:48 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@12 -- # local i 00:04:51.823 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:52.081 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.081 20:54:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:52.081 /dev/nbd0 00:04:52.339 20:54:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:52.339 20:54:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:52.339 20:54:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:52.339 20:54:48 -- common/autotest_common.sh@867 -- # local i 00:04:52.339 20:54:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.339 20:54:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.339 20:54:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:52.339 20:54:48 -- common/autotest_common.sh@871 -- # break 00:04:52.339 20:54:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.339 20:54:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.339 20:54:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.339 1+0 records in 00:04:52.339 1+0 records out 00:04:52.339 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000184086 s, 22.3 MB/s 00:04:52.339 20:54:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.339 20:54:48 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.339 20:54:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.339 20:54:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.339 20:54:48 -- common/autotest_common.sh@887 -- # return 0 00:04:52.339 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.339 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.339 20:54:48 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:52.597 /dev/nbd1 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:52.597 20:54:48 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:52.597 20:54:48 -- common/autotest_common.sh@867 -- # local i 00:04:52.597 20:54:48 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.597 20:54:48 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.597 20:54:48 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:52.597 20:54:48 -- common/autotest_common.sh@871 -- # break 00:04:52.597 20:54:48 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.597 20:54:48 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.597 20:54:48 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.597 1+0 records in 00:04:52.597 1+0 records out 00:04:52.597 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000272748 s, 15.0 MB/s 00:04:52.597 20:54:48 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.597 20:54:48 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.597 20:54:48 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.597 20:54:48 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.597 20:54:48 -- common/autotest_common.sh@887 -- # return 0 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.597 20:54:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:52.856 { 00:04:52.856 "nbd_device": "/dev/nbd0", 00:04:52.856 "bdev_name": "Malloc0" 00:04:52.856 }, 00:04:52.856 { 00:04:52.856 "nbd_device": "/dev/nbd1", 00:04:52.856 "bdev_name": "Malloc1" 00:04:52.856 } 00:04:52.856 ]' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:52.856 { 00:04:52.856 "nbd_device": "/dev/nbd0", 00:04:52.856 "bdev_name": "Malloc0" 00:04:52.856 }, 00:04:52.856 { 00:04:52.856 "nbd_device": "/dev/nbd1", 00:04:52.856 "bdev_name": "Malloc1" 00:04:52.856 } 00:04:52.856 ]' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:52.856 /dev/nbd1' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:52.856 /dev/nbd1' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@65 -- # count=2 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@95 -- # count=2 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:52.856 256+0 records in 00:04:52.856 256+0 records out 00:04:52.856 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508693 s, 206 MB/s 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:52.856 256+0 records in 00:04:52.856 256+0 records out 00:04:52.856 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223583 s, 46.9 MB/s 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:52.856 256+0 records in 00:04:52.856 256+0 records out 00:04:52.856 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256122 s, 40.9 MB/s 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.856 20:54:48 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@51 -- # local i 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.856 20:54:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@41 -- # break 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.114 20:54:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@41 -- # break 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.372 20:54:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@65 -- # true 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@65 -- # count=0 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@104 -- # count=0 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:53.630 20:54:49 -- bdev/nbd_common.sh@109 -- # return 0 00:04:53.630 20:54:49 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:53.908 20:54:50 -- event/event.sh@35 -- # sleep 3 00:04:54.473 [2024-11-27 20:54:50.413359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:54.473 [2024-11-27 20:54:50.527032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.473 [2024-11-27 20:54:50.527032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.473 [2024-11-27 20:54:50.585456] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:54.473 [2024-11-27 20:54:50.585549] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:56.996 20:54:53 -- event/event.sh@23 -- # for i in {0..2} 00:04:56.996 20:54:53 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:56.996 spdk_app_start Round 1 00:04:56.996 20:54:53 -- event/event.sh@25 -- # waitforlisten 3864152 /var/tmp/spdk-nbd.sock 00:04:56.996 20:54:53 -- common/autotest_common.sh@829 -- # '[' -z 3864152 ']' 00:04:56.996 20:54:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:56.996 20:54:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.996 20:54:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:56.996 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:56.996 20:54:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.996 20:54:53 -- common/autotest_common.sh@10 -- # set +x 00:04:57.253 20:54:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.253 20:54:53 -- common/autotest_common.sh@862 -- # return 0 00:04:57.253 20:54:53 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:57.512 Malloc0 00:04:57.512 20:54:53 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:57.770 Malloc1 00:04:57.770 20:54:53 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:57.770 20:54:53 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.771 20:54:53 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:57.771 20:54:53 -- bdev/nbd_common.sh@12 -- # local i 00:04:57.771 20:54:53 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:57.771 20:54:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.771 20:54:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:58.028 /dev/nbd0 00:04:58.028 20:54:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:58.028 20:54:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:58.028 20:54:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:58.028 20:54:54 -- common/autotest_common.sh@867 -- # local i 00:04:58.028 20:54:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:58.028 20:54:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:58.028 20:54:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:58.028 20:54:54 -- common/autotest_common.sh@871 -- # break 00:04:58.028 20:54:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:58.028 20:54:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:58.028 20:54:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:58.028 1+0 records in 00:04:58.028 1+0 records out 00:04:58.028 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211068 s, 19.4 MB/s 00:04:58.028 20:54:54 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.029 20:54:54 -- common/autotest_common.sh@884 -- # size=4096 00:04:58.029 20:54:54 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.029 20:54:54 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:58.029 20:54:54 -- common/autotest_common.sh@887 -- # return 0 00:04:58.029 20:54:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:58.029 20:54:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:58.029 20:54:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:58.287 /dev/nbd1 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:58.287 20:54:54 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:58.287 20:54:54 -- common/autotest_common.sh@867 -- # local i 00:04:58.287 20:54:54 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:58.287 20:54:54 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:58.287 20:54:54 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:58.287 20:54:54 -- common/autotest_common.sh@871 -- # break 00:04:58.287 20:54:54 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:58.287 20:54:54 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:58.287 20:54:54 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:58.287 1+0 records in 00:04:58.287 1+0 records out 00:04:58.287 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000181972 s, 22.5 MB/s 00:04:58.287 20:54:54 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.287 20:54:54 -- common/autotest_common.sh@884 -- # size=4096 00:04:58.287 20:54:54 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.287 20:54:54 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:58.287 20:54:54 -- common/autotest_common.sh@887 -- # return 0 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.287 20:54:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.546 20:54:54 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:58.546 { 00:04:58.546 "nbd_device": "/dev/nbd0", 00:04:58.546 "bdev_name": "Malloc0" 00:04:58.546 }, 00:04:58.546 { 00:04:58.547 "nbd_device": "/dev/nbd1", 00:04:58.547 "bdev_name": "Malloc1" 00:04:58.547 } 00:04:58.547 ]' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:58.547 { 00:04:58.547 "nbd_device": "/dev/nbd0", 00:04:58.547 "bdev_name": "Malloc0" 00:04:58.547 }, 00:04:58.547 { 00:04:58.547 "nbd_device": "/dev/nbd1", 00:04:58.547 "bdev_name": "Malloc1" 00:04:58.547 } 00:04:58.547 ]' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:58.547 /dev/nbd1' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:58.547 /dev/nbd1' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@65 -- # count=2 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@95 -- # count=2 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:58.547 256+0 records in 00:04:58.547 256+0 records out 00:04:58.547 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00434187 s, 242 MB/s 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:58.547 20:54:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:58.805 256+0 records in 00:04:58.805 256+0 records out 00:04:58.805 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262305 s, 40.0 MB/s 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:58.805 256+0 records in 00:04:58.805 256+0 records out 00:04:58.805 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256535 s, 40.9 MB/s 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@51 -- # local i 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:58.805 20:54:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@41 -- # break 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@45 -- # return 0 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:59.064 20:54:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@41 -- # break 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@45 -- # return 0 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.322 20:54:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@65 -- # true 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@65 -- # count=0 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@104 -- # count=0 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:59.580 20:54:55 -- bdev/nbd_common.sh@109 -- # return 0 00:04:59.580 20:54:55 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:59.838 20:54:55 -- event/event.sh@35 -- # sleep 3 00:05:00.097 [2024-11-27 20:54:56.238585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:00.355 [2024-11-27 20:54:56.352698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:00.355 [2024-11-27 20:54:56.352704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.355 [2024-11-27 20:54:56.414346] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:00.355 [2024-11-27 20:54:56.414429] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:02.882 20:54:58 -- event/event.sh@23 -- # for i in {0..2} 00:05:02.882 20:54:58 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:02.882 spdk_app_start Round 2 00:05:02.882 20:54:58 -- event/event.sh@25 -- # waitforlisten 3864152 /var/tmp/spdk-nbd.sock 00:05:02.882 20:54:58 -- common/autotest_common.sh@829 -- # '[' -z 3864152 ']' 00:05:02.882 20:54:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:02.882 20:54:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.882 20:54:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:02.883 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:02.883 20:54:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.883 20:54:58 -- common/autotest_common.sh@10 -- # set +x 00:05:03.139 20:54:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.139 20:54:59 -- common/autotest_common.sh@862 -- # return 0 00:05:03.139 20:54:59 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:03.395 Malloc0 00:05:03.395 20:54:59 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:03.653 Malloc1 00:05:03.653 20:54:59 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@12 -- # local i 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.653 20:54:59 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:03.911 /dev/nbd0 00:05:03.911 20:55:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:03.911 20:55:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:03.911 20:55:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:03.911 20:55:00 -- common/autotest_common.sh@867 -- # local i 00:05:03.911 20:55:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:03.911 20:55:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:03.911 20:55:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:03.911 20:55:00 -- common/autotest_common.sh@871 -- # break 00:05:03.911 20:55:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:03.911 20:55:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:03.911 20:55:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:03.911 1+0 records in 00:05:03.911 1+0 records out 00:05:03.911 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000148042 s, 27.7 MB/s 00:05:03.911 20:55:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.911 20:55:00 -- common/autotest_common.sh@884 -- # size=4096 00:05:03.911 20:55:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.911 20:55:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:03.911 20:55:00 -- common/autotest_common.sh@887 -- # return 0 00:05:03.911 20:55:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:03.911 20:55:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.911 20:55:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:04.170 /dev/nbd1 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:04.170 20:55:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:04.170 20:55:00 -- common/autotest_common.sh@867 -- # local i 00:05:04.170 20:55:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:04.170 20:55:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:04.170 20:55:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:04.170 20:55:00 -- common/autotest_common.sh@871 -- # break 00:05:04.170 20:55:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:04.170 20:55:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:04.170 20:55:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:04.170 1+0 records in 00:05:04.170 1+0 records out 00:05:04.170 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200952 s, 20.4 MB/s 00:05:04.170 20:55:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:04.170 20:55:00 -- common/autotest_common.sh@884 -- # size=4096 00:05:04.170 20:55:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:04.170 20:55:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:04.170 20:55:00 -- common/autotest_common.sh@887 -- # return 0 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.170 20:55:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:04.428 { 00:05:04.428 "nbd_device": "/dev/nbd0", 00:05:04.428 "bdev_name": "Malloc0" 00:05:04.428 }, 00:05:04.428 { 00:05:04.428 "nbd_device": "/dev/nbd1", 00:05:04.428 "bdev_name": "Malloc1" 00:05:04.428 } 00:05:04.428 ]' 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:04.428 { 00:05:04.428 "nbd_device": "/dev/nbd0", 00:05:04.428 "bdev_name": "Malloc0" 00:05:04.428 }, 00:05:04.428 { 00:05:04.428 "nbd_device": "/dev/nbd1", 00:05:04.428 "bdev_name": "Malloc1" 00:05:04.428 } 00:05:04.428 ]' 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:04.428 /dev/nbd1' 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:04.428 /dev/nbd1' 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@65 -- # count=2 00:05:04.428 20:55:00 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@95 -- # count=2 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:04.429 256+0 records in 00:05:04.429 256+0 records out 00:05:04.429 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00467733 s, 224 MB/s 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:04.429 20:55:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:04.686 256+0 records in 00:05:04.686 256+0 records out 00:05:04.686 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227885 s, 46.0 MB/s 00:05:04.686 20:55:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:04.686 20:55:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:04.686 256+0 records in 00:05:04.686 256+0 records out 00:05:04.686 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278747 s, 37.6 MB/s 00:05:04.686 20:55:00 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:04.686 20:55:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.686 20:55:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@51 -- # local i 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:04.687 20:55:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@41 -- # break 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@45 -- # return 0 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:04.968 20:55:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@41 -- # break 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@45 -- # return 0 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.264 20:55:01 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:05.524 20:55:01 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@65 -- # true 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@65 -- # count=0 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@104 -- # count=0 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:05.525 20:55:01 -- bdev/nbd_common.sh@109 -- # return 0 00:05:05.525 20:55:01 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:05.782 20:55:01 -- event/event.sh@35 -- # sleep 3 00:05:06.041 [2024-11-27 20:55:02.118439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:06.041 [2024-11-27 20:55:02.231608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.041 [2024-11-27 20:55:02.231609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:06.299 [2024-11-27 20:55:02.293617] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:06.299 [2024-11-27 20:55:02.293685] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:08.826 20:55:04 -- event/event.sh@38 -- # waitforlisten 3864152 /var/tmp/spdk-nbd.sock 00:05:08.826 20:55:04 -- common/autotest_common.sh@829 -- # '[' -z 3864152 ']' 00:05:08.826 20:55:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:08.826 20:55:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.826 20:55:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:08.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:08.827 20:55:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.827 20:55:04 -- common/autotest_common.sh@10 -- # set +x 00:05:09.085 20:55:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:09.085 20:55:05 -- common/autotest_common.sh@862 -- # return 0 00:05:09.085 20:55:05 -- event/event.sh@39 -- # killprocess 3864152 00:05:09.085 20:55:05 -- common/autotest_common.sh@936 -- # '[' -z 3864152 ']' 00:05:09.085 20:55:05 -- common/autotest_common.sh@940 -- # kill -0 3864152 00:05:09.085 20:55:05 -- common/autotest_common.sh@941 -- # uname 00:05:09.085 20:55:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:09.085 20:55:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3864152 00:05:09.085 20:55:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:09.085 20:55:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:09.085 20:55:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3864152' 00:05:09.085 killing process with pid 3864152 00:05:09.085 20:55:05 -- common/autotest_common.sh@955 -- # kill 3864152 00:05:09.085 20:55:05 -- common/autotest_common.sh@960 -- # wait 3864152 00:05:09.343 spdk_app_start is called in Round 0. 00:05:09.343 Shutdown signal received, stop current app iteration 00:05:09.343 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:09.343 spdk_app_start is called in Round 1. 00:05:09.343 Shutdown signal received, stop current app iteration 00:05:09.343 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:09.343 spdk_app_start is called in Round 2. 00:05:09.343 Shutdown signal received, stop current app iteration 00:05:09.343 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:09.343 spdk_app_start is called in Round 3. 00:05:09.343 Shutdown signal received, stop current app iteration 00:05:09.343 20:55:05 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:09.343 20:55:05 -- event/event.sh@42 -- # return 0 00:05:09.343 00:05:09.343 real 0m18.882s 00:05:09.343 user 0m41.105s 00:05:09.343 sys 0m3.119s 00:05:09.343 20:55:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.343 20:55:05 -- common/autotest_common.sh@10 -- # set +x 00:05:09.343 ************************************ 00:05:09.343 END TEST app_repeat 00:05:09.343 ************************************ 00:05:09.343 20:55:05 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:09.343 20:55:05 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:09.343 20:55:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.343 20:55:05 -- common/autotest_common.sh@10 -- # set +x 00:05:09.343 ************************************ 00:05:09.343 START TEST cpu_locks 00:05:09.343 ************************************ 00:05:09.343 20:55:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:09.343 * Looking for test storage... 00:05:09.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:09.343 20:55:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:09.343 20:55:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:09.343 20:55:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:09.343 20:55:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:09.343 20:55:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:09.343 20:55:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:09.343 20:55:05 -- scripts/common.sh@335 -- # IFS=.-: 00:05:09.343 20:55:05 -- scripts/common.sh@335 -- # read -ra ver1 00:05:09.343 20:55:05 -- scripts/common.sh@336 -- # IFS=.-: 00:05:09.343 20:55:05 -- scripts/common.sh@336 -- # read -ra ver2 00:05:09.343 20:55:05 -- scripts/common.sh@337 -- # local 'op=<' 00:05:09.343 20:55:05 -- scripts/common.sh@339 -- # ver1_l=2 00:05:09.343 20:55:05 -- scripts/common.sh@340 -- # ver2_l=1 00:05:09.343 20:55:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:09.343 20:55:05 -- scripts/common.sh@343 -- # case "$op" in 00:05:09.343 20:55:05 -- scripts/common.sh@344 -- # : 1 00:05:09.343 20:55:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:09.343 20:55:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:09.343 20:55:05 -- scripts/common.sh@364 -- # decimal 1 00:05:09.343 20:55:05 -- scripts/common.sh@352 -- # local d=1 00:05:09.343 20:55:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:09.343 20:55:05 -- scripts/common.sh@354 -- # echo 1 00:05:09.343 20:55:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:09.343 20:55:05 -- scripts/common.sh@365 -- # decimal 2 00:05:09.343 20:55:05 -- scripts/common.sh@352 -- # local d=2 00:05:09.343 20:55:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:09.343 20:55:05 -- scripts/common.sh@354 -- # echo 2 00:05:09.343 20:55:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:09.343 20:55:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:09.343 20:55:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:09.343 20:55:05 -- scripts/common.sh@367 -- # return 0 00:05:09.343 20:55:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:09.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.343 --rc genhtml_branch_coverage=1 00:05:09.343 --rc genhtml_function_coverage=1 00:05:09.343 --rc genhtml_legend=1 00:05:09.343 --rc geninfo_all_blocks=1 00:05:09.343 --rc geninfo_unexecuted_blocks=1 00:05:09.343 00:05:09.343 ' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:09.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.343 --rc genhtml_branch_coverage=1 00:05:09.343 --rc genhtml_function_coverage=1 00:05:09.343 --rc genhtml_legend=1 00:05:09.343 --rc geninfo_all_blocks=1 00:05:09.343 --rc geninfo_unexecuted_blocks=1 00:05:09.343 00:05:09.343 ' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:09.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.343 --rc genhtml_branch_coverage=1 00:05:09.343 --rc genhtml_function_coverage=1 00:05:09.343 --rc genhtml_legend=1 00:05:09.343 --rc geninfo_all_blocks=1 00:05:09.343 --rc geninfo_unexecuted_blocks=1 00:05:09.343 00:05:09.343 ' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:09.343 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:09.343 --rc genhtml_branch_coverage=1 00:05:09.343 --rc genhtml_function_coverage=1 00:05:09.343 --rc genhtml_legend=1 00:05:09.343 --rc geninfo_all_blocks=1 00:05:09.343 --rc geninfo_unexecuted_blocks=1 00:05:09.343 00:05:09.343 ' 00:05:09.343 20:55:05 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:09.343 20:55:05 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:09.343 20:55:05 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:09.343 20:55:05 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:09.343 20:55:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.343 20:55:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.343 20:55:05 -- common/autotest_common.sh@10 -- # set +x 00:05:09.343 ************************************ 00:05:09.343 START TEST default_locks 00:05:09.343 ************************************ 00:05:09.343 20:55:05 -- common/autotest_common.sh@1114 -- # default_locks 00:05:09.343 20:55:05 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3866708 00:05:09.343 20:55:05 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:09.343 20:55:05 -- event/cpu_locks.sh@47 -- # waitforlisten 3866708 00:05:09.343 20:55:05 -- common/autotest_common.sh@829 -- # '[' -z 3866708 ']' 00:05:09.343 20:55:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.343 20:55:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.343 20:55:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.343 20:55:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.343 20:55:05 -- common/autotest_common.sh@10 -- # set +x 00:05:09.601 [2024-11-27 20:55:05.618075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.601 [2024-11-27 20:55:05.618167] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3866708 ] 00:05:09.601 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.601 [2024-11-27 20:55:05.688174] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.601 [2024-11-27 20:55:05.822364] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.601 [2024-11-27 20:55:05.822606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.533 20:55:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.533 20:55:06 -- common/autotest_common.sh@862 -- # return 0 00:05:10.533 20:55:06 -- event/cpu_locks.sh@49 -- # locks_exist 3866708 00:05:10.533 20:55:06 -- event/cpu_locks.sh@22 -- # lslocks -p 3866708 00:05:10.533 20:55:06 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:10.791 lslocks: write error 00:05:10.791 20:55:06 -- event/cpu_locks.sh@50 -- # killprocess 3866708 00:05:10.791 20:55:06 -- common/autotest_common.sh@936 -- # '[' -z 3866708 ']' 00:05:10.791 20:55:06 -- common/autotest_common.sh@940 -- # kill -0 3866708 00:05:10.791 20:55:06 -- common/autotest_common.sh@941 -- # uname 00:05:10.791 20:55:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.791 20:55:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3866708 00:05:10.791 20:55:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.791 20:55:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.791 20:55:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3866708' 00:05:10.791 killing process with pid 3866708 00:05:10.791 20:55:06 -- common/autotest_common.sh@955 -- # kill 3866708 00:05:10.791 20:55:06 -- common/autotest_common.sh@960 -- # wait 3866708 00:05:11.357 20:55:07 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3866708 00:05:11.357 20:55:07 -- common/autotest_common.sh@650 -- # local es=0 00:05:11.357 20:55:07 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3866708 00:05:11.357 20:55:07 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:11.357 20:55:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:11.357 20:55:07 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:11.357 20:55:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:11.357 20:55:07 -- common/autotest_common.sh@653 -- # waitforlisten 3866708 00:05:11.357 20:55:07 -- common/autotest_common.sh@829 -- # '[' -z 3866708 ']' 00:05:11.357 20:55:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.357 20:55:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.357 20:55:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.357 20:55:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.357 20:55:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.357 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3866708) - No such process 00:05:11.357 ERROR: process (pid: 3866708) is no longer running 00:05:11.357 20:55:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.357 20:55:07 -- common/autotest_common.sh@862 -- # return 1 00:05:11.357 20:55:07 -- common/autotest_common.sh@653 -- # es=1 00:05:11.357 20:55:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:11.357 20:55:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:11.357 20:55:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:11.357 20:55:07 -- event/cpu_locks.sh@54 -- # no_locks 00:05:11.357 20:55:07 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:11.357 20:55:07 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:11.357 20:55:07 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:11.357 00:05:11.357 real 0m1.814s 00:05:11.357 user 0m2.079s 00:05:11.357 sys 0m0.553s 00:05:11.357 20:55:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.357 20:55:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.357 ************************************ 00:05:11.357 END TEST default_locks 00:05:11.357 ************************************ 00:05:11.357 20:55:07 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:11.357 20:55:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.357 20:55:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.357 20:55:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.357 ************************************ 00:05:11.357 START TEST default_locks_via_rpc 00:05:11.357 ************************************ 00:05:11.357 20:55:07 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:11.357 20:55:07 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3867009 00:05:11.357 20:55:07 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:11.357 20:55:07 -- event/cpu_locks.sh@63 -- # waitforlisten 3867009 00:05:11.357 20:55:07 -- common/autotest_common.sh@829 -- # '[' -z 3867009 ']' 00:05:11.357 20:55:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.357 20:55:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.357 20:55:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.357 20:55:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.357 20:55:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.357 [2024-11-27 20:55:07.457695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.357 [2024-11-27 20:55:07.457789] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3867009 ] 00:05:11.357 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.357 [2024-11-27 20:55:07.516065] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.615 [2024-11-27 20:55:07.627035] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.615 [2024-11-27 20:55:07.627202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.548 20:55:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.548 20:55:08 -- common/autotest_common.sh@862 -- # return 0 00:05:12.548 20:55:08 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:12.548 20:55:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.548 20:55:08 -- common/autotest_common.sh@10 -- # set +x 00:05:12.548 20:55:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.548 20:55:08 -- event/cpu_locks.sh@67 -- # no_locks 00:05:12.548 20:55:08 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:12.548 20:55:08 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:12.548 20:55:08 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:12.548 20:55:08 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:12.548 20:55:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.548 20:55:08 -- common/autotest_common.sh@10 -- # set +x 00:05:12.548 20:55:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.548 20:55:08 -- event/cpu_locks.sh@71 -- # locks_exist 3867009 00:05:12.548 20:55:08 -- event/cpu_locks.sh@22 -- # lslocks -p 3867009 00:05:12.548 20:55:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:12.548 20:55:08 -- event/cpu_locks.sh@73 -- # killprocess 3867009 00:05:12.548 20:55:08 -- common/autotest_common.sh@936 -- # '[' -z 3867009 ']' 00:05:12.548 20:55:08 -- common/autotest_common.sh@940 -- # kill -0 3867009 00:05:12.548 20:55:08 -- common/autotest_common.sh@941 -- # uname 00:05:12.548 20:55:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.548 20:55:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3867009 00:05:12.548 20:55:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.548 20:55:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.548 20:55:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3867009' 00:05:12.548 killing process with pid 3867009 00:05:12.548 20:55:08 -- common/autotest_common.sh@955 -- # kill 3867009 00:05:12.548 20:55:08 -- common/autotest_common.sh@960 -- # wait 3867009 00:05:13.115 00:05:13.115 real 0m1.796s 00:05:13.115 user 0m1.945s 00:05:13.115 sys 0m0.580s 00:05:13.115 20:55:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.115 20:55:09 -- common/autotest_common.sh@10 -- # set +x 00:05:13.115 ************************************ 00:05:13.115 END TEST default_locks_via_rpc 00:05:13.115 ************************************ 00:05:13.115 20:55:09 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:13.115 20:55:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.115 20:55:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.115 20:55:09 -- common/autotest_common.sh@10 -- # set +x 00:05:13.115 ************************************ 00:05:13.115 START TEST non_locking_app_on_locked_coremask 00:05:13.115 ************************************ 00:05:13.115 20:55:09 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:13.115 20:55:09 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3867182 00:05:13.115 20:55:09 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:13.115 20:55:09 -- event/cpu_locks.sh@81 -- # waitforlisten 3867182 /var/tmp/spdk.sock 00:05:13.115 20:55:09 -- common/autotest_common.sh@829 -- # '[' -z 3867182 ']' 00:05:13.115 20:55:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:13.115 20:55:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.115 20:55:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:13.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:13.115 20:55:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.115 20:55:09 -- common/autotest_common.sh@10 -- # set +x 00:05:13.115 [2024-11-27 20:55:09.285175] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.116 [2024-11-27 20:55:09.285269] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3867182 ] 00:05:13.116 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.116 [2024-11-27 20:55:09.345358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.374 [2024-11-27 20:55:09.464016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.374 [2024-11-27 20:55:09.464185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.309 20:55:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.309 20:55:10 -- common/autotest_common.sh@862 -- # return 0 00:05:14.309 20:55:10 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3867322 00:05:14.309 20:55:10 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:14.309 20:55:10 -- event/cpu_locks.sh@85 -- # waitforlisten 3867322 /var/tmp/spdk2.sock 00:05:14.309 20:55:10 -- common/autotest_common.sh@829 -- # '[' -z 3867322 ']' 00:05:14.309 20:55:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:14.309 20:55:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.309 20:55:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:14.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:14.309 20:55:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.309 20:55:10 -- common/autotest_common.sh@10 -- # set +x 00:05:14.309 [2024-11-27 20:55:10.297037] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.309 [2024-11-27 20:55:10.297121] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3867322 ] 00:05:14.309 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.309 [2024-11-27 20:55:10.392422] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:14.309 [2024-11-27 20:55:10.392479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.567 [2024-11-27 20:55:10.626200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.567 [2024-11-27 20:55:10.626386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.133 20:55:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.133 20:55:11 -- common/autotest_common.sh@862 -- # return 0 00:05:15.133 20:55:11 -- event/cpu_locks.sh@87 -- # locks_exist 3867182 00:05:15.133 20:55:11 -- event/cpu_locks.sh@22 -- # lslocks -p 3867182 00:05:15.133 20:55:11 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.697 lslocks: write error 00:05:15.697 20:55:11 -- event/cpu_locks.sh@89 -- # killprocess 3867182 00:05:15.697 20:55:11 -- common/autotest_common.sh@936 -- # '[' -z 3867182 ']' 00:05:15.697 20:55:11 -- common/autotest_common.sh@940 -- # kill -0 3867182 00:05:15.697 20:55:11 -- common/autotest_common.sh@941 -- # uname 00:05:15.697 20:55:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.697 20:55:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3867182 00:05:15.697 20:55:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.697 20:55:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.697 20:55:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3867182' 00:05:15.697 killing process with pid 3867182 00:05:15.697 20:55:11 -- common/autotest_common.sh@955 -- # kill 3867182 00:05:15.697 20:55:11 -- common/autotest_common.sh@960 -- # wait 3867182 00:05:16.631 20:55:12 -- event/cpu_locks.sh@90 -- # killprocess 3867322 00:05:16.631 20:55:12 -- common/autotest_common.sh@936 -- # '[' -z 3867322 ']' 00:05:16.631 20:55:12 -- common/autotest_common.sh@940 -- # kill -0 3867322 00:05:16.631 20:55:12 -- common/autotest_common.sh@941 -- # uname 00:05:16.631 20:55:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.631 20:55:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3867322 00:05:16.631 20:55:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.631 20:55:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.631 20:55:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3867322' 00:05:16.631 killing process with pid 3867322 00:05:16.631 20:55:12 -- common/autotest_common.sh@955 -- # kill 3867322 00:05:16.631 20:55:12 -- common/autotest_common.sh@960 -- # wait 3867322 00:05:17.197 00:05:17.197 real 0m3.994s 00:05:17.197 user 0m4.390s 00:05:17.197 sys 0m1.098s 00:05:17.197 20:55:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.197 20:55:13 -- common/autotest_common.sh@10 -- # set +x 00:05:17.197 ************************************ 00:05:17.197 END TEST non_locking_app_on_locked_coremask 00:05:17.197 ************************************ 00:05:17.197 20:55:13 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:17.197 20:55:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.197 20:55:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.197 20:55:13 -- common/autotest_common.sh@10 -- # set +x 00:05:17.197 ************************************ 00:05:17.197 START TEST locking_app_on_unlocked_coremask 00:05:17.197 ************************************ 00:05:17.197 20:55:13 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:17.197 20:55:13 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3867763 00:05:17.197 20:55:13 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:17.197 20:55:13 -- event/cpu_locks.sh@99 -- # waitforlisten 3867763 /var/tmp/spdk.sock 00:05:17.197 20:55:13 -- common/autotest_common.sh@829 -- # '[' -z 3867763 ']' 00:05:17.197 20:55:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.197 20:55:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.197 20:55:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.197 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.197 20:55:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.197 20:55:13 -- common/autotest_common.sh@10 -- # set +x 00:05:17.197 [2024-11-27 20:55:13.307798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.197 [2024-11-27 20:55:13.307895] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3867763 ] 00:05:17.197 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.197 [2024-11-27 20:55:13.368464] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:17.197 [2024-11-27 20:55:13.368510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.455 [2024-11-27 20:55:13.479260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.455 [2024-11-27 20:55:13.479436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.022 20:55:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.022 20:55:14 -- common/autotest_common.sh@862 -- # return 0 00:05:18.022 20:55:14 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3867904 00:05:18.022 20:55:14 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:18.022 20:55:14 -- event/cpu_locks.sh@103 -- # waitforlisten 3867904 /var/tmp/spdk2.sock 00:05:18.022 20:55:14 -- common/autotest_common.sh@829 -- # '[' -z 3867904 ']' 00:05:18.022 20:55:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.022 20:55:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.022 20:55:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.022 20:55:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.022 20:55:14 -- common/autotest_common.sh@10 -- # set +x 00:05:18.280 [2024-11-27 20:55:14.293436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.280 [2024-11-27 20:55:14.293511] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3867904 ] 00:05:18.280 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.280 [2024-11-27 20:55:14.389540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.538 [2024-11-27 20:55:14.621174] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.538 [2024-11-27 20:55:14.621368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.105 20:55:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.105 20:55:15 -- common/autotest_common.sh@862 -- # return 0 00:05:19.105 20:55:15 -- event/cpu_locks.sh@105 -- # locks_exist 3867904 00:05:19.105 20:55:15 -- event/cpu_locks.sh@22 -- # lslocks -p 3867904 00:05:19.105 20:55:15 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:19.362 lslocks: write error 00:05:19.362 20:55:15 -- event/cpu_locks.sh@107 -- # killprocess 3867763 00:05:19.362 20:55:15 -- common/autotest_common.sh@936 -- # '[' -z 3867763 ']' 00:05:19.362 20:55:15 -- common/autotest_common.sh@940 -- # kill -0 3867763 00:05:19.362 20:55:15 -- common/autotest_common.sh@941 -- # uname 00:05:19.362 20:55:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.362 20:55:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3867763 00:05:19.620 20:55:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:19.620 20:55:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:19.620 20:55:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3867763' 00:05:19.620 killing process with pid 3867763 00:05:19.620 20:55:15 -- common/autotest_common.sh@955 -- # kill 3867763 00:05:19.620 20:55:15 -- common/autotest_common.sh@960 -- # wait 3867763 00:05:20.553 20:55:16 -- event/cpu_locks.sh@108 -- # killprocess 3867904 00:05:20.553 20:55:16 -- common/autotest_common.sh@936 -- # '[' -z 3867904 ']' 00:05:20.553 20:55:16 -- common/autotest_common.sh@940 -- # kill -0 3867904 00:05:20.553 20:55:16 -- common/autotest_common.sh@941 -- # uname 00:05:20.553 20:55:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.553 20:55:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3867904 00:05:20.553 20:55:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.553 20:55:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.553 20:55:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3867904' 00:05:20.553 killing process with pid 3867904 00:05:20.553 20:55:16 -- common/autotest_common.sh@955 -- # kill 3867904 00:05:20.553 20:55:16 -- common/autotest_common.sh@960 -- # wait 3867904 00:05:20.812 00:05:20.812 real 0m3.789s 00:05:20.812 user 0m4.133s 00:05:20.812 sys 0m1.052s 00:05:20.812 20:55:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.812 20:55:17 -- common/autotest_common.sh@10 -- # set +x 00:05:20.812 ************************************ 00:05:20.812 END TEST locking_app_on_unlocked_coremask 00:05:20.812 ************************************ 00:05:21.070 20:55:17 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:21.070 20:55:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.070 20:55:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.070 20:55:17 -- common/autotest_common.sh@10 -- # set +x 00:05:21.070 ************************************ 00:05:21.070 START TEST locking_app_on_locked_coremask 00:05:21.070 ************************************ 00:05:21.070 20:55:17 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:21.070 20:55:17 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3868216 00:05:21.070 20:55:17 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:21.070 20:55:17 -- event/cpu_locks.sh@116 -- # waitforlisten 3868216 /var/tmp/spdk.sock 00:05:21.070 20:55:17 -- common/autotest_common.sh@829 -- # '[' -z 3868216 ']' 00:05:21.070 20:55:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.070 20:55:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.070 20:55:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.070 20:55:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.070 20:55:17 -- common/autotest_common.sh@10 -- # set +x 00:05:21.070 [2024-11-27 20:55:17.123064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.071 [2024-11-27 20:55:17.123141] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3868216 ] 00:05:21.071 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.071 [2024-11-27 20:55:17.178522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.071 [2024-11-27 20:55:17.285789] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.071 [2024-11-27 20:55:17.285970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.004 20:55:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.004 20:55:18 -- common/autotest_common.sh@862 -- # return 0 00:05:22.004 20:55:18 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3868358 00:05:22.004 20:55:18 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:22.004 20:55:18 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3868358 /var/tmp/spdk2.sock 00:05:22.004 20:55:18 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.004 20:55:18 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3868358 /var/tmp/spdk2.sock 00:05:22.004 20:55:18 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:22.004 20:55:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.004 20:55:18 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:22.004 20:55:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.004 20:55:18 -- common/autotest_common.sh@653 -- # waitforlisten 3868358 /var/tmp/spdk2.sock 00:05:22.004 20:55:18 -- common/autotest_common.sh@829 -- # '[' -z 3868358 ']' 00:05:22.004 20:55:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.004 20:55:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.004 20:55:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.004 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.004 20:55:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.004 20:55:18 -- common/autotest_common.sh@10 -- # set +x 00:05:22.004 [2024-11-27 20:55:18.130016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.004 [2024-11-27 20:55:18.130093] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3868358 ] 00:05:22.004 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.004 [2024-11-27 20:55:18.223625] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3868216 has claimed it. 00:05:22.004 [2024-11-27 20:55:18.223685] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:22.938 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3868358) - No such process 00:05:22.938 ERROR: process (pid: 3868358) is no longer running 00:05:22.938 20:55:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.938 20:55:18 -- common/autotest_common.sh@862 -- # return 1 00:05:22.938 20:55:18 -- common/autotest_common.sh@653 -- # es=1 00:05:22.938 20:55:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.938 20:55:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:22.938 20:55:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.938 20:55:18 -- event/cpu_locks.sh@122 -- # locks_exist 3868216 00:05:22.938 20:55:18 -- event/cpu_locks.sh@22 -- # lslocks -p 3868216 00:05:22.938 20:55:18 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.202 lslocks: write error 00:05:23.202 20:55:19 -- event/cpu_locks.sh@124 -- # killprocess 3868216 00:05:23.202 20:55:19 -- common/autotest_common.sh@936 -- # '[' -z 3868216 ']' 00:05:23.202 20:55:19 -- common/autotest_common.sh@940 -- # kill -0 3868216 00:05:23.202 20:55:19 -- common/autotest_common.sh@941 -- # uname 00:05:23.202 20:55:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:23.202 20:55:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3868216 00:05:23.202 20:55:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:23.202 20:55:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:23.202 20:55:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3868216' 00:05:23.202 killing process with pid 3868216 00:05:23.202 20:55:19 -- common/autotest_common.sh@955 -- # kill 3868216 00:05:23.202 20:55:19 -- common/autotest_common.sh@960 -- # wait 3868216 00:05:23.773 00:05:23.773 real 0m2.709s 00:05:23.773 user 0m3.117s 00:05:23.773 sys 0m0.654s 00:05:23.773 20:55:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.773 20:55:19 -- common/autotest_common.sh@10 -- # set +x 00:05:23.773 ************************************ 00:05:23.773 END TEST locking_app_on_locked_coremask 00:05:23.773 ************************************ 00:05:23.773 20:55:19 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:23.773 20:55:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:23.773 20:55:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.773 20:55:19 -- common/autotest_common.sh@10 -- # set +x 00:05:23.773 ************************************ 00:05:23.773 START TEST locking_overlapped_coremask 00:05:23.773 ************************************ 00:05:23.773 20:55:19 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:23.773 20:55:19 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3868649 00:05:23.773 20:55:19 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:23.773 20:55:19 -- event/cpu_locks.sh@133 -- # waitforlisten 3868649 /var/tmp/spdk.sock 00:05:23.773 20:55:19 -- common/autotest_common.sh@829 -- # '[' -z 3868649 ']' 00:05:23.773 20:55:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:23.773 20:55:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.773 20:55:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:23.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:23.773 20:55:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.773 20:55:19 -- common/autotest_common.sh@10 -- # set +x 00:05:23.773 [2024-11-27 20:55:19.856818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.773 [2024-11-27 20:55:19.856938] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3868649 ] 00:05:23.773 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.773 [2024-11-27 20:55:19.915839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:24.032 [2024-11-27 20:55:20.033812] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.032 [2024-11-27 20:55:20.034017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:24.032 [2024-11-27 20:55:20.035546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:24.032 [2024-11-27 20:55:20.035551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.964 20:55:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:24.964 20:55:20 -- common/autotest_common.sh@862 -- # return 0 00:05:24.964 20:55:20 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3868789 00:05:24.964 20:55:20 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3868789 /var/tmp/spdk2.sock 00:05:24.964 20:55:20 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:24.964 20:55:20 -- common/autotest_common.sh@650 -- # local es=0 00:05:24.964 20:55:20 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3868789 /var/tmp/spdk2.sock 00:05:24.964 20:55:20 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:24.964 20:55:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:24.964 20:55:20 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:24.964 20:55:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:24.964 20:55:20 -- common/autotest_common.sh@653 -- # waitforlisten 3868789 /var/tmp/spdk2.sock 00:05:24.964 20:55:20 -- common/autotest_common.sh@829 -- # '[' -z 3868789 ']' 00:05:24.964 20:55:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:24.964 20:55:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.964 20:55:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:24.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:24.964 20:55:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.964 20:55:20 -- common/autotest_common.sh@10 -- # set +x 00:05:24.964 [2024-11-27 20:55:20.899167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.964 [2024-11-27 20:55:20.899247] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3868789 ] 00:05:24.964 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.964 [2024-11-27 20:55:20.990034] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3868649 has claimed it. 00:05:24.964 [2024-11-27 20:55:20.990097] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:25.529 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3868789) - No such process 00:05:25.529 ERROR: process (pid: 3868789) is no longer running 00:05:25.529 20:55:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.529 20:55:21 -- common/autotest_common.sh@862 -- # return 1 00:05:25.529 20:55:21 -- common/autotest_common.sh@653 -- # es=1 00:05:25.529 20:55:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:25.529 20:55:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:25.529 20:55:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:25.529 20:55:21 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:25.529 20:55:21 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:25.529 20:55:21 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:25.529 20:55:21 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:25.529 20:55:21 -- event/cpu_locks.sh@141 -- # killprocess 3868649 00:05:25.529 20:55:21 -- common/autotest_common.sh@936 -- # '[' -z 3868649 ']' 00:05:25.529 20:55:21 -- common/autotest_common.sh@940 -- # kill -0 3868649 00:05:25.529 20:55:21 -- common/autotest_common.sh@941 -- # uname 00:05:25.529 20:55:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.529 20:55:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3868649 00:05:25.529 20:55:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.529 20:55:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.529 20:55:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3868649' 00:05:25.529 killing process with pid 3868649 00:05:25.529 20:55:21 -- common/autotest_common.sh@955 -- # kill 3868649 00:05:25.529 20:55:21 -- common/autotest_common.sh@960 -- # wait 3868649 00:05:26.095 00:05:26.095 real 0m2.288s 00:05:26.095 user 0m6.500s 00:05:26.095 sys 0m0.510s 00:05:26.095 20:55:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.095 20:55:22 -- common/autotest_common.sh@10 -- # set +x 00:05:26.095 ************************************ 00:05:26.095 END TEST locking_overlapped_coremask 00:05:26.095 ************************************ 00:05:26.095 20:55:22 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:26.095 20:55:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.095 20:55:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.095 20:55:22 -- common/autotest_common.sh@10 -- # set +x 00:05:26.095 ************************************ 00:05:26.095 START TEST locking_overlapped_coremask_via_rpc 00:05:26.095 ************************************ 00:05:26.095 20:55:22 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:26.095 20:55:22 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3868965 00:05:26.095 20:55:22 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:26.095 20:55:22 -- event/cpu_locks.sh@149 -- # waitforlisten 3868965 /var/tmp/spdk.sock 00:05:26.095 20:55:22 -- common/autotest_common.sh@829 -- # '[' -z 3868965 ']' 00:05:26.095 20:55:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.095 20:55:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.095 20:55:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.095 20:55:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.095 20:55:22 -- common/autotest_common.sh@10 -- # set +x 00:05:26.095 [2024-11-27 20:55:22.172569] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.095 [2024-11-27 20:55:22.172668] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3868965 ] 00:05:26.095 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.095 [2024-11-27 20:55:22.233664] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:26.095 [2024-11-27 20:55:22.233710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:26.354 [2024-11-27 20:55:22.347504] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.354 [2024-11-27 20:55:22.347738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:26.354 [2024-11-27 20:55:22.347795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:26.354 [2024-11-27 20:55:22.347813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.919 20:55:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.919 20:55:23 -- common/autotest_common.sh@862 -- # return 0 00:05:26.919 20:55:23 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3869101 00:05:26.919 20:55:23 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:26.919 20:55:23 -- event/cpu_locks.sh@153 -- # waitforlisten 3869101 /var/tmp/spdk2.sock 00:05:26.919 20:55:23 -- common/autotest_common.sh@829 -- # '[' -z 3869101 ']' 00:05:26.919 20:55:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.919 20:55:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.919 20:55:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.919 20:55:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.919 20:55:23 -- common/autotest_common.sh@10 -- # set +x 00:05:27.177 [2024-11-27 20:55:23.170877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.177 [2024-11-27 20:55:23.170975] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3869101 ] 00:05:27.177 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.177 [2024-11-27 20:55:23.261683] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:27.177 [2024-11-27 20:55:23.261723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:27.436 [2024-11-27 20:55:23.477569] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.436 [2024-11-27 20:55:23.477808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:27.436 [2024-11-27 20:55:23.481623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:27.436 [2024-11-27 20:55:23.481626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:28.001 20:55:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.001 20:55:24 -- common/autotest_common.sh@862 -- # return 0 00:05:28.001 20:55:24 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:28.001 20:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.001 20:55:24 -- common/autotest_common.sh@10 -- # set +x 00:05:28.001 20:55:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.001 20:55:24 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.001 20:55:24 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.001 20:55:24 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.001 20:55:24 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:28.001 20:55:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.001 20:55:24 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:28.001 20:55:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.001 20:55:24 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.001 20:55:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.001 20:55:24 -- common/autotest_common.sh@10 -- # set +x 00:05:28.001 [2024-11-27 20:55:24.144643] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3868965 has claimed it. 00:05:28.001 request: 00:05:28.001 { 00:05:28.001 "method": "framework_enable_cpumask_locks", 00:05:28.001 "req_id": 1 00:05:28.001 } 00:05:28.001 Got JSON-RPC error response 00:05:28.001 response: 00:05:28.001 { 00:05:28.001 "code": -32603, 00:05:28.001 "message": "Failed to claim CPU core: 2" 00:05:28.001 } 00:05:28.001 20:55:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:28.001 20:55:24 -- common/autotest_common.sh@653 -- # es=1 00:05:28.001 20:55:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.001 20:55:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.001 20:55:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.001 20:55:24 -- event/cpu_locks.sh@158 -- # waitforlisten 3868965 /var/tmp/spdk.sock 00:05:28.001 20:55:24 -- common/autotest_common.sh@829 -- # '[' -z 3868965 ']' 00:05:28.001 20:55:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.001 20:55:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.001 20:55:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.001 20:55:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.001 20:55:24 -- common/autotest_common.sh@10 -- # set +x 00:05:28.259 20:55:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.259 20:55:24 -- common/autotest_common.sh@862 -- # return 0 00:05:28.259 20:55:24 -- event/cpu_locks.sh@159 -- # waitforlisten 3869101 /var/tmp/spdk2.sock 00:05:28.259 20:55:24 -- common/autotest_common.sh@829 -- # '[' -z 3869101 ']' 00:05:28.259 20:55:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:28.259 20:55:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.259 20:55:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:28.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:28.259 20:55:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.259 20:55:24 -- common/autotest_common.sh@10 -- # set +x 00:05:28.517 20:55:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.517 20:55:24 -- common/autotest_common.sh@862 -- # return 0 00:05:28.517 20:55:24 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:28.517 20:55:24 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:28.517 20:55:24 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:28.517 20:55:24 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:28.517 00:05:28.517 real 0m2.542s 00:05:28.517 user 0m1.280s 00:05:28.517 sys 0m0.195s 00:05:28.517 20:55:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.517 20:55:24 -- common/autotest_common.sh@10 -- # set +x 00:05:28.517 ************************************ 00:05:28.517 END TEST locking_overlapped_coremask_via_rpc 00:05:28.517 ************************************ 00:05:28.517 20:55:24 -- event/cpu_locks.sh@174 -- # cleanup 00:05:28.517 20:55:24 -- event/cpu_locks.sh@15 -- # [[ -z 3868965 ]] 00:05:28.517 20:55:24 -- event/cpu_locks.sh@15 -- # killprocess 3868965 00:05:28.517 20:55:24 -- common/autotest_common.sh@936 -- # '[' -z 3868965 ']' 00:05:28.517 20:55:24 -- common/autotest_common.sh@940 -- # kill -0 3868965 00:05:28.517 20:55:24 -- common/autotest_common.sh@941 -- # uname 00:05:28.517 20:55:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.517 20:55:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3868965 00:05:28.517 20:55:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.517 20:55:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.517 20:55:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3868965' 00:05:28.517 killing process with pid 3868965 00:05:28.517 20:55:24 -- common/autotest_common.sh@955 -- # kill 3868965 00:05:28.517 20:55:24 -- common/autotest_common.sh@960 -- # wait 3868965 00:05:29.083 20:55:25 -- event/cpu_locks.sh@16 -- # [[ -z 3869101 ]] 00:05:29.083 20:55:25 -- event/cpu_locks.sh@16 -- # killprocess 3869101 00:05:29.083 20:55:25 -- common/autotest_common.sh@936 -- # '[' -z 3869101 ']' 00:05:29.083 20:55:25 -- common/autotest_common.sh@940 -- # kill -0 3869101 00:05:29.083 20:55:25 -- common/autotest_common.sh@941 -- # uname 00:05:29.083 20:55:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.083 20:55:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3869101 00:05:29.083 20:55:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:29.083 20:55:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:29.083 20:55:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3869101' 00:05:29.083 killing process with pid 3869101 00:05:29.083 20:55:25 -- common/autotest_common.sh@955 -- # kill 3869101 00:05:29.083 20:55:25 -- common/autotest_common.sh@960 -- # wait 3869101 00:05:29.649 20:55:25 -- event/cpu_locks.sh@18 -- # rm -f 00:05:29.649 20:55:25 -- event/cpu_locks.sh@1 -- # cleanup 00:05:29.649 20:55:25 -- event/cpu_locks.sh@15 -- # [[ -z 3868965 ]] 00:05:29.649 20:55:25 -- event/cpu_locks.sh@15 -- # killprocess 3868965 00:05:29.649 20:55:25 -- common/autotest_common.sh@936 -- # '[' -z 3868965 ']' 00:05:29.649 20:55:25 -- common/autotest_common.sh@940 -- # kill -0 3868965 00:05:29.649 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3868965) - No such process 00:05:29.649 20:55:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3868965 is not found' 00:05:29.649 Process with pid 3868965 is not found 00:05:29.649 20:55:25 -- event/cpu_locks.sh@16 -- # [[ -z 3869101 ]] 00:05:29.649 20:55:25 -- event/cpu_locks.sh@16 -- # killprocess 3869101 00:05:29.649 20:55:25 -- common/autotest_common.sh@936 -- # '[' -z 3869101 ']' 00:05:29.649 20:55:25 -- common/autotest_common.sh@940 -- # kill -0 3869101 00:05:29.649 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3869101) - No such process 00:05:29.649 20:55:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3869101 is not found' 00:05:29.649 Process with pid 3869101 is not found 00:05:29.649 20:55:25 -- event/cpu_locks.sh@18 -- # rm -f 00:05:29.649 00:05:29.649 real 0m20.243s 00:05:29.649 user 0m36.262s 00:05:29.649 sys 0m5.498s 00:05:29.649 20:55:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.649 20:55:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.649 ************************************ 00:05:29.649 END TEST cpu_locks 00:05:29.649 ************************************ 00:05:29.649 00:05:29.649 real 0m47.325s 00:05:29.649 user 1m30.131s 00:05:29.649 sys 0m9.403s 00:05:29.649 20:55:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.649 20:55:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.649 ************************************ 00:05:29.649 END TEST event 00:05:29.649 ************************************ 00:05:29.649 20:55:25 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:29.649 20:55:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.649 20:55:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.649 20:55:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.649 ************************************ 00:05:29.649 START TEST thread 00:05:29.649 ************************************ 00:05:29.649 20:55:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:29.649 * Looking for test storage... 00:05:29.649 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:29.649 20:55:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:29.649 20:55:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:29.649 20:55:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:29.649 20:55:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:29.649 20:55:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:29.649 20:55:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:29.649 20:55:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:29.649 20:55:25 -- scripts/common.sh@335 -- # IFS=.-: 00:05:29.649 20:55:25 -- scripts/common.sh@335 -- # read -ra ver1 00:05:29.649 20:55:25 -- scripts/common.sh@336 -- # IFS=.-: 00:05:29.649 20:55:25 -- scripts/common.sh@336 -- # read -ra ver2 00:05:29.649 20:55:25 -- scripts/common.sh@337 -- # local 'op=<' 00:05:29.649 20:55:25 -- scripts/common.sh@339 -- # ver1_l=2 00:05:29.649 20:55:25 -- scripts/common.sh@340 -- # ver2_l=1 00:05:29.649 20:55:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:29.649 20:55:25 -- scripts/common.sh@343 -- # case "$op" in 00:05:29.649 20:55:25 -- scripts/common.sh@344 -- # : 1 00:05:29.649 20:55:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:29.650 20:55:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:29.650 20:55:25 -- scripts/common.sh@364 -- # decimal 1 00:05:29.650 20:55:25 -- scripts/common.sh@352 -- # local d=1 00:05:29.650 20:55:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:29.650 20:55:25 -- scripts/common.sh@354 -- # echo 1 00:05:29.650 20:55:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:29.650 20:55:25 -- scripts/common.sh@365 -- # decimal 2 00:05:29.650 20:55:25 -- scripts/common.sh@352 -- # local d=2 00:05:29.650 20:55:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:29.650 20:55:25 -- scripts/common.sh@354 -- # echo 2 00:05:29.650 20:55:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:29.650 20:55:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:29.650 20:55:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:29.650 20:55:25 -- scripts/common.sh@367 -- # return 0 00:05:29.650 20:55:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:29.650 20:55:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:29.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.650 --rc genhtml_branch_coverage=1 00:05:29.650 --rc genhtml_function_coverage=1 00:05:29.650 --rc genhtml_legend=1 00:05:29.650 --rc geninfo_all_blocks=1 00:05:29.650 --rc geninfo_unexecuted_blocks=1 00:05:29.650 00:05:29.650 ' 00:05:29.650 20:55:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:29.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.650 --rc genhtml_branch_coverage=1 00:05:29.650 --rc genhtml_function_coverage=1 00:05:29.650 --rc genhtml_legend=1 00:05:29.650 --rc geninfo_all_blocks=1 00:05:29.650 --rc geninfo_unexecuted_blocks=1 00:05:29.650 00:05:29.650 ' 00:05:29.650 20:55:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:29.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.650 --rc genhtml_branch_coverage=1 00:05:29.650 --rc genhtml_function_coverage=1 00:05:29.650 --rc genhtml_legend=1 00:05:29.650 --rc geninfo_all_blocks=1 00:05:29.650 --rc geninfo_unexecuted_blocks=1 00:05:29.650 00:05:29.650 ' 00:05:29.650 20:55:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:29.650 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:29.650 --rc genhtml_branch_coverage=1 00:05:29.650 --rc genhtml_function_coverage=1 00:05:29.650 --rc genhtml_legend=1 00:05:29.650 --rc geninfo_all_blocks=1 00:05:29.650 --rc geninfo_unexecuted_blocks=1 00:05:29.650 00:05:29.650 ' 00:05:29.650 20:55:25 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:29.650 20:55:25 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:29.650 20:55:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.650 20:55:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.650 ************************************ 00:05:29.650 START TEST thread_poller_perf 00:05:29.650 ************************************ 00:05:29.650 20:55:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:29.650 [2024-11-27 20:55:25.879452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.650 [2024-11-27 20:55:25.879547] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3869481 ] 00:05:29.908 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.908 [2024-11-27 20:55:25.941785] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.908 [2024-11-27 20:55:26.057244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.908 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:31.336 [2024-11-27T19:55:27.577Z] ====================================== 00:05:31.336 [2024-11-27T19:55:27.577Z] busy:2711000901 (cyc) 00:05:31.336 [2024-11-27T19:55:27.577Z] total_run_count: 283000 00:05:31.336 [2024-11-27T19:55:27.577Z] tsc_hz: 2700000000 (cyc) 00:05:31.336 [2024-11-27T19:55:27.577Z] ====================================== 00:05:31.336 [2024-11-27T19:55:27.577Z] poller_cost: 9579 (cyc), 3547 (nsec) 00:05:31.336 00:05:31.336 real 0m1.324s 00:05:31.336 user 0m1.230s 00:05:31.336 sys 0m0.087s 00:05:31.336 20:55:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.336 20:55:27 -- common/autotest_common.sh@10 -- # set +x 00:05:31.336 ************************************ 00:05:31.336 END TEST thread_poller_perf 00:05:31.336 ************************************ 00:05:31.336 20:55:27 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:31.336 20:55:27 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:31.336 20:55:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.336 20:55:27 -- common/autotest_common.sh@10 -- # set +x 00:05:31.336 ************************************ 00:05:31.336 START TEST thread_poller_perf 00:05:31.336 ************************************ 00:05:31.336 20:55:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:31.336 [2024-11-27 20:55:27.226430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.336 [2024-11-27 20:55:27.226510] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3869643 ] 00:05:31.336 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.336 [2024-11-27 20:55:27.292047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.336 [2024-11-27 20:55:27.407280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.336 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:32.292 [2024-11-27T19:55:28.533Z] ====================================== 00:05:32.292 [2024-11-27T19:55:28.533Z] busy:2703370836 (cyc) 00:05:32.292 [2024-11-27T19:55:28.533Z] total_run_count: 3844000 00:05:32.292 [2024-11-27T19:55:28.533Z] tsc_hz: 2700000000 (cyc) 00:05:32.292 [2024-11-27T19:55:28.533Z] ====================================== 00:05:32.292 [2024-11-27T19:55:28.533Z] poller_cost: 703 (cyc), 260 (nsec) 00:05:32.292 00:05:32.292 real 0m1.316s 00:05:32.292 user 0m1.222s 00:05:32.292 sys 0m0.086s 00:05:32.292 20:55:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.292 20:55:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.292 ************************************ 00:05:32.292 END TEST thread_poller_perf 00:05:32.292 ************************************ 00:05:32.550 20:55:28 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:32.550 00:05:32.550 real 0m2.826s 00:05:32.550 user 0m2.572s 00:05:32.550 sys 0m0.258s 00:05:32.550 20:55:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.550 20:55:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.550 ************************************ 00:05:32.550 END TEST thread 00:05:32.550 ************************************ 00:05:32.550 20:55:28 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:32.550 20:55:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.550 20:55:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.550 20:55:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.550 ************************************ 00:05:32.550 START TEST accel 00:05:32.550 ************************************ 00:05:32.550 20:55:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:32.550 * Looking for test storage... 00:05:32.550 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:32.550 20:55:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:32.550 20:55:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:32.550 20:55:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:32.550 20:55:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:32.550 20:55:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:32.550 20:55:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:32.550 20:55:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:32.550 20:55:28 -- scripts/common.sh@335 -- # IFS=.-: 00:05:32.550 20:55:28 -- scripts/common.sh@335 -- # read -ra ver1 00:05:32.550 20:55:28 -- scripts/common.sh@336 -- # IFS=.-: 00:05:32.550 20:55:28 -- scripts/common.sh@336 -- # read -ra ver2 00:05:32.550 20:55:28 -- scripts/common.sh@337 -- # local 'op=<' 00:05:32.550 20:55:28 -- scripts/common.sh@339 -- # ver1_l=2 00:05:32.550 20:55:28 -- scripts/common.sh@340 -- # ver2_l=1 00:05:32.550 20:55:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:32.550 20:55:28 -- scripts/common.sh@343 -- # case "$op" in 00:05:32.550 20:55:28 -- scripts/common.sh@344 -- # : 1 00:05:32.550 20:55:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:32.550 20:55:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:32.550 20:55:28 -- scripts/common.sh@364 -- # decimal 1 00:05:32.550 20:55:28 -- scripts/common.sh@352 -- # local d=1 00:05:32.550 20:55:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:32.550 20:55:28 -- scripts/common.sh@354 -- # echo 1 00:05:32.550 20:55:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:32.550 20:55:28 -- scripts/common.sh@365 -- # decimal 2 00:05:32.550 20:55:28 -- scripts/common.sh@352 -- # local d=2 00:05:32.550 20:55:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:32.550 20:55:28 -- scripts/common.sh@354 -- # echo 2 00:05:32.550 20:55:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:32.550 20:55:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:32.550 20:55:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:32.550 20:55:28 -- scripts/common.sh@367 -- # return 0 00:05:32.550 20:55:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:32.550 20:55:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:32.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.550 --rc genhtml_branch_coverage=1 00:05:32.550 --rc genhtml_function_coverage=1 00:05:32.550 --rc genhtml_legend=1 00:05:32.550 --rc geninfo_all_blocks=1 00:05:32.550 --rc geninfo_unexecuted_blocks=1 00:05:32.550 00:05:32.550 ' 00:05:32.550 20:55:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:32.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.550 --rc genhtml_branch_coverage=1 00:05:32.550 --rc genhtml_function_coverage=1 00:05:32.550 --rc genhtml_legend=1 00:05:32.550 --rc geninfo_all_blocks=1 00:05:32.550 --rc geninfo_unexecuted_blocks=1 00:05:32.550 00:05:32.551 ' 00:05:32.551 20:55:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:32.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.551 --rc genhtml_branch_coverage=1 00:05:32.551 --rc genhtml_function_coverage=1 00:05:32.551 --rc genhtml_legend=1 00:05:32.551 --rc geninfo_all_blocks=1 00:05:32.551 --rc geninfo_unexecuted_blocks=1 00:05:32.551 00:05:32.551 ' 00:05:32.551 20:55:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:32.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.551 --rc genhtml_branch_coverage=1 00:05:32.551 --rc genhtml_function_coverage=1 00:05:32.551 --rc genhtml_legend=1 00:05:32.551 --rc geninfo_all_blocks=1 00:05:32.551 --rc geninfo_unexecuted_blocks=1 00:05:32.551 00:05:32.551 ' 00:05:32.551 20:55:28 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:32.551 20:55:28 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:32.551 20:55:28 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:32.551 20:55:28 -- accel/accel.sh@59 -- # spdk_tgt_pid=3869965 00:05:32.551 20:55:28 -- accel/accel.sh@60 -- # waitforlisten 3869965 00:05:32.551 20:55:28 -- common/autotest_common.sh@829 -- # '[' -z 3869965 ']' 00:05:32.551 20:55:28 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:32.551 20:55:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.551 20:55:28 -- accel/accel.sh@58 -- # build_accel_config 00:05:32.551 20:55:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.551 20:55:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.551 20:55:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.551 20:55:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.551 20:55:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.551 20:55:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.551 20:55:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.551 20:55:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.551 20:55:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.551 20:55:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.551 20:55:28 -- accel/accel.sh@42 -- # jq -r . 00:05:32.551 [2024-11-27 20:55:28.763350] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.551 [2024-11-27 20:55:28.763432] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3869965 ] 00:05:32.551 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.810 [2024-11-27 20:55:28.819849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.810 [2024-11-27 20:55:28.925176] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:32.810 [2024-11-27 20:55:28.925351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.743 20:55:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:33.743 20:55:29 -- common/autotest_common.sh@862 -- # return 0 00:05:33.743 20:55:29 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:33.743 20:55:29 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:33.743 20:55:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:33.743 20:55:29 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:33.743 20:55:29 -- common/autotest_common.sh@10 -- # set +x 00:05:33.743 20:55:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # IFS== 00:05:33.743 20:55:29 -- accel/accel.sh@64 -- # read -r opc module 00:05:33.743 20:55:29 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:33.743 20:55:29 -- accel/accel.sh@67 -- # killprocess 3869965 00:05:33.743 20:55:29 -- common/autotest_common.sh@936 -- # '[' -z 3869965 ']' 00:05:33.743 20:55:29 -- common/autotest_common.sh@940 -- # kill -0 3869965 00:05:33.743 20:55:29 -- common/autotest_common.sh@941 -- # uname 00:05:33.743 20:55:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:33.743 20:55:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3869965 00:05:33.743 20:55:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:33.743 20:55:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:33.743 20:55:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3869965' 00:05:33.743 killing process with pid 3869965 00:05:33.743 20:55:29 -- common/autotest_common.sh@955 -- # kill 3869965 00:05:33.743 20:55:29 -- common/autotest_common.sh@960 -- # wait 3869965 00:05:34.309 20:55:30 -- accel/accel.sh@68 -- # trap - ERR 00:05:34.309 20:55:30 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:34.309 20:55:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:34.309 20:55:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.309 20:55:30 -- common/autotest_common.sh@10 -- # set +x 00:05:34.309 20:55:30 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:34.309 20:55:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:34.309 20:55:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.309 20:55:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.309 20:55:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.309 20:55:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.309 20:55:30 -- accel/accel.sh@42 -- # jq -r . 00:05:34.309 20:55:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.309 20:55:30 -- common/autotest_common.sh@10 -- # set +x 00:05:34.309 20:55:30 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:34.309 20:55:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:34.309 20:55:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.309 20:55:30 -- common/autotest_common.sh@10 -- # set +x 00:05:34.309 ************************************ 00:05:34.309 START TEST accel_missing_filename 00:05:34.309 ************************************ 00:05:34.309 20:55:30 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:34.309 20:55:30 -- common/autotest_common.sh@650 -- # local es=0 00:05:34.309 20:55:30 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:34.309 20:55:30 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:34.309 20:55:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.309 20:55:30 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:34.309 20:55:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.309 20:55:30 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:34.309 20:55:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:34.309 20:55:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.309 20:55:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.309 20:55:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.309 20:55:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.309 20:55:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.309 20:55:30 -- accel/accel.sh@42 -- # jq -r . 00:05:34.309 [2024-11-27 20:55:30.357578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.309 [2024-11-27 20:55:30.357650] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870153 ] 00:05:34.309 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.309 [2024-11-27 20:55:30.422832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.309 [2024-11-27 20:55:30.539423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.568 [2024-11-27 20:55:30.601457] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:34.568 [2024-11-27 20:55:30.684699] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:34.568 A filename is required. 00:05:34.568 20:55:30 -- common/autotest_common.sh@653 -- # es=234 00:05:34.568 20:55:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:34.568 20:55:30 -- common/autotest_common.sh@662 -- # es=106 00:05:34.568 20:55:30 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:34.568 20:55:30 -- common/autotest_common.sh@670 -- # es=1 00:05:34.568 20:55:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:34.568 00:05:34.568 real 0m0.470s 00:05:34.568 user 0m0.359s 00:05:34.568 sys 0m0.147s 00:05:34.568 20:55:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.568 20:55:30 -- common/autotest_common.sh@10 -- # set +x 00:05:34.568 ************************************ 00:05:34.568 END TEST accel_missing_filename 00:05:34.568 ************************************ 00:05:34.826 20:55:30 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.826 20:55:30 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:34.826 20:55:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.826 20:55:30 -- common/autotest_common.sh@10 -- # set +x 00:05:34.826 ************************************ 00:05:34.826 START TEST accel_compress_verify 00:05:34.826 ************************************ 00:05:34.826 20:55:30 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.826 20:55:30 -- common/autotest_common.sh@650 -- # local es=0 00:05:34.826 20:55:30 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.826 20:55:30 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:34.826 20:55:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.826 20:55:30 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:34.826 20:55:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.826 20:55:30 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.826 20:55:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.826 20:55:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.826 20:55:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.826 20:55:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.826 20:55:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.826 20:55:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.826 20:55:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.826 20:55:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.826 20:55:30 -- accel/accel.sh@42 -- # jq -r . 00:05:34.826 [2024-11-27 20:55:30.853306] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.826 [2024-11-27 20:55:30.853392] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870276 ] 00:05:34.826 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.826 [2024-11-27 20:55:30.916896] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.826 [2024-11-27 20:55:31.033762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.084 [2024-11-27 20:55:31.095780] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.084 [2024-11-27 20:55:31.171641] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:35.084 00:05:35.084 Compression does not support the verify option, aborting. 00:05:35.084 20:55:31 -- common/autotest_common.sh@653 -- # es=161 00:05:35.085 20:55:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.085 20:55:31 -- common/autotest_common.sh@662 -- # es=33 00:05:35.085 20:55:31 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:35.085 20:55:31 -- common/autotest_common.sh@670 -- # es=1 00:05:35.085 20:55:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.085 00:05:35.085 real 0m0.458s 00:05:35.085 user 0m0.348s 00:05:35.085 sys 0m0.143s 00:05:35.085 20:55:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.085 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.085 ************************************ 00:05:35.085 END TEST accel_compress_verify 00:05:35.085 ************************************ 00:05:35.085 20:55:31 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:35.085 20:55:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.085 20:55:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.085 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.085 ************************************ 00:05:35.085 START TEST accel_wrong_workload 00:05:35.085 ************************************ 00:05:35.085 20:55:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:35.085 20:55:31 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.085 20:55:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:35.085 20:55:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.085 20:55:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.085 20:55:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.085 20:55:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.085 20:55:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:35.085 20:55:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:35.085 20:55:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.085 20:55:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.085 20:55:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.085 20:55:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.085 20:55:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.085 20:55:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.085 20:55:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.085 20:55:31 -- accel/accel.sh@42 -- # jq -r . 00:05:35.343 Unsupported workload type: foobar 00:05:35.343 [2024-11-27 20:55:31.337588] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:35.343 accel_perf options: 00:05:35.343 [-h help message] 00:05:35.343 [-q queue depth per core] 00:05:35.343 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:35.343 [-T number of threads per core 00:05:35.343 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:35.343 [-t time in seconds] 00:05:35.343 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:35.343 [ dif_verify, , dif_generate, dif_generate_copy 00:05:35.343 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:35.343 [-l for compress/decompress workloads, name of uncompressed input file 00:05:35.343 [-S for crc32c workload, use this seed value (default 0) 00:05:35.344 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:35.344 [-f for fill workload, use this BYTE value (default 255) 00:05:35.344 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:35.344 [-y verify result if this switch is on] 00:05:35.344 [-a tasks to allocate per core (default: same value as -q)] 00:05:35.344 Can be used to spread operations across a wider range of memory. 00:05:35.344 20:55:31 -- common/autotest_common.sh@653 -- # es=1 00:05:35.344 20:55:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.344 20:55:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:35.344 20:55:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.344 00:05:35.344 real 0m0.024s 00:05:35.344 user 0m0.015s 00:05:35.344 sys 0m0.008s 00:05:35.344 20:55:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.344 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.344 ************************************ 00:05:35.344 END TEST accel_wrong_workload 00:05:35.344 ************************************ 00:05:35.344 Error: writing output failed: Broken pipe 00:05:35.344 20:55:31 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:35.344 20:55:31 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:35.344 20:55:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.344 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.344 ************************************ 00:05:35.344 START TEST accel_negative_buffers 00:05:35.344 ************************************ 00:05:35.344 20:55:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:35.344 20:55:31 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.344 20:55:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:35.344 20:55:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.344 20:55:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.344 20:55:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.344 20:55:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.344 20:55:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:35.344 20:55:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:35.344 20:55:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.344 20:55:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.344 20:55:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.344 20:55:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.344 20:55:31 -- accel/accel.sh@42 -- # jq -r . 00:05:35.344 -x option must be non-negative. 00:05:35.344 [2024-11-27 20:55:31.385468] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:35.344 accel_perf options: 00:05:35.344 [-h help message] 00:05:35.344 [-q queue depth per core] 00:05:35.344 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:35.344 [-T number of threads per core 00:05:35.344 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:35.344 [-t time in seconds] 00:05:35.344 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:35.344 [ dif_verify, , dif_generate, dif_generate_copy 00:05:35.344 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:35.344 [-l for compress/decompress workloads, name of uncompressed input file 00:05:35.344 [-S for crc32c workload, use this seed value (default 0) 00:05:35.344 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:35.344 [-f for fill workload, use this BYTE value (default 255) 00:05:35.344 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:35.344 [-y verify result if this switch is on] 00:05:35.344 [-a tasks to allocate per core (default: same value as -q)] 00:05:35.344 Can be used to spread operations across a wider range of memory. 00:05:35.344 20:55:31 -- common/autotest_common.sh@653 -- # es=1 00:05:35.344 20:55:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.344 20:55:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:35.344 20:55:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.344 00:05:35.344 real 0m0.022s 00:05:35.344 user 0m0.015s 00:05:35.344 sys 0m0.006s 00:05:35.344 20:55:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.344 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.344 ************************************ 00:05:35.344 END TEST accel_negative_buffers 00:05:35.344 ************************************ 00:05:35.344 Error: writing output failed: Broken pipe 00:05:35.344 20:55:31 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:35.344 20:55:31 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:35.344 20:55:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.344 20:55:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.344 ************************************ 00:05:35.344 START TEST accel_crc32c 00:05:35.344 ************************************ 00:05:35.344 20:55:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:35.344 20:55:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.344 20:55:31 -- accel/accel.sh@17 -- # local accel_module 00:05:35.344 20:55:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:35.344 20:55:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:35.344 20:55:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.344 20:55:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.344 20:55:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.344 20:55:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.344 20:55:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.344 20:55:31 -- accel/accel.sh@42 -- # jq -r . 00:05:35.344 [2024-11-27 20:55:31.435080] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.344 [2024-11-27 20:55:31.435162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870360 ] 00:05:35.344 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.344 [2024-11-27 20:55:31.498471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.603 [2024-11-27 20:55:31.617149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.977 20:55:32 -- accel/accel.sh@18 -- # out=' 00:05:36.977 SPDK Configuration: 00:05:36.977 Core mask: 0x1 00:05:36.977 00:05:36.977 Accel Perf Configuration: 00:05:36.977 Workload Type: crc32c 00:05:36.977 CRC-32C seed: 32 00:05:36.977 Transfer size: 4096 bytes 00:05:36.977 Vector count 1 00:05:36.977 Module: software 00:05:36.977 Queue depth: 32 00:05:36.977 Allocate depth: 32 00:05:36.977 # threads/core: 1 00:05:36.977 Run time: 1 seconds 00:05:36.977 Verify: Yes 00:05:36.977 00:05:36.977 Running for 1 seconds... 00:05:36.977 00:05:36.977 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.977 ------------------------------------------------------------------------------------ 00:05:36.977 0,0 406944/s 1589 MiB/s 0 0 00:05:36.977 ==================================================================================== 00:05:36.977 Total 406944/s 1589 MiB/s 0 0' 00:05:36.977 20:55:32 -- accel/accel.sh@20 -- # IFS=: 00:05:36.977 20:55:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:36.977 20:55:32 -- accel/accel.sh@20 -- # read -r var val 00:05:36.977 20:55:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:36.977 20:55:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.977 20:55:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.977 20:55:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.977 20:55:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.977 20:55:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.977 20:55:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.977 20:55:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.977 20:55:32 -- accel/accel.sh@42 -- # jq -r . 00:05:36.977 [2024-11-27 20:55:32.916144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.978 [2024-11-27 20:55:32.916223] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870498 ] 00:05:36.978 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.978 [2024-11-27 20:55:32.977413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.978 [2024-11-27 20:55:33.101579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=0x1 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=crc32c 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=32 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=software 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=32 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=32 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=1 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val=Yes 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.978 20:55:33 -- accel/accel.sh@21 -- # val= 00:05:36.978 20:55:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.978 20:55:33 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@21 -- # val= 00:05:38.352 20:55:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # IFS=: 00:05:38.352 20:55:34 -- accel/accel.sh@20 -- # read -r var val 00:05:38.352 20:55:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:38.352 20:55:34 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:38.352 20:55:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:38.352 00:05:38.352 real 0m2.959s 00:05:38.352 user 0m2.657s 00:05:38.352 sys 0m0.296s 00:05:38.352 20:55:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.352 20:55:34 -- common/autotest_common.sh@10 -- # set +x 00:05:38.352 ************************************ 00:05:38.352 END TEST accel_crc32c 00:05:38.352 ************************************ 00:05:38.352 20:55:34 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:38.352 20:55:34 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:38.352 20:55:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.352 20:55:34 -- common/autotest_common.sh@10 -- # set +x 00:05:38.352 ************************************ 00:05:38.352 START TEST accel_crc32c_C2 00:05:38.352 ************************************ 00:05:38.352 20:55:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:38.352 20:55:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:38.352 20:55:34 -- accel/accel.sh@17 -- # local accel_module 00:05:38.352 20:55:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:38.352 20:55:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:38.352 20:55:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.352 20:55:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.352 20:55:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.352 20:55:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.352 20:55:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.352 20:55:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.352 20:55:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.352 20:55:34 -- accel/accel.sh@42 -- # jq -r . 00:05:38.352 [2024-11-27 20:55:34.421869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.352 [2024-11-27 20:55:34.421949] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870778 ] 00:05:38.352 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.352 [2024-11-27 20:55:34.484317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.611 [2024-11-27 20:55:34.601992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.983 20:55:35 -- accel/accel.sh@18 -- # out=' 00:05:39.983 SPDK Configuration: 00:05:39.983 Core mask: 0x1 00:05:39.983 00:05:39.983 Accel Perf Configuration: 00:05:39.983 Workload Type: crc32c 00:05:39.983 CRC-32C seed: 0 00:05:39.983 Transfer size: 4096 bytes 00:05:39.983 Vector count 2 00:05:39.983 Module: software 00:05:39.983 Queue depth: 32 00:05:39.983 Allocate depth: 32 00:05:39.983 # threads/core: 1 00:05:39.983 Run time: 1 seconds 00:05:39.983 Verify: Yes 00:05:39.983 00:05:39.983 Running for 1 seconds... 00:05:39.983 00:05:39.983 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.983 ------------------------------------------------------------------------------------ 00:05:39.983 0,0 312992/s 2445 MiB/s 0 0 00:05:39.983 ==================================================================================== 00:05:39.983 Total 312992/s 1222 MiB/s 0 0' 00:05:39.983 20:55:35 -- accel/accel.sh@20 -- # IFS=: 00:05:39.983 20:55:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.983 20:55:35 -- accel/accel.sh@20 -- # read -r var val 00:05:39.983 20:55:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.983 20:55:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.983 20:55:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.983 20:55:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.983 20:55:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.983 20:55:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.983 20:55:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.983 20:55:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.983 20:55:35 -- accel/accel.sh@42 -- # jq -r . 00:05:39.983 [2024-11-27 20:55:35.881512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.983 [2024-11-27 20:55:35.881600] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3870926 ] 00:05:39.983 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.983 [2024-11-27 20:55:35.942422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.983 [2024-11-27 20:55:36.059032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.983 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.983 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.983 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.983 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.983 20:55:36 -- accel/accel.sh@21 -- # val=0x1 00:05:39.983 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.983 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.983 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.983 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=crc32c 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=0 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=software 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=32 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=32 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=1 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val=Yes 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.984 20:55:36 -- accel/accel.sh@21 -- # val= 00:05:39.984 20:55:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.984 20:55:36 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@21 -- # val= 00:05:41.357 20:55:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # IFS=: 00:05:41.357 20:55:37 -- accel/accel.sh@20 -- # read -r var val 00:05:41.357 20:55:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.357 20:55:37 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:41.357 20:55:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.357 00:05:41.357 real 0m2.934s 00:05:41.357 user 0m2.642s 00:05:41.357 sys 0m0.284s 00:05:41.357 20:55:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.357 20:55:37 -- common/autotest_common.sh@10 -- # set +x 00:05:41.357 ************************************ 00:05:41.357 END TEST accel_crc32c_C2 00:05:41.357 ************************************ 00:05:41.357 20:55:37 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:41.357 20:55:37 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:41.357 20:55:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.357 20:55:37 -- common/autotest_common.sh@10 -- # set +x 00:05:41.357 ************************************ 00:05:41.357 START TEST accel_copy 00:05:41.357 ************************************ 00:05:41.357 20:55:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:41.357 20:55:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.357 20:55:37 -- accel/accel.sh@17 -- # local accel_module 00:05:41.357 20:55:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:41.357 20:55:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:41.357 20:55:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.357 20:55:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.357 20:55:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.357 20:55:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.358 20:55:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.358 20:55:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.358 20:55:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.358 20:55:37 -- accel/accel.sh@42 -- # jq -r . 00:05:41.358 [2024-11-27 20:55:37.377848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.358 [2024-11-27 20:55:37.377931] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871087 ] 00:05:41.358 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.358 [2024-11-27 20:55:37.440403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.358 [2024-11-27 20:55:37.561181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.731 20:55:38 -- accel/accel.sh@18 -- # out=' 00:05:42.731 SPDK Configuration: 00:05:42.731 Core mask: 0x1 00:05:42.731 00:05:42.731 Accel Perf Configuration: 00:05:42.731 Workload Type: copy 00:05:42.731 Transfer size: 4096 bytes 00:05:42.731 Vector count 1 00:05:42.731 Module: software 00:05:42.731 Queue depth: 32 00:05:42.731 Allocate depth: 32 00:05:42.731 # threads/core: 1 00:05:42.731 Run time: 1 seconds 00:05:42.731 Verify: Yes 00:05:42.731 00:05:42.731 Running for 1 seconds... 00:05:42.731 00:05:42.731 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.731 ------------------------------------------------------------------------------------ 00:05:42.731 0,0 278752/s 1088 MiB/s 0 0 00:05:42.731 ==================================================================================== 00:05:42.731 Total 278752/s 1088 MiB/s 0 0' 00:05:42.731 20:55:38 -- accel/accel.sh@20 -- # IFS=: 00:05:42.731 20:55:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:42.731 20:55:38 -- accel/accel.sh@20 -- # read -r var val 00:05:42.731 20:55:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:42.731 20:55:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.731 20:55:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.731 20:55:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.731 20:55:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.731 20:55:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.731 20:55:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.731 20:55:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.731 20:55:38 -- accel/accel.sh@42 -- # jq -r . 00:05:42.732 [2024-11-27 20:55:38.851041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.732 [2024-11-27 20:55:38.851122] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871344 ] 00:05:42.732 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.732 [2024-11-27 20:55:38.912271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.989 [2024-11-27 20:55:39.028629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val=0x1 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val=copy 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.989 20:55:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.989 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.989 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val=software 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val=32 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val=32 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val=1 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val=Yes 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.990 20:55:39 -- accel/accel.sh@21 -- # val= 00:05:42.990 20:55:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.990 20:55:39 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@21 -- # val= 00:05:44.362 20:55:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # IFS=: 00:05:44.362 20:55:40 -- accel/accel.sh@20 -- # read -r var val 00:05:44.362 20:55:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.362 20:55:40 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:44.362 20:55:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.362 00:05:44.362 real 0m2.950s 00:05:44.362 user 0m2.650s 00:05:44.362 sys 0m0.291s 00:05:44.362 20:55:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.362 20:55:40 -- common/autotest_common.sh@10 -- # set +x 00:05:44.362 ************************************ 00:05:44.362 END TEST accel_copy 00:05:44.362 ************************************ 00:05:44.362 20:55:40 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.362 20:55:40 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:44.362 20:55:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.362 20:55:40 -- common/autotest_common.sh@10 -- # set +x 00:05:44.362 ************************************ 00:05:44.362 START TEST accel_fill 00:05:44.362 ************************************ 00:05:44.362 20:55:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.362 20:55:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.362 20:55:40 -- accel/accel.sh@17 -- # local accel_module 00:05:44.362 20:55:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.362 20:55:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.362 20:55:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.362 20:55:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.362 20:55:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.362 20:55:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.362 20:55:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.362 20:55:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.362 20:55:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.362 20:55:40 -- accel/accel.sh@42 -- # jq -r . 00:05:44.362 [2024-11-27 20:55:40.352478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.362 [2024-11-27 20:55:40.352567] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871511 ] 00:05:44.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.362 [2024-11-27 20:55:40.415933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.362 [2024-11-27 20:55:40.536799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.734 20:55:41 -- accel/accel.sh@18 -- # out=' 00:05:45.734 SPDK Configuration: 00:05:45.734 Core mask: 0x1 00:05:45.734 00:05:45.734 Accel Perf Configuration: 00:05:45.734 Workload Type: fill 00:05:45.734 Fill pattern: 0x80 00:05:45.734 Transfer size: 4096 bytes 00:05:45.734 Vector count 1 00:05:45.734 Module: software 00:05:45.734 Queue depth: 64 00:05:45.734 Allocate depth: 64 00:05:45.734 # threads/core: 1 00:05:45.734 Run time: 1 seconds 00:05:45.734 Verify: Yes 00:05:45.734 00:05:45.734 Running for 1 seconds... 00:05:45.734 00:05:45.734 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.734 ------------------------------------------------------------------------------------ 00:05:45.734 0,0 406016/s 1586 MiB/s 0 0 00:05:45.734 ==================================================================================== 00:05:45.734 Total 406016/s 1586 MiB/s 0 0' 00:05:45.734 20:55:41 -- accel/accel.sh@20 -- # IFS=: 00:05:45.734 20:55:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.734 20:55:41 -- accel/accel.sh@20 -- # read -r var val 00:05:45.734 20:55:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.734 20:55:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.734 20:55:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.734 20:55:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.734 20:55:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.734 20:55:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.734 20:55:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.734 20:55:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.734 20:55:41 -- accel/accel.sh@42 -- # jq -r . 00:05:45.734 [2024-11-27 20:55:41.840360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.734 [2024-11-27 20:55:41.840449] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871653 ] 00:05:45.734 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.734 [2024-11-27 20:55:41.902607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.993 [2024-11-27 20:55:42.023532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val=0x1 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val=fill 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val=0x80 00:05:45.993 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.993 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.993 20:55:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val=software 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val=64 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val=64 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val=1 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val=Yes 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.994 20:55:42 -- accel/accel.sh@21 -- # val= 00:05:45.994 20:55:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.994 20:55:42 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@21 -- # val= 00:05:47.366 20:55:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # IFS=: 00:05:47.366 20:55:43 -- accel/accel.sh@20 -- # read -r var val 00:05:47.366 20:55:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.366 20:55:43 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:47.366 20:55:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.366 00:05:47.366 real 0m2.973s 00:05:47.366 user 0m2.672s 00:05:47.366 sys 0m0.293s 00:05:47.366 20:55:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.366 20:55:43 -- common/autotest_common.sh@10 -- # set +x 00:05:47.366 ************************************ 00:05:47.366 END TEST accel_fill 00:05:47.366 ************************************ 00:05:47.366 20:55:43 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:47.366 20:55:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:47.366 20:55:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.366 20:55:43 -- common/autotest_common.sh@10 -- # set +x 00:05:47.366 ************************************ 00:05:47.366 START TEST accel_copy_crc32c 00:05:47.366 ************************************ 00:05:47.366 20:55:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:47.366 20:55:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.366 20:55:43 -- accel/accel.sh@17 -- # local accel_module 00:05:47.366 20:55:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:47.366 20:55:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:47.366 20:55:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.366 20:55:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.366 20:55:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.366 20:55:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.366 20:55:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.366 20:55:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.366 20:55:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.366 20:55:43 -- accel/accel.sh@42 -- # jq -r . 00:05:47.366 [2024-11-27 20:55:43.349092] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.366 [2024-11-27 20:55:43.349173] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871933 ] 00:05:47.366 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.366 [2024-11-27 20:55:43.414439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.366 [2024-11-27 20:55:43.535355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.738 20:55:44 -- accel/accel.sh@18 -- # out=' 00:05:48.738 SPDK Configuration: 00:05:48.738 Core mask: 0x1 00:05:48.738 00:05:48.738 Accel Perf Configuration: 00:05:48.738 Workload Type: copy_crc32c 00:05:48.738 CRC-32C seed: 0 00:05:48.738 Vector size: 4096 bytes 00:05:48.738 Transfer size: 4096 bytes 00:05:48.738 Vector count 1 00:05:48.738 Module: software 00:05:48.738 Queue depth: 32 00:05:48.738 Allocate depth: 32 00:05:48.738 # threads/core: 1 00:05:48.738 Run time: 1 seconds 00:05:48.738 Verify: Yes 00:05:48.738 00:05:48.738 Running for 1 seconds... 00:05:48.738 00:05:48.738 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.738 ------------------------------------------------------------------------------------ 00:05:48.738 0,0 218304/s 852 MiB/s 0 0 00:05:48.738 ==================================================================================== 00:05:48.738 Total 218304/s 852 MiB/s 0 0' 00:05:48.738 20:55:44 -- accel/accel.sh@20 -- # IFS=: 00:05:48.738 20:55:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:48.738 20:55:44 -- accel/accel.sh@20 -- # read -r var val 00:05:48.738 20:55:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:48.738 20:55:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.738 20:55:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.738 20:55:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.739 20:55:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.739 20:55:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.739 20:55:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.739 20:55:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.739 20:55:44 -- accel/accel.sh@42 -- # jq -r . 00:05:48.739 [2024-11-27 20:55:44.838946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.739 [2024-11-27 20:55:44.839026] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872075 ] 00:05:48.739 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.739 [2024-11-27 20:55:44.901608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.997 [2024-11-27 20:55:45.020998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.997 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.997 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.997 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.997 20:55:45 -- accel/accel.sh@21 -- # val=0x1 00:05:48.997 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.997 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=0 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=software 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=32 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=32 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=1 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val=Yes 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.998 20:55:45 -- accel/accel.sh@21 -- # val= 00:05:48.998 20:55:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.998 20:55:45 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@21 -- # val= 00:05:50.372 20:55:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # IFS=: 00:05:50.372 20:55:46 -- accel/accel.sh@20 -- # read -r var val 00:05:50.372 20:55:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.372 20:55:46 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:50.372 20:55:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.372 00:05:50.372 real 0m2.975s 00:05:50.372 user 0m2.672s 00:05:50.372 sys 0m0.296s 00:05:50.372 20:55:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.372 20:55:46 -- common/autotest_common.sh@10 -- # set +x 00:05:50.372 ************************************ 00:05:50.372 END TEST accel_copy_crc32c 00:05:50.372 ************************************ 00:05:50.372 20:55:46 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:50.372 20:55:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:50.372 20:55:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.372 20:55:46 -- common/autotest_common.sh@10 -- # set +x 00:05:50.372 ************************************ 00:05:50.372 START TEST accel_copy_crc32c_C2 00:05:50.372 ************************************ 00:05:50.372 20:55:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:50.372 20:55:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.372 20:55:46 -- accel/accel.sh@17 -- # local accel_module 00:05:50.372 20:55:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:50.372 20:55:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:50.372 20:55:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.372 20:55:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.372 20:55:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.372 20:55:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.372 20:55:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.372 20:55:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.372 20:55:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.372 20:55:46 -- accel/accel.sh@42 -- # jq -r . 00:05:50.372 [2024-11-27 20:55:46.358847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.372 [2024-11-27 20:55:46.358939] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872242 ] 00:05:50.372 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.372 [2024-11-27 20:55:46.421208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.372 [2024-11-27 20:55:46.541512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.747 20:55:47 -- accel/accel.sh@18 -- # out=' 00:05:51.747 SPDK Configuration: 00:05:51.747 Core mask: 0x1 00:05:51.747 00:05:51.747 Accel Perf Configuration: 00:05:51.747 Workload Type: copy_crc32c 00:05:51.747 CRC-32C seed: 0 00:05:51.747 Vector size: 4096 bytes 00:05:51.747 Transfer size: 8192 bytes 00:05:51.747 Vector count 2 00:05:51.747 Module: software 00:05:51.747 Queue depth: 32 00:05:51.747 Allocate depth: 32 00:05:51.747 # threads/core: 1 00:05:51.747 Run time: 1 seconds 00:05:51.747 Verify: Yes 00:05:51.747 00:05:51.747 Running for 1 seconds... 00:05:51.747 00:05:51.747 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.747 ------------------------------------------------------------------------------------ 00:05:51.747 0,0 155328/s 1213 MiB/s 0 0 00:05:51.747 ==================================================================================== 00:05:51.747 Total 155328/s 606 MiB/s 0 0' 00:05:51.747 20:55:47 -- accel/accel.sh@20 -- # IFS=: 00:05:51.747 20:55:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:51.747 20:55:47 -- accel/accel.sh@20 -- # read -r var val 00:05:51.747 20:55:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:51.747 20:55:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.747 20:55:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.747 20:55:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.747 20:55:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.747 20:55:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.747 20:55:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.747 20:55:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.747 20:55:47 -- accel/accel.sh@42 -- # jq -r . 00:05:51.747 [2024-11-27 20:55:47.840257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.748 [2024-11-27 20:55:47.840338] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872441 ] 00:05:51.748 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.748 [2024-11-27 20:55:47.902222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.006 [2024-11-27 20:55:48.023181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=0x1 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=0 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=software 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@23 -- # accel_module=software 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=32 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=32 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=1 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val=Yes 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.006 20:55:48 -- accel/accel.sh@21 -- # val= 00:05:52.006 20:55:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # IFS=: 00:05:52.006 20:55:48 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@21 -- # val= 00:05:53.379 20:55:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # IFS=: 00:05:53.379 20:55:49 -- accel/accel.sh@20 -- # read -r var val 00:05:53.379 20:55:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:53.379 20:55:49 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:53.379 20:55:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.379 00:05:53.379 real 0m2.971s 00:05:53.379 user 0m2.661s 00:05:53.379 sys 0m0.302s 00:05:53.379 20:55:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.379 20:55:49 -- common/autotest_common.sh@10 -- # set +x 00:05:53.379 ************************************ 00:05:53.379 END TEST accel_copy_crc32c_C2 00:05:53.379 ************************************ 00:05:53.379 20:55:49 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:53.379 20:55:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:53.379 20:55:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.379 20:55:49 -- common/autotest_common.sh@10 -- # set +x 00:05:53.379 ************************************ 00:05:53.379 START TEST accel_dualcast 00:05:53.379 ************************************ 00:05:53.379 20:55:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:53.379 20:55:49 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.379 20:55:49 -- accel/accel.sh@17 -- # local accel_module 00:05:53.379 20:55:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:53.379 20:55:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:53.379 20:55:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.379 20:55:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.379 20:55:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.379 20:55:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.379 20:55:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.379 20:55:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.379 20:55:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.379 20:55:49 -- accel/accel.sh@42 -- # jq -r . 00:05:53.379 [2024-11-27 20:55:49.355143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.379 [2024-11-27 20:55:49.355227] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872654 ] 00:05:53.379 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.379 [2024-11-27 20:55:49.419328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.379 [2024-11-27 20:55:49.536613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.751 20:55:50 -- accel/accel.sh@18 -- # out=' 00:05:54.751 SPDK Configuration: 00:05:54.751 Core mask: 0x1 00:05:54.751 00:05:54.751 Accel Perf Configuration: 00:05:54.751 Workload Type: dualcast 00:05:54.751 Transfer size: 4096 bytes 00:05:54.751 Vector count 1 00:05:54.751 Module: software 00:05:54.751 Queue depth: 32 00:05:54.751 Allocate depth: 32 00:05:54.751 # threads/core: 1 00:05:54.751 Run time: 1 seconds 00:05:54.751 Verify: Yes 00:05:54.751 00:05:54.751 Running for 1 seconds... 00:05:54.751 00:05:54.751 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.751 ------------------------------------------------------------------------------------ 00:05:54.751 0,0 298912/s 1167 MiB/s 0 0 00:05:54.751 ==================================================================================== 00:05:54.751 Total 298912/s 1167 MiB/s 0 0' 00:05:54.751 20:55:50 -- accel/accel.sh@20 -- # IFS=: 00:05:54.751 20:55:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:54.751 20:55:50 -- accel/accel.sh@20 -- # read -r var val 00:05:54.751 20:55:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:54.751 20:55:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.751 20:55:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.751 20:55:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.751 20:55:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.751 20:55:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.751 20:55:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.751 20:55:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.751 20:55:50 -- accel/accel.sh@42 -- # jq -r . 00:05:54.751 [2024-11-27 20:55:50.833160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.751 [2024-11-27 20:55:50.833243] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872808 ] 00:05:54.751 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.751 [2024-11-27 20:55:50.894268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.010 [2024-11-27 20:55:51.015233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=0x1 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=dualcast 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=software 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=32 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=32 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=1 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val=Yes 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.010 20:55:51 -- accel/accel.sh@21 -- # val= 00:05:55.010 20:55:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # IFS=: 00:05:55.010 20:55:51 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@21 -- # val= 00:05:56.383 20:55:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # IFS=: 00:05:56.383 20:55:52 -- accel/accel.sh@20 -- # read -r var val 00:05:56.383 20:55:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:56.383 20:55:52 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:56.383 20:55:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.383 00:05:56.383 real 0m2.965s 00:05:56.383 user 0m2.656s 00:05:56.383 sys 0m0.300s 00:05:56.383 20:55:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.383 20:55:52 -- common/autotest_common.sh@10 -- # set +x 00:05:56.383 ************************************ 00:05:56.383 END TEST accel_dualcast 00:05:56.383 ************************************ 00:05:56.383 20:55:52 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:56.383 20:55:52 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:56.383 20:55:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.383 20:55:52 -- common/autotest_common.sh@10 -- # set +x 00:05:56.383 ************************************ 00:05:56.383 START TEST accel_compare 00:05:56.383 ************************************ 00:05:56.383 20:55:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:56.383 20:55:52 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.383 20:55:52 -- accel/accel.sh@17 -- # local accel_module 00:05:56.383 20:55:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:56.383 20:55:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:56.383 20:55:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.383 20:55:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.383 20:55:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.383 20:55:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.383 20:55:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.383 20:55:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.383 20:55:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.383 20:55:52 -- accel/accel.sh@42 -- # jq -r . 00:05:56.383 [2024-11-27 20:55:52.348217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.383 [2024-11-27 20:55:52.348296] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3872979 ] 00:05:56.383 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.383 [2024-11-27 20:55:52.409236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.383 [2024-11-27 20:55:52.530802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.755 20:55:53 -- accel/accel.sh@18 -- # out=' 00:05:57.755 SPDK Configuration: 00:05:57.755 Core mask: 0x1 00:05:57.755 00:05:57.755 Accel Perf Configuration: 00:05:57.755 Workload Type: compare 00:05:57.755 Transfer size: 4096 bytes 00:05:57.755 Vector count 1 00:05:57.755 Module: software 00:05:57.755 Queue depth: 32 00:05:57.755 Allocate depth: 32 00:05:57.755 # threads/core: 1 00:05:57.755 Run time: 1 seconds 00:05:57.755 Verify: Yes 00:05:57.755 00:05:57.755 Running for 1 seconds... 00:05:57.755 00:05:57.755 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.755 ------------------------------------------------------------------------------------ 00:05:57.755 0,0 397632/s 1553 MiB/s 0 0 00:05:57.755 ==================================================================================== 00:05:57.755 Total 397632/s 1553 MiB/s 0 0' 00:05:57.755 20:55:53 -- accel/accel.sh@20 -- # IFS=: 00:05:57.755 20:55:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:57.755 20:55:53 -- accel/accel.sh@20 -- # read -r var val 00:05:57.755 20:55:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:57.755 20:55:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.755 20:55:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.755 20:55:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.755 20:55:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.755 20:55:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.755 20:55:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.755 20:55:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.755 20:55:53 -- accel/accel.sh@42 -- # jq -r . 00:05:57.755 [2024-11-27 20:55:53.834084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.755 [2024-11-27 20:55:53.834166] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873226 ] 00:05:57.755 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.755 [2024-11-27 20:55:53.894676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.013 [2024-11-27 20:55:54.015737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=0x1 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=compare 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=software 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=32 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=32 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=1 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val=Yes 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.013 20:55:54 -- accel/accel.sh@21 -- # val= 00:05:58.013 20:55:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # IFS=: 00:05:58.013 20:55:54 -- accel/accel.sh@20 -- # read -r var val 00:05:59.386 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@21 -- # val= 00:05:59.387 20:55:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # IFS=: 00:05:59.387 20:55:55 -- accel/accel.sh@20 -- # read -r var val 00:05:59.387 20:55:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:59.387 20:55:55 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:59.387 20:55:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.387 00:05:59.387 real 0m2.957s 00:05:59.387 user 0m2.664s 00:05:59.387 sys 0m0.284s 00:05:59.387 20:55:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.387 20:55:55 -- common/autotest_common.sh@10 -- # set +x 00:05:59.387 ************************************ 00:05:59.387 END TEST accel_compare 00:05:59.387 ************************************ 00:05:59.387 20:55:55 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:59.387 20:55:55 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:59.387 20:55:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.387 20:55:55 -- common/autotest_common.sh@10 -- # set +x 00:05:59.387 ************************************ 00:05:59.387 START TEST accel_xor 00:05:59.387 ************************************ 00:05:59.387 20:55:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:59.387 20:55:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.387 20:55:55 -- accel/accel.sh@17 -- # local accel_module 00:05:59.387 20:55:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:59.387 20:55:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:59.387 20:55:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.387 20:55:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.387 20:55:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.387 20:55:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.387 20:55:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.387 20:55:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.387 20:55:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.387 20:55:55 -- accel/accel.sh@42 -- # jq -r . 00:05:59.387 [2024-11-27 20:55:55.332448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.387 [2024-11-27 20:55:55.332543] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873391 ] 00:05:59.387 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.387 [2024-11-27 20:55:55.394701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.387 [2024-11-27 20:55:55.513804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.808 20:55:56 -- accel/accel.sh@18 -- # out=' 00:06:00.808 SPDK Configuration: 00:06:00.808 Core mask: 0x1 00:06:00.808 00:06:00.808 Accel Perf Configuration: 00:06:00.808 Workload Type: xor 00:06:00.808 Source buffers: 2 00:06:00.808 Transfer size: 4096 bytes 00:06:00.808 Vector count 1 00:06:00.808 Module: software 00:06:00.808 Queue depth: 32 00:06:00.808 Allocate depth: 32 00:06:00.808 # threads/core: 1 00:06:00.808 Run time: 1 seconds 00:06:00.808 Verify: Yes 00:06:00.808 00:06:00.808 Running for 1 seconds... 00:06:00.808 00:06:00.808 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.808 ------------------------------------------------------------------------------------ 00:06:00.808 0,0 191456/s 747 MiB/s 0 0 00:06:00.808 ==================================================================================== 00:06:00.808 Total 191456/s 747 MiB/s 0 0' 00:06:00.808 20:55:56 -- accel/accel.sh@20 -- # IFS=: 00:06:00.808 20:55:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:00.808 20:55:56 -- accel/accel.sh@20 -- # read -r var val 00:06:00.808 20:55:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:00.808 20:55:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.808 20:55:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.808 20:55:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.808 20:55:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.808 20:55:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.808 20:55:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.808 20:55:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.808 20:55:56 -- accel/accel.sh@42 -- # jq -r . 00:06:00.808 [2024-11-27 20:55:56.817379] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.808 [2024-11-27 20:55:56.817459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873538 ] 00:06:00.808 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.808 [2024-11-27 20:55:56.879834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.808 [2024-11-27 20:55:56.999077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=0x1 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=xor 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=2 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=software 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@23 -- # accel_module=software 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=32 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=32 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=1 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val=Yes 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:01.066 20:55:57 -- accel/accel.sh@21 -- # val= 00:06:01.066 20:55:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # IFS=: 00:06:01.066 20:55:57 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@21 -- # val= 00:06:02.441 20:55:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.441 20:55:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.441 20:55:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.441 20:55:58 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:02.441 20:55:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.441 00:06:02.441 real 0m2.968s 00:06:02.441 user 0m2.668s 00:06:02.441 sys 0m0.292s 00:06:02.441 20:55:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.441 20:55:58 -- common/autotest_common.sh@10 -- # set +x 00:06:02.441 ************************************ 00:06:02.441 END TEST accel_xor 00:06:02.441 ************************************ 00:06:02.441 20:55:58 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:02.441 20:55:58 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:02.441 20:55:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.441 20:55:58 -- common/autotest_common.sh@10 -- # set +x 00:06:02.441 ************************************ 00:06:02.441 START TEST accel_xor 00:06:02.441 ************************************ 00:06:02.441 20:55:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:02.441 20:55:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.441 20:55:58 -- accel/accel.sh@17 -- # local accel_module 00:06:02.441 20:55:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:02.441 20:55:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:02.441 20:55:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.441 20:55:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.441 20:55:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.441 20:55:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.441 20:55:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.441 20:55:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.441 20:55:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.441 20:55:58 -- accel/accel.sh@42 -- # jq -r . 00:06:02.441 [2024-11-27 20:55:58.323980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.441 [2024-11-27 20:55:58.324063] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873812 ] 00:06:02.441 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.441 [2024-11-27 20:55:58.385827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.441 [2024-11-27 20:55:58.509444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.812 20:55:59 -- accel/accel.sh@18 -- # out=' 00:06:03.812 SPDK Configuration: 00:06:03.812 Core mask: 0x1 00:06:03.812 00:06:03.812 Accel Perf Configuration: 00:06:03.812 Workload Type: xor 00:06:03.812 Source buffers: 3 00:06:03.812 Transfer size: 4096 bytes 00:06:03.812 Vector count 1 00:06:03.812 Module: software 00:06:03.812 Queue depth: 32 00:06:03.812 Allocate depth: 32 00:06:03.812 # threads/core: 1 00:06:03.812 Run time: 1 seconds 00:06:03.812 Verify: Yes 00:06:03.812 00:06:03.812 Running for 1 seconds... 00:06:03.812 00:06:03.812 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.812 ------------------------------------------------------------------------------------ 00:06:03.812 0,0 182688/s 713 MiB/s 0 0 00:06:03.812 ==================================================================================== 00:06:03.812 Total 182688/s 713 MiB/s 0 0' 00:06:03.812 20:55:59 -- accel/accel.sh@20 -- # IFS=: 00:06:03.812 20:55:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:03.812 20:55:59 -- accel/accel.sh@20 -- # read -r var val 00:06:03.812 20:55:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:03.812 20:55:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.812 20:55:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.812 20:55:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.812 20:55:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.812 20:55:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.812 20:55:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.812 20:55:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.812 20:55:59 -- accel/accel.sh@42 -- # jq -r . 00:06:03.812 [2024-11-27 20:55:59.802200] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.812 [2024-11-27 20:55:59.802294] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3873964 ] 00:06:03.812 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.812 [2024-11-27 20:55:59.867658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.812 [2024-11-27 20:55:59.987929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.812 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:03.812 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.812 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.812 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.812 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:03.812 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.812 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=0x1 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=xor 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=3 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=software 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=32 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=32 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=1 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val=Yes 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:04.070 20:56:00 -- accel/accel.sh@21 -- # val= 00:06:04.070 20:56:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # IFS=: 00:06:04.070 20:56:00 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@21 -- # val= 00:06:05.442 20:56:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.442 20:56:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.442 20:56:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.442 20:56:01 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:05.442 20:56:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.442 00:06:05.442 real 0m2.962s 00:06:05.442 user 0m2.659s 00:06:05.442 sys 0m0.294s 00:06:05.442 20:56:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.442 20:56:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.442 ************************************ 00:06:05.442 END TEST accel_xor 00:06:05.442 ************************************ 00:06:05.442 20:56:01 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:05.442 20:56:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:05.442 20:56:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.442 20:56:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.442 ************************************ 00:06:05.442 START TEST accel_dif_verify 00:06:05.442 ************************************ 00:06:05.442 20:56:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:05.442 20:56:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.442 20:56:01 -- accel/accel.sh@17 -- # local accel_module 00:06:05.442 20:56:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:05.442 20:56:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:05.442 20:56:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.442 20:56:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.442 20:56:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.442 20:56:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.442 20:56:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.442 20:56:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.442 20:56:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.442 20:56:01 -- accel/accel.sh@42 -- # jq -r . 00:06:05.442 [2024-11-27 20:56:01.310318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.442 [2024-11-27 20:56:01.310401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874121 ] 00:06:05.442 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.442 [2024-11-27 20:56:01.372857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.442 [2024-11-27 20:56:01.492063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.816 20:56:02 -- accel/accel.sh@18 -- # out=' 00:06:06.816 SPDK Configuration: 00:06:06.816 Core mask: 0x1 00:06:06.816 00:06:06.816 Accel Perf Configuration: 00:06:06.816 Workload Type: dif_verify 00:06:06.816 Vector size: 4096 bytes 00:06:06.816 Transfer size: 4096 bytes 00:06:06.816 Block size: 512 bytes 00:06:06.816 Metadata size: 8 bytes 00:06:06.816 Vector count 1 00:06:06.816 Module: software 00:06:06.816 Queue depth: 32 00:06:06.816 Allocate depth: 32 00:06:06.816 # threads/core: 1 00:06:06.816 Run time: 1 seconds 00:06:06.816 Verify: No 00:06:06.816 00:06:06.816 Running for 1 seconds... 00:06:06.816 00:06:06.816 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.816 ------------------------------------------------------------------------------------ 00:06:06.816 0,0 81344/s 322 MiB/s 0 0 00:06:06.816 ==================================================================================== 00:06:06.816 Total 81344/s 317 MiB/s 0 0' 00:06:06.816 20:56:02 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:06.816 20:56:02 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:06.816 20:56:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.816 20:56:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.816 20:56:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.816 20:56:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.816 20:56:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.816 20:56:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.816 20:56:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.816 20:56:02 -- accel/accel.sh@42 -- # jq -r . 00:06:06.816 [2024-11-27 20:56:02.786246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.816 [2024-11-27 20:56:02.786330] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874384 ] 00:06:06.816 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.816 [2024-11-27 20:56:02.848581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.816 [2024-11-27 20:56:02.968731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val=0x1 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val=dif_verify 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.816 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.816 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.816 20:56:03 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val=software 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val=32 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val=32 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val=1 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val=No 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:06.817 20:56:03 -- accel/accel.sh@21 -- # val= 00:06:06.817 20:56:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # IFS=: 00:06:06.817 20:56:03 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@21 -- # val= 00:06:08.191 20:56:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # IFS=: 00:06:08.191 20:56:04 -- accel/accel.sh@20 -- # read -r var val 00:06:08.191 20:56:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:08.191 20:56:04 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:08.191 20:56:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.191 00:06:08.191 real 0m2.963s 00:06:08.191 user 0m2.669s 00:06:08.191 sys 0m0.288s 00:06:08.191 20:56:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.191 20:56:04 -- common/autotest_common.sh@10 -- # set +x 00:06:08.191 ************************************ 00:06:08.191 END TEST accel_dif_verify 00:06:08.191 ************************************ 00:06:08.191 20:56:04 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:08.191 20:56:04 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:08.191 20:56:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.191 20:56:04 -- common/autotest_common.sh@10 -- # set +x 00:06:08.191 ************************************ 00:06:08.191 START TEST accel_dif_generate 00:06:08.191 ************************************ 00:06:08.191 20:56:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:08.191 20:56:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.191 20:56:04 -- accel/accel.sh@17 -- # local accel_module 00:06:08.191 20:56:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:08.191 20:56:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:08.191 20:56:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.191 20:56:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.191 20:56:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.191 20:56:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.191 20:56:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.191 20:56:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.191 20:56:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.191 20:56:04 -- accel/accel.sh@42 -- # jq -r . 00:06:08.191 [2024-11-27 20:56:04.299663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.191 [2024-11-27 20:56:04.299744] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874541 ] 00:06:08.191 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.191 [2024-11-27 20:56:04.362053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.449 [2024-11-27 20:56:04.481482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.822 20:56:05 -- accel/accel.sh@18 -- # out=' 00:06:09.822 SPDK Configuration: 00:06:09.822 Core mask: 0x1 00:06:09.822 00:06:09.822 Accel Perf Configuration: 00:06:09.822 Workload Type: dif_generate 00:06:09.822 Vector size: 4096 bytes 00:06:09.822 Transfer size: 4096 bytes 00:06:09.822 Block size: 512 bytes 00:06:09.822 Metadata size: 8 bytes 00:06:09.822 Vector count 1 00:06:09.822 Module: software 00:06:09.822 Queue depth: 32 00:06:09.822 Allocate depth: 32 00:06:09.822 # threads/core: 1 00:06:09.822 Run time: 1 seconds 00:06:09.822 Verify: No 00:06:09.822 00:06:09.822 Running for 1 seconds... 00:06:09.822 00:06:09.822 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.822 ------------------------------------------------------------------------------------ 00:06:09.822 0,0 96288/s 382 MiB/s 0 0 00:06:09.822 ==================================================================================== 00:06:09.822 Total 96288/s 376 MiB/s 0 0' 00:06:09.822 20:56:05 -- accel/accel.sh@20 -- # IFS=: 00:06:09.822 20:56:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:09.822 20:56:05 -- accel/accel.sh@20 -- # read -r var val 00:06:09.822 20:56:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:09.822 20:56:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.822 20:56:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.822 20:56:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.822 20:56:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.822 20:56:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.822 20:56:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.822 20:56:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.822 20:56:05 -- accel/accel.sh@42 -- # jq -r . 00:06:09.822 [2024-11-27 20:56:05.767978] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.823 [2024-11-27 20:56:05.768063] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874693 ] 00:06:09.823 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.823 [2024-11-27 20:56:05.830157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.823 [2024-11-27 20:56:05.950292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=0x1 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=dif_generate 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=software 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=32 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=32 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=1 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val=No 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:09.823 20:56:06 -- accel/accel.sh@21 -- # val= 00:06:09.823 20:56:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # IFS=: 00:06:09.823 20:56:06 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@21 -- # val= 00:06:11.198 20:56:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # IFS=: 00:06:11.198 20:56:07 -- accel/accel.sh@20 -- # read -r var val 00:06:11.198 20:56:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:11.198 20:56:07 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:11.198 20:56:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.198 00:06:11.198 real 0m2.945s 00:06:11.198 user 0m2.645s 00:06:11.198 sys 0m0.294s 00:06:11.198 20:56:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.198 20:56:07 -- common/autotest_common.sh@10 -- # set +x 00:06:11.198 ************************************ 00:06:11.198 END TEST accel_dif_generate 00:06:11.198 ************************************ 00:06:11.198 20:56:07 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:11.198 20:56:07 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:11.198 20:56:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.198 20:56:07 -- common/autotest_common.sh@10 -- # set +x 00:06:11.198 ************************************ 00:06:11.198 START TEST accel_dif_generate_copy 00:06:11.198 ************************************ 00:06:11.198 20:56:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:11.198 20:56:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.198 20:56:07 -- accel/accel.sh@17 -- # local accel_module 00:06:11.198 20:56:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:11.198 20:56:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:11.198 20:56:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.198 20:56:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.198 20:56:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.198 20:56:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.198 20:56:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.198 20:56:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.198 20:56:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.198 20:56:07 -- accel/accel.sh@42 -- # jq -r . 00:06:11.198 [2024-11-27 20:56:07.269210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.198 [2024-11-27 20:56:07.269289] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3874967 ] 00:06:11.198 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.198 [2024-11-27 20:56:07.330783] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.456 [2024-11-27 20:56:07.452113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.830 20:56:08 -- accel/accel.sh@18 -- # out=' 00:06:12.830 SPDK Configuration: 00:06:12.830 Core mask: 0x1 00:06:12.830 00:06:12.830 Accel Perf Configuration: 00:06:12.830 Workload Type: dif_generate_copy 00:06:12.830 Vector size: 4096 bytes 00:06:12.830 Transfer size: 4096 bytes 00:06:12.830 Vector count 1 00:06:12.830 Module: software 00:06:12.830 Queue depth: 32 00:06:12.830 Allocate depth: 32 00:06:12.830 # threads/core: 1 00:06:12.830 Run time: 1 seconds 00:06:12.830 Verify: No 00:06:12.830 00:06:12.830 Running for 1 seconds... 00:06:12.830 00:06:12.830 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.830 ------------------------------------------------------------------------------------ 00:06:12.830 0,0 76032/s 301 MiB/s 0 0 00:06:12.830 ==================================================================================== 00:06:12.830 Total 76032/s 297 MiB/s 0 0' 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:12.830 20:56:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.830 20:56:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.830 20:56:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.830 20:56:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.830 20:56:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.830 20:56:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.830 20:56:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.830 20:56:08 -- accel/accel.sh@42 -- # jq -r . 00:06:12.830 [2024-11-27 20:56:08.754931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.830 [2024-11-27 20:56:08.755016] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3875111 ] 00:06:12.830 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.830 [2024-11-27 20:56:08.817388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.830 [2024-11-27 20:56:08.936376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val=0x1 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val=software 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:08 -- accel/accel.sh@21 -- # val=32 00:06:12.830 20:56:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:08 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val=32 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val=1 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val=No 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:12.830 20:56:09 -- accel/accel.sh@21 -- # val= 00:06:12.830 20:56:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # IFS=: 00:06:12.830 20:56:09 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@21 -- # val= 00:06:14.212 20:56:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # IFS=: 00:06:14.212 20:56:10 -- accel/accel.sh@20 -- # read -r var val 00:06:14.212 20:56:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:14.212 20:56:10 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:14.212 20:56:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.212 00:06:14.212 real 0m2.960s 00:06:14.212 user 0m2.658s 00:06:14.212 sys 0m0.292s 00:06:14.212 20:56:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.212 20:56:10 -- common/autotest_common.sh@10 -- # set +x 00:06:14.212 ************************************ 00:06:14.212 END TEST accel_dif_generate_copy 00:06:14.212 ************************************ 00:06:14.212 20:56:10 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:14.212 20:56:10 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.212 20:56:10 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:14.212 20:56:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.212 20:56:10 -- common/autotest_common.sh@10 -- # set +x 00:06:14.212 ************************************ 00:06:14.212 START TEST accel_comp 00:06:14.212 ************************************ 00:06:14.212 20:56:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.212 20:56:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:14.212 20:56:10 -- accel/accel.sh@17 -- # local accel_module 00:06:14.212 20:56:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.212 20:56:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.212 20:56:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.212 20:56:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.212 20:56:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.212 20:56:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.212 20:56:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.212 20:56:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.212 20:56:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.212 20:56:10 -- accel/accel.sh@42 -- # jq -r . 00:06:14.212 [2024-11-27 20:56:10.252818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.212 [2024-11-27 20:56:10.252899] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3875275 ] 00:06:14.212 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.212 [2024-11-27 20:56:10.318304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.212 [2024-11-27 20:56:10.439059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.590 20:56:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.590 00:06:15.590 SPDK Configuration: 00:06:15.590 Core mask: 0x1 00:06:15.590 00:06:15.590 Accel Perf Configuration: 00:06:15.590 Workload Type: compress 00:06:15.590 Transfer size: 4096 bytes 00:06:15.590 Vector count 1 00:06:15.590 Module: software 00:06:15.590 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.590 Queue depth: 32 00:06:15.590 Allocate depth: 32 00:06:15.590 # threads/core: 1 00:06:15.590 Run time: 1 seconds 00:06:15.590 Verify: No 00:06:15.590 00:06:15.590 Running for 1 seconds... 00:06:15.590 00:06:15.590 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.590 ------------------------------------------------------------------------------------ 00:06:15.590 0,0 31488/s 131 MiB/s 0 0 00:06:15.590 ==================================================================================== 00:06:15.590 Total 31488/s 123 MiB/s 0 0' 00:06:15.590 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.590 20:56:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.590 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.590 20:56:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.590 20:56:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.590 20:56:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.590 20:56:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.590 20:56:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.590 20:56:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.590 20:56:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.590 20:56:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.590 20:56:11 -- accel/accel.sh@42 -- # jq -r . 00:06:15.590 [2024-11-27 20:56:11.740181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.590 [2024-11-27 20:56:11.740264] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3875499 ] 00:06:15.590 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.590 [2024-11-27 20:56:11.802254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.848 [2024-11-27 20:56:11.924387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val=0x1 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.848 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.848 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.848 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=compress 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=software 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=32 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=32 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=1 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val=No 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:15.849 20:56:11 -- accel/accel.sh@21 -- # val= 00:06:15.849 20:56:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # IFS=: 00:06:15.849 20:56:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@21 -- # val= 00:06:17.223 20:56:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # IFS=: 00:06:17.223 20:56:13 -- accel/accel.sh@20 -- # read -r var val 00:06:17.223 20:56:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:17.223 20:56:13 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:17.223 20:56:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:17.223 00:06:17.223 real 0m2.981s 00:06:17.223 user 0m2.682s 00:06:17.223 sys 0m0.292s 00:06:17.223 20:56:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:17.223 20:56:13 -- common/autotest_common.sh@10 -- # set +x 00:06:17.223 ************************************ 00:06:17.223 END TEST accel_comp 00:06:17.223 ************************************ 00:06:17.223 20:56:13 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.223 20:56:13 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:17.223 20:56:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.223 20:56:13 -- common/autotest_common.sh@10 -- # set +x 00:06:17.223 ************************************ 00:06:17.223 START TEST accel_decomp 00:06:17.223 ************************************ 00:06:17.223 20:56:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.223 20:56:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:17.223 20:56:13 -- accel/accel.sh@17 -- # local accel_module 00:06:17.223 20:56:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.223 20:56:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.223 20:56:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.223 20:56:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.223 20:56:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.223 20:56:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.223 20:56:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.223 20:56:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.223 20:56:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.223 20:56:13 -- accel/accel.sh@42 -- # jq -r . 00:06:17.223 [2024-11-27 20:56:13.259165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.223 [2024-11-27 20:56:13.259246] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3875694 ] 00:06:17.223 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.223 [2024-11-27 20:56:13.325449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.223 [2024-11-27 20:56:13.446644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.597 20:56:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.597 00:06:18.597 SPDK Configuration: 00:06:18.597 Core mask: 0x1 00:06:18.597 00:06:18.597 Accel Perf Configuration: 00:06:18.597 Workload Type: decompress 00:06:18.597 Transfer size: 4096 bytes 00:06:18.597 Vector count 1 00:06:18.597 Module: software 00:06:18.597 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.597 Queue depth: 32 00:06:18.597 Allocate depth: 32 00:06:18.597 # threads/core: 1 00:06:18.597 Run time: 1 seconds 00:06:18.597 Verify: Yes 00:06:18.597 00:06:18.597 Running for 1 seconds... 00:06:18.597 00:06:18.597 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.597 ------------------------------------------------------------------------------------ 00:06:18.597 0,0 55456/s 102 MiB/s 0 0 00:06:18.597 ==================================================================================== 00:06:18.597 Total 55456/s 216 MiB/s 0 0' 00:06:18.597 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.597 20:56:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.597 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.597 20:56:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:18.597 20:56:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.597 20:56:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.597 20:56:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.597 20:56:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.597 20:56:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.597 20:56:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.597 20:56:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.597 20:56:14 -- accel/accel.sh@42 -- # jq -r . 00:06:18.597 [2024-11-27 20:56:14.745941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.597 [2024-11-27 20:56:14.746025] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3875842 ] 00:06:18.597 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.597 [2024-11-27 20:56:14.808410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.857 [2024-11-27 20:56:14.927318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=0x1 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=decompress 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=software 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=32 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=32 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=1 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val=Yes 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:18.857 20:56:14 -- accel/accel.sh@21 -- # val= 00:06:18.857 20:56:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # IFS=: 00:06:18.857 20:56:14 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@21 -- # val= 00:06:20.230 20:56:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # IFS=: 00:06:20.230 20:56:16 -- accel/accel.sh@20 -- # read -r var val 00:06:20.230 20:56:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:20.230 20:56:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:20.230 20:56:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:20.230 00:06:20.230 real 0m2.955s 00:06:20.230 user 0m2.647s 00:06:20.230 sys 0m0.301s 00:06:20.230 20:56:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.230 20:56:16 -- common/autotest_common.sh@10 -- # set +x 00:06:20.230 ************************************ 00:06:20.230 END TEST accel_decomp 00:06:20.230 ************************************ 00:06:20.230 20:56:16 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.230 20:56:16 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:20.230 20:56:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.230 20:56:16 -- common/autotest_common.sh@10 -- # set +x 00:06:20.230 ************************************ 00:06:20.230 START TEST accel_decmop_full 00:06:20.230 ************************************ 00:06:20.230 20:56:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.230 20:56:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:20.230 20:56:16 -- accel/accel.sh@17 -- # local accel_module 00:06:20.230 20:56:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.230 20:56:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.230 20:56:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.230 20:56:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.230 20:56:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.230 20:56:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.230 20:56:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.230 20:56:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.230 20:56:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.230 20:56:16 -- accel/accel.sh@42 -- # jq -r . 00:06:20.230 [2024-11-27 20:56:16.241965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.230 [2024-11-27 20:56:16.242043] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876028 ] 00:06:20.230 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.231 [2024-11-27 20:56:16.305550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.231 [2024-11-27 20:56:16.425502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.605 20:56:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.605 00:06:21.605 SPDK Configuration: 00:06:21.605 Core mask: 0x1 00:06:21.605 00:06:21.605 Accel Perf Configuration: 00:06:21.605 Workload Type: decompress 00:06:21.605 Transfer size: 111250 bytes 00:06:21.605 Vector count 1 00:06:21.605 Module: software 00:06:21.605 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.605 Queue depth: 32 00:06:21.605 Allocate depth: 32 00:06:21.605 # threads/core: 1 00:06:21.605 Run time: 1 seconds 00:06:21.605 Verify: Yes 00:06:21.605 00:06:21.605 Running for 1 seconds... 00:06:21.605 00:06:21.605 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.605 ------------------------------------------------------------------------------------ 00:06:21.605 0,0 3808/s 157 MiB/s 0 0 00:06:21.605 ==================================================================================== 00:06:21.605 Total 3808/s 404 MiB/s 0 0' 00:06:21.605 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.605 20:56:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.605 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.605 20:56:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:21.605 20:56:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.605 20:56:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.605 20:56:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.605 20:56:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.605 20:56:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.605 20:56:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.605 20:56:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.605 20:56:17 -- accel/accel.sh@42 -- # jq -r . 00:06:21.605 [2024-11-27 20:56:17.747591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.605 [2024-11-27 20:56:17.747675] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876260 ] 00:06:21.605 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.605 [2024-11-27 20:56:17.810505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.864 [2024-11-27 20:56:17.931491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val=0x1 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val=decompress 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val=software 00:06:21.864 20:56:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:17 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:17 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val=32 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val=32 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val=1 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val=Yes 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:21.864 20:56:18 -- accel/accel.sh@21 -- # val= 00:06:21.864 20:56:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # IFS=: 00:06:21.864 20:56:18 -- accel/accel.sh@20 -- # read -r var val 00:06:23.237 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@21 -- # val= 00:06:23.238 20:56:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # IFS=: 00:06:23.238 20:56:19 -- accel/accel.sh@20 -- # read -r var val 00:06:23.238 20:56:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:23.238 20:56:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:23.238 20:56:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:23.238 00:06:23.238 real 0m3.014s 00:06:23.238 user 0m2.711s 00:06:23.238 sys 0m0.295s 00:06:23.238 20:56:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.238 20:56:19 -- common/autotest_common.sh@10 -- # set +x 00:06:23.238 ************************************ 00:06:23.238 END TEST accel_decmop_full 00:06:23.238 ************************************ 00:06:23.238 20:56:19 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.238 20:56:19 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:23.238 20:56:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.238 20:56:19 -- common/autotest_common.sh@10 -- # set +x 00:06:23.238 ************************************ 00:06:23.238 START TEST accel_decomp_mcore 00:06:23.238 ************************************ 00:06:23.238 20:56:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.238 20:56:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:23.238 20:56:19 -- accel/accel.sh@17 -- # local accel_module 00:06:23.238 20:56:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.238 20:56:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.238 20:56:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.238 20:56:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.238 20:56:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.238 20:56:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.238 20:56:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.238 20:56:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.238 20:56:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.238 20:56:19 -- accel/accel.sh@42 -- # jq -r . 00:06:23.238 [2024-11-27 20:56:19.285537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.238 [2024-11-27 20:56:19.285619] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876423 ] 00:06:23.238 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.238 [2024-11-27 20:56:19.348815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.238 [2024-11-27 20:56:19.472631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.238 [2024-11-27 20:56:19.472688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.238 [2024-11-27 20:56:19.472744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:23.238 [2024-11-27 20:56:19.472747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.611 20:56:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:24.611 00:06:24.611 SPDK Configuration: 00:06:24.611 Core mask: 0xf 00:06:24.611 00:06:24.611 Accel Perf Configuration: 00:06:24.611 Workload Type: decompress 00:06:24.611 Transfer size: 4096 bytes 00:06:24.611 Vector count 1 00:06:24.611 Module: software 00:06:24.611 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.611 Queue depth: 32 00:06:24.611 Allocate depth: 32 00:06:24.611 # threads/core: 1 00:06:24.611 Run time: 1 seconds 00:06:24.611 Verify: Yes 00:06:24.611 00:06:24.611 Running for 1 seconds... 00:06:24.611 00:06:24.611 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:24.611 ------------------------------------------------------------------------------------ 00:06:24.611 0,0 49824/s 91 MiB/s 0 0 00:06:24.611 3,0 50432/s 92 MiB/s 0 0 00:06:24.611 2,0 50240/s 92 MiB/s 0 0 00:06:24.611 1,0 50240/s 92 MiB/s 0 0 00:06:24.611 ==================================================================================== 00:06:24.611 Total 200736/s 784 MiB/s 0 0' 00:06:24.611 20:56:20 -- accel/accel.sh@20 -- # IFS=: 00:06:24.611 20:56:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.611 20:56:20 -- accel/accel.sh@20 -- # read -r var val 00:06:24.611 20:56:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.611 20:56:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.611 20:56:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.611 20:56:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.611 20:56:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.611 20:56:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.611 20:56:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.611 20:56:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.612 20:56:20 -- accel/accel.sh@42 -- # jq -r . 00:06:24.612 [2024-11-27 20:56:20.781376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.612 [2024-11-27 20:56:20.781462] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876638 ] 00:06:24.612 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.612 [2024-11-27 20:56:20.841071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:24.870 [2024-11-27 20:56:20.962614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.870 [2024-11-27 20:56:20.962669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.870 [2024-11-27 20:56:20.962724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.870 [2024-11-27 20:56:20.962727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=0xf 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=decompress 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=software 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@23 -- # accel_module=software 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=32 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=32 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=1 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val=Yes 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:24.870 20:56:21 -- accel/accel.sh@21 -- # val= 00:06:24.870 20:56:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # IFS=: 00:06:24.870 20:56:21 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@21 -- # val= 00:06:26.247 20:56:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # IFS=: 00:06:26.247 20:56:22 -- accel/accel.sh@20 -- # read -r var val 00:06:26.247 20:56:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:26.247 20:56:22 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:26.247 20:56:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:26.247 00:06:26.247 real 0m2.987s 00:06:26.247 user 0m9.592s 00:06:26.247 sys 0m0.314s 00:06:26.247 20:56:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.247 20:56:22 -- common/autotest_common.sh@10 -- # set +x 00:06:26.247 ************************************ 00:06:26.247 END TEST accel_decomp_mcore 00:06:26.247 ************************************ 00:06:26.247 20:56:22 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.247 20:56:22 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:26.247 20:56:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.247 20:56:22 -- common/autotest_common.sh@10 -- # set +x 00:06:26.247 ************************************ 00:06:26.247 START TEST accel_decomp_full_mcore 00:06:26.247 ************************************ 00:06:26.247 20:56:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.247 20:56:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:26.247 20:56:22 -- accel/accel.sh@17 -- # local accel_module 00:06:26.247 20:56:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.247 20:56:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.247 20:56:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.247 20:56:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.247 20:56:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.247 20:56:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.247 20:56:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.247 20:56:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.247 20:56:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.247 20:56:22 -- accel/accel.sh@42 -- # jq -r . 00:06:26.247 [2024-11-27 20:56:22.303832] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.247 [2024-11-27 20:56:22.303916] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876855 ] 00:06:26.247 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.247 [2024-11-27 20:56:22.365963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.506 [2024-11-27 20:56:22.490061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.506 [2024-11-27 20:56:22.490118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.506 [2024-11-27 20:56:22.490170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.506 [2024-11-27 20:56:22.490173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.882 20:56:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:27.882 00:06:27.882 SPDK Configuration: 00:06:27.882 Core mask: 0xf 00:06:27.882 00:06:27.882 Accel Perf Configuration: 00:06:27.882 Workload Type: decompress 00:06:27.882 Transfer size: 111250 bytes 00:06:27.882 Vector count 1 00:06:27.882 Module: software 00:06:27.882 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.882 Queue depth: 32 00:06:27.882 Allocate depth: 32 00:06:27.882 # threads/core: 1 00:06:27.882 Run time: 1 seconds 00:06:27.882 Verify: Yes 00:06:27.882 00:06:27.882 Running for 1 seconds... 00:06:27.882 00:06:27.882 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:27.882 ------------------------------------------------------------------------------------ 00:06:27.882 0,0 3776/s 155 MiB/s 0 0 00:06:27.882 3,0 3776/s 155 MiB/s 0 0 00:06:27.882 2,0 3776/s 155 MiB/s 0 0 00:06:27.882 1,0 3776/s 155 MiB/s 0 0 00:06:27.882 ==================================================================================== 00:06:27.882 Total 15104/s 1602 MiB/s 0 0' 00:06:27.882 20:56:23 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.882 20:56:23 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.882 20:56:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.882 20:56:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.882 20:56:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.882 20:56:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.882 20:56:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.882 20:56:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.882 20:56:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.882 20:56:23 -- accel/accel.sh@42 -- # jq -r . 00:06:27.882 [2024-11-27 20:56:23.815560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.882 [2024-11-27 20:56:23.815645] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3876996 ] 00:06:27.882 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.882 [2024-11-27 20:56:23.878857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.882 [2024-11-27 20:56:24.002339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.882 [2024-11-27 20:56:24.002395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.882 [2024-11-27 20:56:24.002447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.882 [2024-11-27 20:56:24.002451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=0xf 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=decompress 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=software 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=32 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=32 00:06:27.882 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.882 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.882 20:56:24 -- accel/accel.sh@21 -- # val=1 00:06:27.883 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.883 20:56:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:27.883 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.883 20:56:24 -- accel/accel.sh@21 -- # val=Yes 00:06:27.883 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.883 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.883 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:27.883 20:56:24 -- accel/accel.sh@21 -- # val= 00:06:27.883 20:56:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # IFS=: 00:06:27.883 20:56:24 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@21 -- # val= 00:06:29.256 20:56:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # IFS=: 00:06:29.256 20:56:25 -- accel/accel.sh@20 -- # read -r var val 00:06:29.256 20:56:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:29.256 20:56:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:29.256 20:56:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:29.256 00:06:29.256 real 0m3.018s 00:06:29.256 user 0m9.696s 00:06:29.256 sys 0m0.313s 00:06:29.256 20:56:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.256 20:56:25 -- common/autotest_common.sh@10 -- # set +x 00:06:29.256 ************************************ 00:06:29.256 END TEST accel_decomp_full_mcore 00:06:29.256 ************************************ 00:06:29.256 20:56:25 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.256 20:56:25 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:29.256 20:56:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.256 20:56:25 -- common/autotest_common.sh@10 -- # set +x 00:06:29.256 ************************************ 00:06:29.256 START TEST accel_decomp_mthread 00:06:29.256 ************************************ 00:06:29.256 20:56:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.256 20:56:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:29.256 20:56:25 -- accel/accel.sh@17 -- # local accel_module 00:06:29.256 20:56:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.256 20:56:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.256 20:56:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.256 20:56:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.256 20:56:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.256 20:56:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.256 20:56:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.256 20:56:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.256 20:56:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.256 20:56:25 -- accel/accel.sh@42 -- # jq -r . 00:06:29.256 [2024-11-27 20:56:25.347078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.256 [2024-11-27 20:56:25.347156] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877255 ] 00:06:29.256 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.256 [2024-11-27 20:56:25.413445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.516 [2024-11-27 20:56:25.531719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.920 20:56:26 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:30.920 00:06:30.920 SPDK Configuration: 00:06:30.920 Core mask: 0x1 00:06:30.920 00:06:30.920 Accel Perf Configuration: 00:06:30.920 Workload Type: decompress 00:06:30.920 Transfer size: 4096 bytes 00:06:30.920 Vector count 1 00:06:30.920 Module: software 00:06:30.920 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:30.920 Queue depth: 32 00:06:30.920 Allocate depth: 32 00:06:30.920 # threads/core: 2 00:06:30.920 Run time: 1 seconds 00:06:30.920 Verify: Yes 00:06:30.920 00:06:30.920 Running for 1 seconds... 00:06:30.920 00:06:30.920 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:30.920 ------------------------------------------------------------------------------------ 00:06:30.920 0,1 28032/s 51 MiB/s 0 0 00:06:30.920 0,0 27904/s 51 MiB/s 0 0 00:06:30.920 ==================================================================================== 00:06:30.920 Total 55936/s 218 MiB/s 0 0' 00:06:30.920 20:56:26 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.920 20:56:26 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.920 20:56:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.920 20:56:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.920 20:56:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.920 20:56:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.920 20:56:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.920 20:56:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.920 20:56:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.920 20:56:26 -- accel/accel.sh@42 -- # jq -r . 00:06:30.920 [2024-11-27 20:56:26.824685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.920 [2024-11-27 20:56:26.824771] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877433 ] 00:06:30.920 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.920 [2024-11-27 20:56:26.888772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.920 [2024-11-27 20:56:27.009739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=0x1 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=decompress 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=software 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@23 -- # accel_module=software 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=32 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=32 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=2 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val=Yes 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:30.920 20:56:27 -- accel/accel.sh@21 -- # val= 00:06:30.920 20:56:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # IFS=: 00:06:30.920 20:56:27 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@21 -- # val= 00:06:32.294 20:56:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # IFS=: 00:06:32.294 20:56:28 -- accel/accel.sh@20 -- # read -r var val 00:06:32.294 20:56:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:32.294 20:56:28 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:32.295 20:56:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:32.295 00:06:32.295 real 0m2.976s 00:06:32.295 user 0m2.684s 00:06:32.295 sys 0m0.284s 00:06:32.295 20:56:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.295 20:56:28 -- common/autotest_common.sh@10 -- # set +x 00:06:32.295 ************************************ 00:06:32.295 END TEST accel_decomp_mthread 00:06:32.295 ************************************ 00:06:32.295 20:56:28 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.295 20:56:28 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:32.295 20:56:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.295 20:56:28 -- common/autotest_common.sh@10 -- # set +x 00:06:32.295 ************************************ 00:06:32.295 START TEST accel_deomp_full_mthread 00:06:32.295 ************************************ 00:06:32.295 20:56:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.295 20:56:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.295 20:56:28 -- accel/accel.sh@17 -- # local accel_module 00:06:32.295 20:56:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.295 20:56:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.295 20:56:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.295 20:56:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.295 20:56:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.295 20:56:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.295 20:56:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.295 20:56:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.295 20:56:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.295 20:56:28 -- accel/accel.sh@42 -- # jq -r . 00:06:32.295 [2024-11-27 20:56:28.349395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.295 [2024-11-27 20:56:28.349478] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877594 ] 00:06:32.295 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.295 [2024-11-27 20:56:28.415986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.553 [2024-11-27 20:56:28.536738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.925 20:56:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:33.925 00:06:33.925 SPDK Configuration: 00:06:33.925 Core mask: 0x1 00:06:33.925 00:06:33.925 Accel Perf Configuration: 00:06:33.925 Workload Type: decompress 00:06:33.925 Transfer size: 111250 bytes 00:06:33.925 Vector count 1 00:06:33.925 Module: software 00:06:33.925 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:33.925 Queue depth: 32 00:06:33.925 Allocate depth: 32 00:06:33.925 # threads/core: 2 00:06:33.925 Run time: 1 seconds 00:06:33.925 Verify: Yes 00:06:33.925 00:06:33.925 Running for 1 seconds... 00:06:33.925 00:06:33.925 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:33.925 ------------------------------------------------------------------------------------ 00:06:33.925 0,1 1952/s 80 MiB/s 0 0 00:06:33.925 0,0 1920/s 79 MiB/s 0 0 00:06:33.925 ==================================================================================== 00:06:33.925 Total 3872/s 410 MiB/s 0 0' 00:06:33.925 20:56:29 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.925 20:56:29 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.925 20:56:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.925 20:56:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.925 20:56:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.925 20:56:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.925 20:56:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.925 20:56:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.925 20:56:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.925 20:56:29 -- accel/accel.sh@42 -- # jq -r . 00:06:33.925 [2024-11-27 20:56:29.863217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.925 [2024-11-27 20:56:29.863299] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3877777 ] 00:06:33.925 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.925 [2024-11-27 20:56:29.925448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.925 [2024-11-27 20:56:30.052957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=0x1 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=decompress 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=software 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@23 -- # accel_module=software 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=32 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=32 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=2 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val=Yes 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:33.925 20:56:30 -- accel/accel.sh@21 -- # val= 00:06:33.925 20:56:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # IFS=: 00:06:33.925 20:56:30 -- accel/accel.sh@20 -- # read -r var val 00:06:35.300 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@21 -- # val= 00:06:35.301 20:56:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # IFS=: 00:06:35.301 20:56:31 -- accel/accel.sh@20 -- # read -r var val 00:06:35.301 20:56:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.301 20:56:31 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:35.301 20:56:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.301 00:06:35.301 real 0m3.040s 00:06:35.301 user 0m2.741s 00:06:35.301 sys 0m0.291s 00:06:35.301 20:56:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.301 20:56:31 -- common/autotest_common.sh@10 -- # set +x 00:06:35.301 ************************************ 00:06:35.301 END TEST accel_deomp_full_mthread 00:06:35.301 ************************************ 00:06:35.301 20:56:31 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:35.301 20:56:31 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.301 20:56:31 -- accel/accel.sh@129 -- # build_accel_config 00:06:35.301 20:56:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:35.301 20:56:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.301 20:56:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.301 20:56:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.301 20:56:31 -- common/autotest_common.sh@10 -- # set +x 00:06:35.301 20:56:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.301 20:56:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.301 20:56:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.301 20:56:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.301 20:56:31 -- accel/accel.sh@42 -- # jq -r . 00:06:35.301 ************************************ 00:06:35.301 START TEST accel_dif_functional_tests 00:06:35.301 ************************************ 00:06:35.301 20:56:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.301 [2024-11-27 20:56:31.435039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.301 [2024-11-27 20:56:31.435121] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3878022 ] 00:06:35.301 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.301 [2024-11-27 20:56:31.502018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:35.560 [2024-11-27 20:56:31.625471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.560 [2024-11-27 20:56:31.625542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.560 [2024-11-27 20:56:31.625553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.560 00:06:35.560 00:06:35.560 CUnit - A unit testing framework for C - Version 2.1-3 00:06:35.560 http://cunit.sourceforge.net/ 00:06:35.560 00:06:35.560 00:06:35.560 Suite: accel_dif 00:06:35.560 Test: verify: DIF generated, GUARD check ...passed 00:06:35.560 Test: verify: DIF generated, APPTAG check ...passed 00:06:35.560 Test: verify: DIF generated, REFTAG check ...passed 00:06:35.560 Test: verify: DIF not generated, GUARD check ...[2024-11-27 20:56:31.728206] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:35.560 [2024-11-27 20:56:31.728276] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:35.560 passed 00:06:35.560 Test: verify: DIF not generated, APPTAG check ...[2024-11-27 20:56:31.728319] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:35.560 [2024-11-27 20:56:31.728349] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:35.560 passed 00:06:35.560 Test: verify: DIF not generated, REFTAG check ...[2024-11-27 20:56:31.728386] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:35.560 [2024-11-27 20:56:31.728413] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:35.560 passed 00:06:35.560 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:35.560 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-27 20:56:31.728482] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:35.560 passed 00:06:35.560 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:35.560 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:35.560 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:35.560 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-27 20:56:31.728651] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:35.560 passed 00:06:35.560 Test: generate copy: DIF generated, GUARD check ...passed 00:06:35.560 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:35.560 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:35.560 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:35.560 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:35.560 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:35.560 Test: generate copy: iovecs-len validate ...[2024-11-27 20:56:31.728911] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:35.560 passed 00:06:35.560 Test: generate copy: buffer alignment validate ...passed 00:06:35.560 00:06:35.560 Run Summary: Type Total Ran Passed Failed Inactive 00:06:35.560 suites 1 1 n/a 0 0 00:06:35.560 tests 20 20 20 0 0 00:06:35.560 asserts 204 204 204 0 n/a 00:06:35.560 00:06:35.560 Elapsed time = 0.003 seconds 00:06:35.865 00:06:35.865 real 0m0.601s 00:06:35.865 user 0m0.909s 00:06:35.865 sys 0m0.193s 00:06:35.865 20:56:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.865 20:56:31 -- common/autotest_common.sh@10 -- # set +x 00:06:35.865 ************************************ 00:06:35.865 END TEST accel_dif_functional_tests 00:06:35.865 ************************************ 00:06:35.865 00:06:35.865 real 1m3.444s 00:06:35.865 user 1m11.207s 00:06:35.865 sys 0m7.393s 00:06:35.865 20:56:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.865 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:35.865 ************************************ 00:06:35.865 END TEST accel 00:06:35.865 ************************************ 00:06:35.865 20:56:32 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:35.865 20:56:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.865 20:56:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.865 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:35.865 ************************************ 00:06:35.865 START TEST accel_rpc 00:06:35.865 ************************************ 00:06:35.865 20:56:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:35.865 * Looking for test storage... 00:06:35.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:35.865 20:56:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:35.865 20:56:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:35.865 20:56:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:36.124 20:56:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:36.124 20:56:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:36.124 20:56:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:36.124 20:56:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:36.124 20:56:32 -- scripts/common.sh@335 -- # IFS=.-: 00:06:36.124 20:56:32 -- scripts/common.sh@335 -- # read -ra ver1 00:06:36.124 20:56:32 -- scripts/common.sh@336 -- # IFS=.-: 00:06:36.124 20:56:32 -- scripts/common.sh@336 -- # read -ra ver2 00:06:36.124 20:56:32 -- scripts/common.sh@337 -- # local 'op=<' 00:06:36.124 20:56:32 -- scripts/common.sh@339 -- # ver1_l=2 00:06:36.124 20:56:32 -- scripts/common.sh@340 -- # ver2_l=1 00:06:36.124 20:56:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:36.124 20:56:32 -- scripts/common.sh@343 -- # case "$op" in 00:06:36.124 20:56:32 -- scripts/common.sh@344 -- # : 1 00:06:36.124 20:56:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:36.124 20:56:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:36.124 20:56:32 -- scripts/common.sh@364 -- # decimal 1 00:06:36.124 20:56:32 -- scripts/common.sh@352 -- # local d=1 00:06:36.124 20:56:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:36.124 20:56:32 -- scripts/common.sh@354 -- # echo 1 00:06:36.124 20:56:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:36.124 20:56:32 -- scripts/common.sh@365 -- # decimal 2 00:06:36.124 20:56:32 -- scripts/common.sh@352 -- # local d=2 00:06:36.125 20:56:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:36.125 20:56:32 -- scripts/common.sh@354 -- # echo 2 00:06:36.125 20:56:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:36.125 20:56:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:36.125 20:56:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:36.125 20:56:32 -- scripts/common.sh@367 -- # return 0 00:06:36.125 20:56:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:36.125 20:56:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:36.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.125 --rc genhtml_branch_coverage=1 00:06:36.125 --rc genhtml_function_coverage=1 00:06:36.125 --rc genhtml_legend=1 00:06:36.125 --rc geninfo_all_blocks=1 00:06:36.125 --rc geninfo_unexecuted_blocks=1 00:06:36.125 00:06:36.125 ' 00:06:36.125 20:56:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:36.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.125 --rc genhtml_branch_coverage=1 00:06:36.125 --rc genhtml_function_coverage=1 00:06:36.125 --rc genhtml_legend=1 00:06:36.125 --rc geninfo_all_blocks=1 00:06:36.125 --rc geninfo_unexecuted_blocks=1 00:06:36.125 00:06:36.125 ' 00:06:36.125 20:56:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:36.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.125 --rc genhtml_branch_coverage=1 00:06:36.125 --rc genhtml_function_coverage=1 00:06:36.125 --rc genhtml_legend=1 00:06:36.125 --rc geninfo_all_blocks=1 00:06:36.125 --rc geninfo_unexecuted_blocks=1 00:06:36.125 00:06:36.125 ' 00:06:36.125 20:56:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:36.125 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.125 --rc genhtml_branch_coverage=1 00:06:36.125 --rc genhtml_function_coverage=1 00:06:36.125 --rc genhtml_legend=1 00:06:36.125 --rc geninfo_all_blocks=1 00:06:36.125 --rc geninfo_unexecuted_blocks=1 00:06:36.125 00:06:36.125 ' 00:06:36.125 20:56:32 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:36.125 20:56:32 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3878219 00:06:36.125 20:56:32 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:36.125 20:56:32 -- accel/accel_rpc.sh@15 -- # waitforlisten 3878219 00:06:36.125 20:56:32 -- common/autotest_common.sh@829 -- # '[' -z 3878219 ']' 00:06:36.125 20:56:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.125 20:56:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.125 20:56:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.125 20:56:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.125 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.125 [2024-11-27 20:56:32.232885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.125 [2024-11-27 20:56:32.232963] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3878219 ] 00:06:36.125 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.125 [2024-11-27 20:56:32.289715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.383 [2024-11-27 20:56:32.400222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.384 [2024-11-27 20:56:32.400401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.384 20:56:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.384 20:56:32 -- common/autotest_common.sh@862 -- # return 0 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:36.384 20:56:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.384 20:56:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.384 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.384 ************************************ 00:06:36.384 START TEST accel_assign_opcode 00:06:36.384 ************************************ 00:06:36.384 20:56:32 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:36.384 20:56:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.384 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.384 [2024-11-27 20:56:32.497068] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:36.384 20:56:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:36.384 20:56:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.384 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.384 [2024-11-27 20:56:32.505078] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:36.384 20:56:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.384 20:56:32 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:36.384 20:56:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.384 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.642 20:56:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.642 20:56:32 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:36.642 20:56:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.642 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.642 20:56:32 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:36.642 20:56:32 -- accel/accel_rpc.sh@42 -- # grep software 00:06:36.642 20:56:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.642 software 00:06:36.642 00:06:36.642 real 0m0.310s 00:06:36.642 user 0m0.040s 00:06:36.642 sys 0m0.008s 00:06:36.642 20:56:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.642 20:56:32 -- common/autotest_common.sh@10 -- # set +x 00:06:36.642 ************************************ 00:06:36.642 END TEST accel_assign_opcode 00:06:36.642 ************************************ 00:06:36.642 20:56:32 -- accel/accel_rpc.sh@55 -- # killprocess 3878219 00:06:36.642 20:56:32 -- common/autotest_common.sh@936 -- # '[' -z 3878219 ']' 00:06:36.642 20:56:32 -- common/autotest_common.sh@940 -- # kill -0 3878219 00:06:36.642 20:56:32 -- common/autotest_common.sh@941 -- # uname 00:06:36.642 20:56:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.642 20:56:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3878219 00:06:36.642 20:56:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.642 20:56:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.642 20:56:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3878219' 00:06:36.642 killing process with pid 3878219 00:06:36.642 20:56:32 -- common/autotest_common.sh@955 -- # kill 3878219 00:06:36.642 20:56:32 -- common/autotest_common.sh@960 -- # wait 3878219 00:06:37.208 00:06:37.208 real 0m1.299s 00:06:37.208 user 0m1.256s 00:06:37.208 sys 0m0.444s 00:06:37.208 20:56:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.208 20:56:33 -- common/autotest_common.sh@10 -- # set +x 00:06:37.208 ************************************ 00:06:37.208 END TEST accel_rpc 00:06:37.209 ************************************ 00:06:37.209 20:56:33 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:37.209 20:56:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.209 20:56:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.209 20:56:33 -- common/autotest_common.sh@10 -- # set +x 00:06:37.209 ************************************ 00:06:37.209 START TEST app_cmdline 00:06:37.209 ************************************ 00:06:37.209 20:56:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:37.209 * Looking for test storage... 00:06:37.209 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:37.209 20:56:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:37.209 20:56:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:37.209 20:56:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:37.467 20:56:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:37.467 20:56:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:37.467 20:56:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:37.467 20:56:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:37.467 20:56:33 -- scripts/common.sh@335 -- # IFS=.-: 00:06:37.467 20:56:33 -- scripts/common.sh@335 -- # read -ra ver1 00:06:37.467 20:56:33 -- scripts/common.sh@336 -- # IFS=.-: 00:06:37.467 20:56:33 -- scripts/common.sh@336 -- # read -ra ver2 00:06:37.467 20:56:33 -- scripts/common.sh@337 -- # local 'op=<' 00:06:37.467 20:56:33 -- scripts/common.sh@339 -- # ver1_l=2 00:06:37.467 20:56:33 -- scripts/common.sh@340 -- # ver2_l=1 00:06:37.467 20:56:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:37.467 20:56:33 -- scripts/common.sh@343 -- # case "$op" in 00:06:37.467 20:56:33 -- scripts/common.sh@344 -- # : 1 00:06:37.467 20:56:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:37.467 20:56:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:37.467 20:56:33 -- scripts/common.sh@364 -- # decimal 1 00:06:37.467 20:56:33 -- scripts/common.sh@352 -- # local d=1 00:06:37.467 20:56:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:37.467 20:56:33 -- scripts/common.sh@354 -- # echo 1 00:06:37.467 20:56:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:37.467 20:56:33 -- scripts/common.sh@365 -- # decimal 2 00:06:37.467 20:56:33 -- scripts/common.sh@352 -- # local d=2 00:06:37.467 20:56:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:37.467 20:56:33 -- scripts/common.sh@354 -- # echo 2 00:06:37.467 20:56:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:37.467 20:56:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:37.467 20:56:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:37.467 20:56:33 -- scripts/common.sh@367 -- # return 0 00:06:37.467 20:56:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:37.467 20:56:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:37.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.467 --rc genhtml_branch_coverage=1 00:06:37.467 --rc genhtml_function_coverage=1 00:06:37.467 --rc genhtml_legend=1 00:06:37.467 --rc geninfo_all_blocks=1 00:06:37.467 --rc geninfo_unexecuted_blocks=1 00:06:37.467 00:06:37.467 ' 00:06:37.467 20:56:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:37.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.467 --rc genhtml_branch_coverage=1 00:06:37.467 --rc genhtml_function_coverage=1 00:06:37.467 --rc genhtml_legend=1 00:06:37.467 --rc geninfo_all_blocks=1 00:06:37.467 --rc geninfo_unexecuted_blocks=1 00:06:37.467 00:06:37.467 ' 00:06:37.467 20:56:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:37.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.467 --rc genhtml_branch_coverage=1 00:06:37.467 --rc genhtml_function_coverage=1 00:06:37.467 --rc genhtml_legend=1 00:06:37.467 --rc geninfo_all_blocks=1 00:06:37.467 --rc geninfo_unexecuted_blocks=1 00:06:37.467 00:06:37.467 ' 00:06:37.467 20:56:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:37.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.467 --rc genhtml_branch_coverage=1 00:06:37.467 --rc genhtml_function_coverage=1 00:06:37.467 --rc genhtml_legend=1 00:06:37.467 --rc geninfo_all_blocks=1 00:06:37.467 --rc geninfo_unexecuted_blocks=1 00:06:37.467 00:06:37.467 ' 00:06:37.467 20:56:33 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:37.467 20:56:33 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3878432 00:06:37.468 20:56:33 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:37.468 20:56:33 -- app/cmdline.sh@18 -- # waitforlisten 3878432 00:06:37.468 20:56:33 -- common/autotest_common.sh@829 -- # '[' -z 3878432 ']' 00:06:37.468 20:56:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.468 20:56:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.468 20:56:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.468 20:56:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.468 20:56:33 -- common/autotest_common.sh@10 -- # set +x 00:06:37.468 [2024-11-27 20:56:33.580276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.468 [2024-11-27 20:56:33.580359] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3878432 ] 00:06:37.468 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.468 [2024-11-27 20:56:33.637275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.726 [2024-11-27 20:56:33.753986] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.726 [2024-11-27 20:56:33.754142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.661 20:56:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.661 20:56:34 -- common/autotest_common.sh@862 -- # return 0 00:06:38.661 20:56:34 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:38.661 { 00:06:38.661 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:38.661 "fields": { 00:06:38.661 "major": 24, 00:06:38.661 "minor": 1, 00:06:38.661 "patch": 1, 00:06:38.661 "suffix": "-pre", 00:06:38.661 "commit": "c13c99a5e" 00:06:38.661 } 00:06:38.661 } 00:06:38.661 20:56:34 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:38.661 20:56:34 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:38.661 20:56:34 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:38.661 20:56:34 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:38.661 20:56:34 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:38.661 20:56:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.661 20:56:34 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:38.661 20:56:34 -- app/cmdline.sh@26 -- # sort 00:06:38.661 20:56:34 -- common/autotest_common.sh@10 -- # set +x 00:06:38.661 20:56:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.919 20:56:34 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:38.919 20:56:34 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:38.919 20:56:34 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:38.919 20:56:34 -- common/autotest_common.sh@650 -- # local es=0 00:06:38.919 20:56:34 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:38.919 20:56:34 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.919 20:56:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.919 20:56:34 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.919 20:56:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.919 20:56:34 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.919 20:56:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.919 20:56:34 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.919 20:56:34 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:38.919 20:56:34 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:38.919 request: 00:06:38.919 { 00:06:38.919 "method": "env_dpdk_get_mem_stats", 00:06:38.919 "req_id": 1 00:06:38.919 } 00:06:38.919 Got JSON-RPC error response 00:06:38.919 response: 00:06:38.919 { 00:06:38.919 "code": -32601, 00:06:38.919 "message": "Method not found" 00:06:38.919 } 00:06:39.178 20:56:35 -- common/autotest_common.sh@653 -- # es=1 00:06:39.178 20:56:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:39.178 20:56:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:39.178 20:56:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:39.178 20:56:35 -- app/cmdline.sh@1 -- # killprocess 3878432 00:06:39.178 20:56:35 -- common/autotest_common.sh@936 -- # '[' -z 3878432 ']' 00:06:39.178 20:56:35 -- common/autotest_common.sh@940 -- # kill -0 3878432 00:06:39.178 20:56:35 -- common/autotest_common.sh@941 -- # uname 00:06:39.178 20:56:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.178 20:56:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3878432 00:06:39.178 20:56:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.178 20:56:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.178 20:56:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3878432' 00:06:39.178 killing process with pid 3878432 00:06:39.178 20:56:35 -- common/autotest_common.sh@955 -- # kill 3878432 00:06:39.178 20:56:35 -- common/autotest_common.sh@960 -- # wait 3878432 00:06:39.743 00:06:39.744 real 0m2.308s 00:06:39.744 user 0m2.947s 00:06:39.744 sys 0m0.511s 00:06:39.744 20:56:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.744 20:56:35 -- common/autotest_common.sh@10 -- # set +x 00:06:39.744 ************************************ 00:06:39.744 END TEST app_cmdline 00:06:39.744 ************************************ 00:06:39.744 20:56:35 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.744 20:56:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.744 20:56:35 -- common/autotest_common.sh@10 -- # set +x 00:06:39.744 ************************************ 00:06:39.744 START TEST version 00:06:39.744 ************************************ 00:06:39.744 20:56:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.744 * Looking for test storage... 00:06:39.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.744 20:56:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.744 20:56:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.744 20:56:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.744 20:56:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.744 20:56:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.744 20:56:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.744 20:56:35 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.744 20:56:35 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.744 20:56:35 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.744 20:56:35 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.744 20:56:35 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.744 20:56:35 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.744 20:56:35 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.744 20:56:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.744 20:56:35 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.744 20:56:35 -- scripts/common.sh@344 -- # : 1 00:06:39.744 20:56:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.744 20:56:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.744 20:56:35 -- scripts/common.sh@364 -- # decimal 1 00:06:39.744 20:56:35 -- scripts/common.sh@352 -- # local d=1 00:06:39.744 20:56:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.744 20:56:35 -- scripts/common.sh@354 -- # echo 1 00:06:39.744 20:56:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.744 20:56:35 -- scripts/common.sh@365 -- # decimal 2 00:06:39.744 20:56:35 -- scripts/common.sh@352 -- # local d=2 00:06:39.744 20:56:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.744 20:56:35 -- scripts/common.sh@354 -- # echo 2 00:06:39.744 20:56:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.744 20:56:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.744 20:56:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.744 20:56:35 -- scripts/common.sh@367 -- # return 0 00:06:39.744 20:56:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.744 --rc genhtml_branch_coverage=1 00:06:39.744 --rc genhtml_function_coverage=1 00:06:39.744 --rc genhtml_legend=1 00:06:39.744 --rc geninfo_all_blocks=1 00:06:39.744 --rc geninfo_unexecuted_blocks=1 00:06:39.744 00:06:39.744 ' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.744 --rc genhtml_branch_coverage=1 00:06:39.744 --rc genhtml_function_coverage=1 00:06:39.744 --rc genhtml_legend=1 00:06:39.744 --rc geninfo_all_blocks=1 00:06:39.744 --rc geninfo_unexecuted_blocks=1 00:06:39.744 00:06:39.744 ' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.744 --rc genhtml_branch_coverage=1 00:06:39.744 --rc genhtml_function_coverage=1 00:06:39.744 --rc genhtml_legend=1 00:06:39.744 --rc geninfo_all_blocks=1 00:06:39.744 --rc geninfo_unexecuted_blocks=1 00:06:39.744 00:06:39.744 ' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.744 --rc genhtml_branch_coverage=1 00:06:39.744 --rc genhtml_function_coverage=1 00:06:39.744 --rc genhtml_legend=1 00:06:39.744 --rc geninfo_all_blocks=1 00:06:39.744 --rc geninfo_unexecuted_blocks=1 00:06:39.744 00:06:39.744 ' 00:06:39.744 20:56:35 -- app/version.sh@17 -- # get_header_version major 00:06:39.744 20:56:35 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.744 20:56:35 -- app/version.sh@14 -- # cut -f2 00:06:39.744 20:56:35 -- app/version.sh@14 -- # tr -d '"' 00:06:39.744 20:56:35 -- app/version.sh@17 -- # major=24 00:06:39.744 20:56:35 -- app/version.sh@18 -- # get_header_version minor 00:06:39.744 20:56:35 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.744 20:56:35 -- app/version.sh@14 -- # cut -f2 00:06:39.744 20:56:35 -- app/version.sh@14 -- # tr -d '"' 00:06:39.744 20:56:35 -- app/version.sh@18 -- # minor=1 00:06:39.744 20:56:35 -- app/version.sh@19 -- # get_header_version patch 00:06:39.744 20:56:35 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.744 20:56:35 -- app/version.sh@14 -- # cut -f2 00:06:39.744 20:56:35 -- app/version.sh@14 -- # tr -d '"' 00:06:39.744 20:56:35 -- app/version.sh@19 -- # patch=1 00:06:39.744 20:56:35 -- app/version.sh@20 -- # get_header_version suffix 00:06:39.744 20:56:35 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.744 20:56:35 -- app/version.sh@14 -- # cut -f2 00:06:39.744 20:56:35 -- app/version.sh@14 -- # tr -d '"' 00:06:39.744 20:56:35 -- app/version.sh@20 -- # suffix=-pre 00:06:39.744 20:56:35 -- app/version.sh@22 -- # version=24.1 00:06:39.744 20:56:35 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:39.744 20:56:35 -- app/version.sh@25 -- # version=24.1.1 00:06:39.744 20:56:35 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:39.744 20:56:35 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:39.744 20:56:35 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:39.744 20:56:35 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:39.744 20:56:35 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:39.744 00:06:39.744 real 0m0.194s 00:06:39.744 user 0m0.135s 00:06:39.744 sys 0m0.085s 00:06:39.744 20:56:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.744 20:56:35 -- common/autotest_common.sh@10 -- # set +x 00:06:39.744 ************************************ 00:06:39.744 END TEST version 00:06:39.744 ************************************ 00:06:39.744 20:56:35 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@191 -- # uname -s 00:06:39.744 20:56:35 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:39.744 20:56:35 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:39.744 20:56:35 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:39.744 20:56:35 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:39.744 20:56:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:39.744 20:56:35 -- common/autotest_common.sh@10 -- # set +x 00:06:39.744 20:56:35 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:39.744 20:56:35 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:39.744 20:56:35 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:39.744 20:56:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:39.744 20:56:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.744 20:56:35 -- common/autotest_common.sh@10 -- # set +x 00:06:39.744 ************************************ 00:06:39.744 START TEST nvmf_tcp 00:06:39.744 ************************************ 00:06:39.744 20:56:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:40.003 * Looking for test storage... 00:06:40.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:40.003 20:56:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.003 20:56:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.003 20:56:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.003 20:56:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.003 20:56:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.003 20:56:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.003 20:56:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.003 20:56:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.003 20:56:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.003 20:56:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.003 20:56:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.003 20:56:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.003 20:56:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.003 20:56:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.003 20:56:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.003 20:56:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.003 20:56:36 -- scripts/common.sh@344 -- # : 1 00:06:40.003 20:56:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.003 20:56:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.003 20:56:36 -- scripts/common.sh@364 -- # decimal 1 00:06:40.003 20:56:36 -- scripts/common.sh@352 -- # local d=1 00:06:40.003 20:56:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.003 20:56:36 -- scripts/common.sh@354 -- # echo 1 00:06:40.003 20:56:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.003 20:56:36 -- scripts/common.sh@365 -- # decimal 2 00:06:40.003 20:56:36 -- scripts/common.sh@352 -- # local d=2 00:06:40.003 20:56:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.003 20:56:36 -- scripts/common.sh@354 -- # echo 2 00:06:40.003 20:56:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.003 20:56:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.003 20:56:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.003 20:56:36 -- scripts/common.sh@367 -- # return 0 00:06:40.003 20:56:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.003 20:56:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.003 --rc genhtml_branch_coverage=1 00:06:40.003 --rc genhtml_function_coverage=1 00:06:40.003 --rc genhtml_legend=1 00:06:40.003 --rc geninfo_all_blocks=1 00:06:40.003 --rc geninfo_unexecuted_blocks=1 00:06:40.003 00:06:40.003 ' 00:06:40.003 20:56:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.004 20:56:36 -- nvmf/common.sh@7 -- # uname -s 00:06:40.004 20:56:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.004 20:56:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.004 20:56:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.004 20:56:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.004 20:56:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.004 20:56:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.004 20:56:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.004 20:56:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.004 20:56:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.004 20:56:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.004 20:56:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.004 20:56:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.004 20:56:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.004 20:56:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.004 20:56:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.004 20:56:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.004 20:56:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.004 20:56:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.004 20:56:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.004 20:56:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.004 20:56:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.004 20:56:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.004 20:56:36 -- paths/export.sh@5 -- # export PATH 00:06:40.004 20:56:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.004 20:56:36 -- nvmf/common.sh@46 -- # : 0 00:06:40.004 20:56:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.004 20:56:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.004 20:56:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.004 20:56:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.004 20:56:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.004 20:56:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.004 20:56:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.004 20:56:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:40.004 20:56:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.004 20:56:36 -- common/autotest_common.sh@10 -- # set +x 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:40.004 20:56:36 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.004 20:56:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.004 20:56:36 -- common/autotest_common.sh@10 -- # set +x 00:06:40.004 ************************************ 00:06:40.004 START TEST nvmf_example 00:06:40.004 ************************************ 00:06:40.004 20:56:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.004 * Looking for test storage... 00:06:40.004 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:40.004 20:56:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.004 20:56:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.004 20:56:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.004 20:56:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.004 20:56:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.004 20:56:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.004 20:56:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.004 20:56:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.004 20:56:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.004 20:56:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.004 20:56:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.004 20:56:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.004 20:56:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.004 20:56:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.004 20:56:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.004 20:56:36 -- scripts/common.sh@344 -- # : 1 00:06:40.004 20:56:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.004 20:56:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.004 20:56:36 -- scripts/common.sh@364 -- # decimal 1 00:06:40.004 20:56:36 -- scripts/common.sh@352 -- # local d=1 00:06:40.004 20:56:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.004 20:56:36 -- scripts/common.sh@354 -- # echo 1 00:06:40.004 20:56:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.004 20:56:36 -- scripts/common.sh@365 -- # decimal 2 00:06:40.004 20:56:36 -- scripts/common.sh@352 -- # local d=2 00:06:40.004 20:56:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.004 20:56:36 -- scripts/common.sh@354 -- # echo 2 00:06:40.004 20:56:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.004 20:56:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.004 20:56:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.004 20:56:36 -- scripts/common.sh@367 -- # return 0 00:06:40.004 20:56:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.004 --rc genhtml_branch_coverage=1 00:06:40.004 --rc genhtml_function_coverage=1 00:06:40.004 --rc genhtml_legend=1 00:06:40.004 --rc geninfo_all_blocks=1 00:06:40.004 --rc geninfo_unexecuted_blocks=1 00:06:40.004 00:06:40.004 ' 00:06:40.004 20:56:36 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.004 20:56:36 -- nvmf/common.sh@7 -- # uname -s 00:06:40.004 20:56:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.004 20:56:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.004 20:56:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.004 20:56:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.004 20:56:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.004 20:56:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.004 20:56:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.004 20:56:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.005 20:56:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.005 20:56:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.262 20:56:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.262 20:56:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.262 20:56:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.262 20:56:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.262 20:56:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.262 20:56:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.262 20:56:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.262 20:56:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.262 20:56:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.262 20:56:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.262 20:56:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.262 20:56:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.262 20:56:36 -- paths/export.sh@5 -- # export PATH 00:06:40.263 20:56:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.263 20:56:36 -- nvmf/common.sh@46 -- # : 0 00:06:40.263 20:56:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.263 20:56:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.263 20:56:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.263 20:56:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.263 20:56:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.263 20:56:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.263 20:56:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.263 20:56:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.263 20:56:36 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:40.263 20:56:36 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:40.263 20:56:36 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:40.263 20:56:36 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:40.263 20:56:36 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:40.263 20:56:36 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:40.263 20:56:36 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:40.263 20:56:36 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:40.263 20:56:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.263 20:56:36 -- common/autotest_common.sh@10 -- # set +x 00:06:40.263 20:56:36 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:40.263 20:56:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:40.263 20:56:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:40.263 20:56:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:40.263 20:56:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:40.263 20:56:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:40.263 20:56:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.263 20:56:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.263 20:56:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:40.263 20:56:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:40.263 20:56:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:40.263 20:56:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:40.263 20:56:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.165 20:56:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:42.165 20:56:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:42.165 20:56:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:42.165 20:56:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:42.165 20:56:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:42.165 20:56:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:42.165 20:56:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:42.165 20:56:38 -- nvmf/common.sh@294 -- # net_devs=() 00:06:42.165 20:56:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:42.165 20:56:38 -- nvmf/common.sh@295 -- # e810=() 00:06:42.423 20:56:38 -- nvmf/common.sh@295 -- # local -ga e810 00:06:42.423 20:56:38 -- nvmf/common.sh@296 -- # x722=() 00:06:42.423 20:56:38 -- nvmf/common.sh@296 -- # local -ga x722 00:06:42.423 20:56:38 -- nvmf/common.sh@297 -- # mlx=() 00:06:42.423 20:56:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:42.423 20:56:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:42.423 20:56:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:42.423 20:56:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:42.423 20:56:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:42.423 20:56:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:42.424 20:56:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.424 20:56:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:42.424 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:42.424 20:56:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.424 20:56:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:42.424 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:42.424 20:56:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.424 20:56:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.424 20:56:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.424 20:56:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:42.424 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:42.424 20:56:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.424 20:56:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.424 20:56:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.424 20:56:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:42.424 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:42.424 20:56:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:42.424 20:56:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:42.424 20:56:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:42.424 20:56:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:42.424 20:56:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:42.424 20:56:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:42.424 20:56:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:42.424 20:56:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:42.424 20:56:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:42.424 20:56:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:42.424 20:56:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:42.424 20:56:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:42.424 20:56:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:42.424 20:56:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:42.424 20:56:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:42.424 20:56:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:42.424 20:56:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:42.424 20:56:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:42.424 20:56:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:42.424 20:56:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:42.424 20:56:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:42.424 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:42.424 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.348 ms 00:06:42.424 00:06:42.424 --- 10.0.0.2 ping statistics --- 00:06:42.424 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:42.424 rtt min/avg/max/mdev = 0.348/0.348/0.348/0.000 ms 00:06:42.424 20:56:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:42.424 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:42.424 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:06:42.424 00:06:42.424 --- 10.0.0.1 ping statistics --- 00:06:42.424 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:42.424 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:06:42.424 20:56:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:42.424 20:56:38 -- nvmf/common.sh@410 -- # return 0 00:06:42.424 20:56:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:42.424 20:56:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:42.424 20:56:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:42.424 20:56:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:42.424 20:56:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:42.424 20:56:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:42.424 20:56:38 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:42.424 20:56:38 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:42.424 20:56:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:42.424 20:56:38 -- common/autotest_common.sh@10 -- # set +x 00:06:42.424 20:56:38 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:42.424 20:56:38 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:42.424 20:56:38 -- target/nvmf_example.sh@34 -- # nvmfpid=3880497 00:06:42.424 20:56:38 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:42.424 20:56:38 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:42.424 20:56:38 -- target/nvmf_example.sh@36 -- # waitforlisten 3880497 00:06:42.424 20:56:38 -- common/autotest_common.sh@829 -- # '[' -z 3880497 ']' 00:06:42.424 20:56:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.424 20:56:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.424 20:56:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.424 20:56:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.424 20:56:38 -- common/autotest_common.sh@10 -- # set +x 00:06:42.682 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.613 20:56:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.614 20:56:39 -- common/autotest_common.sh@862 -- # return 0 00:06:43.614 20:56:39 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:43.614 20:56:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:43.614 20:56:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.614 20:56:39 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:43.614 20:56:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.614 20:56:39 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:43.614 20:56:39 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:43.614 20:56:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.614 20:56:39 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:43.614 20:56:39 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:43.614 20:56:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.614 20:56:39 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:43.614 20:56:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.614 20:56:39 -- common/autotest_common.sh@10 -- # set +x 00:06:43.614 20:56:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.614 20:56:39 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:43.614 20:56:39 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:43.614 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.811 Initializing NVMe Controllers 00:06:55.811 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:55.811 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:55.811 Initialization complete. Launching workers. 00:06:55.811 ======================================================== 00:06:55.811 Latency(us) 00:06:55.811 Device Information : IOPS MiB/s Average min max 00:06:55.811 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15525.85 60.65 4121.61 859.94 18228.20 00:06:55.811 ======================================================== 00:06:55.811 Total : 15525.85 60.65 4121.61 859.94 18228.20 00:06:55.811 00:06:55.811 20:56:49 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:55.811 20:56:49 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:55.811 20:56:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:55.811 20:56:49 -- nvmf/common.sh@116 -- # sync 00:06:55.811 20:56:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:55.811 20:56:49 -- nvmf/common.sh@119 -- # set +e 00:06:55.811 20:56:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:55.811 20:56:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:55.811 rmmod nvme_tcp 00:06:55.811 rmmod nvme_fabrics 00:06:55.811 rmmod nvme_keyring 00:06:55.811 20:56:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:55.811 20:56:49 -- nvmf/common.sh@123 -- # set -e 00:06:55.811 20:56:49 -- nvmf/common.sh@124 -- # return 0 00:06:55.811 20:56:49 -- nvmf/common.sh@477 -- # '[' -n 3880497 ']' 00:06:55.811 20:56:49 -- nvmf/common.sh@478 -- # killprocess 3880497 00:06:55.811 20:56:49 -- common/autotest_common.sh@936 -- # '[' -z 3880497 ']' 00:06:55.811 20:56:49 -- common/autotest_common.sh@940 -- # kill -0 3880497 00:06:55.811 20:56:49 -- common/autotest_common.sh@941 -- # uname 00:06:55.811 20:56:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:55.811 20:56:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3880497 00:06:55.811 20:56:50 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:55.811 20:56:50 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:55.811 20:56:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3880497' 00:06:55.811 killing process with pid 3880497 00:06:55.811 20:56:50 -- common/autotest_common.sh@955 -- # kill 3880497 00:06:55.811 20:56:50 -- common/autotest_common.sh@960 -- # wait 3880497 00:06:55.811 nvmf threads initialize successfully 00:06:55.811 bdev subsystem init successfully 00:06:55.811 created a nvmf target service 00:06:55.811 create targets's poll groups done 00:06:55.811 all subsystems of target started 00:06:55.811 nvmf target is running 00:06:55.811 all subsystems of target stopped 00:06:55.811 destroy targets's poll groups done 00:06:55.812 destroyed the nvmf target service 00:06:55.812 bdev subsystem finish successfully 00:06:55.812 nvmf threads destroy successfully 00:06:55.812 20:56:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:55.812 20:56:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:55.812 20:56:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:55.812 20:56:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:55.812 20:56:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:55.812 20:56:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:55.812 20:56:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:55.812 20:56:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:56.070 20:56:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:56.070 20:56:52 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:56.070 20:56:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:56.070 20:56:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.331 00:06:56.331 real 0m16.211s 00:06:56.331 user 0m45.549s 00:06:56.331 sys 0m3.332s 00:06:56.331 20:56:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.331 20:56:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.331 ************************************ 00:06:56.331 END TEST nvmf_example 00:06:56.331 ************************************ 00:06:56.331 20:56:52 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:56.331 20:56:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.331 20:56:52 -- common/autotest_common.sh@10 -- # set +x 00:06:56.331 ************************************ 00:06:56.331 START TEST nvmf_filesystem 00:06:56.331 ************************************ 00:06:56.331 20:56:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:56.331 * Looking for test storage... 00:06:56.331 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.331 20:56:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:56.331 20:56:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:56.331 20:56:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:56.331 20:56:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:56.331 20:56:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:56.331 20:56:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:56.331 20:56:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:56.331 20:56:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:56.331 20:56:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:56.331 20:56:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:56.331 20:56:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:56.331 20:56:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:56.331 20:56:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:56.331 20:56:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:56.331 20:56:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:56.331 20:56:52 -- scripts/common.sh@344 -- # : 1 00:06:56.331 20:56:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:56.331 20:56:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:56.331 20:56:52 -- scripts/common.sh@364 -- # decimal 1 00:06:56.331 20:56:52 -- scripts/common.sh@352 -- # local d=1 00:06:56.331 20:56:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:56.331 20:56:52 -- scripts/common.sh@354 -- # echo 1 00:06:56.331 20:56:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:56.331 20:56:52 -- scripts/common.sh@365 -- # decimal 2 00:06:56.331 20:56:52 -- scripts/common.sh@352 -- # local d=2 00:06:56.331 20:56:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:56.331 20:56:52 -- scripts/common.sh@354 -- # echo 2 00:06:56.331 20:56:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:56.331 20:56:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:56.331 20:56:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:56.331 20:56:52 -- scripts/common.sh@367 -- # return 0 00:06:56.331 20:56:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:56.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.331 --rc genhtml_branch_coverage=1 00:06:56.331 --rc genhtml_function_coverage=1 00:06:56.331 --rc genhtml_legend=1 00:06:56.331 --rc geninfo_all_blocks=1 00:06:56.331 --rc geninfo_unexecuted_blocks=1 00:06:56.331 00:06:56.331 ' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:56.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.331 --rc genhtml_branch_coverage=1 00:06:56.331 --rc genhtml_function_coverage=1 00:06:56.331 --rc genhtml_legend=1 00:06:56.331 --rc geninfo_all_blocks=1 00:06:56.331 --rc geninfo_unexecuted_blocks=1 00:06:56.331 00:06:56.331 ' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:56.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.331 --rc genhtml_branch_coverage=1 00:06:56.331 --rc genhtml_function_coverage=1 00:06:56.331 --rc genhtml_legend=1 00:06:56.331 --rc geninfo_all_blocks=1 00:06:56.331 --rc geninfo_unexecuted_blocks=1 00:06:56.331 00:06:56.331 ' 00:06:56.331 20:56:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:56.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.331 --rc genhtml_branch_coverage=1 00:06:56.331 --rc genhtml_function_coverage=1 00:06:56.331 --rc genhtml_legend=1 00:06:56.331 --rc geninfo_all_blocks=1 00:06:56.331 --rc geninfo_unexecuted_blocks=1 00:06:56.331 00:06:56.331 ' 00:06:56.331 20:56:52 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:56.331 20:56:52 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:56.331 20:56:52 -- common/autotest_common.sh@34 -- # set -e 00:06:56.331 20:56:52 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:56.331 20:56:52 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:56.331 20:56:52 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:56.331 20:56:52 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:56.331 20:56:52 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:56.331 20:56:52 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:56.331 20:56:52 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:56.331 20:56:52 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:56.331 20:56:52 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:56.331 20:56:52 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:56.331 20:56:52 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:56.331 20:56:52 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:56.331 20:56:52 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:56.331 20:56:52 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:56.331 20:56:52 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:56.331 20:56:52 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:56.331 20:56:52 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:56.331 20:56:52 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:56.331 20:56:52 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:56.331 20:56:52 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:56.331 20:56:52 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:56.331 20:56:52 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:56.331 20:56:52 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:56.331 20:56:52 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:56.331 20:56:52 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:56.331 20:56:52 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:56.331 20:56:52 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:56.331 20:56:52 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:56.331 20:56:52 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:56.331 20:56:52 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:56.331 20:56:52 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:56.331 20:56:52 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:56.331 20:56:52 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:56.331 20:56:52 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:56.331 20:56:52 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:56.331 20:56:52 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:56.331 20:56:52 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:56.331 20:56:52 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:56.331 20:56:52 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:56.331 20:56:52 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:56.331 20:56:52 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:56.331 20:56:52 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:56.331 20:56:52 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:56.331 20:56:52 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:56.331 20:56:52 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:56.331 20:56:52 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:56.331 20:56:52 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:56.331 20:56:52 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:56.331 20:56:52 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:56.331 20:56:52 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:56.331 20:56:52 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:56.331 20:56:52 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:56.331 20:56:52 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:56.331 20:56:52 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:56.331 20:56:52 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:56.331 20:56:52 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:56.331 20:56:52 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:56.331 20:56:52 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:56.332 20:56:52 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:56.332 20:56:52 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:56.332 20:56:52 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:56.332 20:56:52 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:56.332 20:56:52 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:56.332 20:56:52 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:56.332 20:56:52 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:56.332 20:56:52 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:56.332 20:56:52 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:56.332 20:56:52 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:56.332 20:56:52 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:56.332 20:56:52 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:56.332 20:56:52 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:56.332 20:56:52 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:56.332 20:56:52 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:56.332 20:56:52 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:56.332 20:56:52 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:56.332 20:56:52 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:56.332 20:56:52 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:56.332 20:56:52 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:56.332 20:56:52 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:56.332 20:56:52 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:56.332 20:56:52 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:56.332 20:56:52 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:56.332 20:56:52 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:56.332 20:56:52 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:56.332 20:56:52 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:56.332 20:56:52 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:56.332 20:56:52 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:56.332 20:56:52 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:56.332 20:56:52 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.332 20:56:52 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:56.332 20:56:52 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.332 20:56:52 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:56.332 20:56:52 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:56.332 20:56:52 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:56.332 20:56:52 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:56.332 20:56:52 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:56.332 20:56:52 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:56.332 20:56:52 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:56.332 20:56:52 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:56.332 #define SPDK_CONFIG_H 00:06:56.332 #define SPDK_CONFIG_APPS 1 00:06:56.332 #define SPDK_CONFIG_ARCH native 00:06:56.332 #undef SPDK_CONFIG_ASAN 00:06:56.332 #undef SPDK_CONFIG_AVAHI 00:06:56.332 #undef SPDK_CONFIG_CET 00:06:56.332 #define SPDK_CONFIG_COVERAGE 1 00:06:56.332 #define SPDK_CONFIG_CROSS_PREFIX 00:06:56.332 #undef SPDK_CONFIG_CRYPTO 00:06:56.332 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:56.332 #undef SPDK_CONFIG_CUSTOMOCF 00:06:56.332 #undef SPDK_CONFIG_DAOS 00:06:56.332 #define SPDK_CONFIG_DAOS_DIR 00:06:56.332 #define SPDK_CONFIG_DEBUG 1 00:06:56.332 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:56.332 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:56.332 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:56.332 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:56.332 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:56.332 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:56.332 #define SPDK_CONFIG_EXAMPLES 1 00:06:56.332 #undef SPDK_CONFIG_FC 00:06:56.332 #define SPDK_CONFIG_FC_PATH 00:06:56.332 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:56.332 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:56.332 #undef SPDK_CONFIG_FUSE 00:06:56.332 #undef SPDK_CONFIG_FUZZER 00:06:56.332 #define SPDK_CONFIG_FUZZER_LIB 00:06:56.332 #undef SPDK_CONFIG_GOLANG 00:06:56.332 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:56.332 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:56.332 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:56.332 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:56.332 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:56.332 #define SPDK_CONFIG_IDXD 1 00:06:56.332 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:56.332 #undef SPDK_CONFIG_IPSEC_MB 00:06:56.332 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:56.332 #define SPDK_CONFIG_ISAL 1 00:06:56.332 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:56.332 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:56.332 #define SPDK_CONFIG_LIBDIR 00:06:56.332 #undef SPDK_CONFIG_LTO 00:06:56.332 #define SPDK_CONFIG_MAX_LCORES 00:06:56.332 #define SPDK_CONFIG_NVME_CUSE 1 00:06:56.332 #undef SPDK_CONFIG_OCF 00:06:56.332 #define SPDK_CONFIG_OCF_PATH 00:06:56.332 #define SPDK_CONFIG_OPENSSL_PATH 00:06:56.332 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:56.332 #undef SPDK_CONFIG_PGO_USE 00:06:56.332 #define SPDK_CONFIG_PREFIX /usr/local 00:06:56.332 #undef SPDK_CONFIG_RAID5F 00:06:56.332 #undef SPDK_CONFIG_RBD 00:06:56.332 #define SPDK_CONFIG_RDMA 1 00:06:56.332 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:56.332 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:56.332 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:56.332 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:56.332 #define SPDK_CONFIG_SHARED 1 00:06:56.332 #undef SPDK_CONFIG_SMA 00:06:56.332 #define SPDK_CONFIG_TESTS 1 00:06:56.332 #undef SPDK_CONFIG_TSAN 00:06:56.332 #define SPDK_CONFIG_UBLK 1 00:06:56.332 #define SPDK_CONFIG_UBSAN 1 00:06:56.332 #undef SPDK_CONFIG_UNIT_TESTS 00:06:56.332 #undef SPDK_CONFIG_URING 00:06:56.332 #define SPDK_CONFIG_URING_PATH 00:06:56.332 #undef SPDK_CONFIG_URING_ZNS 00:06:56.332 #undef SPDK_CONFIG_USDT 00:06:56.332 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:56.332 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:56.332 #undef SPDK_CONFIG_VFIO_USER 00:06:56.332 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:56.332 #define SPDK_CONFIG_VHOST 1 00:06:56.332 #define SPDK_CONFIG_VIRTIO 1 00:06:56.332 #undef SPDK_CONFIG_VTUNE 00:06:56.332 #define SPDK_CONFIG_VTUNE_DIR 00:06:56.332 #define SPDK_CONFIG_WERROR 1 00:06:56.332 #define SPDK_CONFIG_WPDK_DIR 00:06:56.332 #undef SPDK_CONFIG_XNVME 00:06:56.332 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:56.332 20:56:52 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:56.332 20:56:52 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:56.332 20:56:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:56.332 20:56:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:56.332 20:56:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:56.332 20:56:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.332 20:56:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.332 20:56:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.332 20:56:52 -- paths/export.sh@5 -- # export PATH 00:06:56.332 20:56:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.332 20:56:52 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:56.332 20:56:52 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:56.332 20:56:52 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:56.332 20:56:52 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:56.332 20:56:52 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:56.332 20:56:52 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:56.332 20:56:52 -- pm/common@16 -- # TEST_TAG=N/A 00:06:56.332 20:56:52 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:56.332 20:56:52 -- common/autotest_common.sh@52 -- # : 1 00:06:56.332 20:56:52 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:56.332 20:56:52 -- common/autotest_common.sh@56 -- # : 0 00:06:56.332 20:56:52 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:56.332 20:56:52 -- common/autotest_common.sh@58 -- # : 0 00:06:56.332 20:56:52 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:56.332 20:56:52 -- common/autotest_common.sh@60 -- # : 1 00:06:56.332 20:56:52 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:56.332 20:56:52 -- common/autotest_common.sh@62 -- # : 0 00:06:56.332 20:56:52 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:56.333 20:56:52 -- common/autotest_common.sh@64 -- # : 00:06:56.333 20:56:52 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:56.333 20:56:52 -- common/autotest_common.sh@66 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:56.333 20:56:52 -- common/autotest_common.sh@68 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:56.333 20:56:52 -- common/autotest_common.sh@70 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:56.333 20:56:52 -- common/autotest_common.sh@72 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:56.333 20:56:52 -- common/autotest_common.sh@74 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:56.333 20:56:52 -- common/autotest_common.sh@76 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:56.333 20:56:52 -- common/autotest_common.sh@78 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:56.333 20:56:52 -- common/autotest_common.sh@80 -- # : 1 00:06:56.333 20:56:52 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:56.333 20:56:52 -- common/autotest_common.sh@82 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:56.333 20:56:52 -- common/autotest_common.sh@84 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:56.333 20:56:52 -- common/autotest_common.sh@86 -- # : 1 00:06:56.333 20:56:52 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:56.333 20:56:52 -- common/autotest_common.sh@88 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:56.333 20:56:52 -- common/autotest_common.sh@90 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:56.333 20:56:52 -- common/autotest_common.sh@92 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:56.333 20:56:52 -- common/autotest_common.sh@94 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:56.333 20:56:52 -- common/autotest_common.sh@96 -- # : tcp 00:06:56.333 20:56:52 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:56.333 20:56:52 -- common/autotest_common.sh@98 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:56.333 20:56:52 -- common/autotest_common.sh@100 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:56.333 20:56:52 -- common/autotest_common.sh@102 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:56.333 20:56:52 -- common/autotest_common.sh@104 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:56.333 20:56:52 -- common/autotest_common.sh@106 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:56.333 20:56:52 -- common/autotest_common.sh@108 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:56.333 20:56:52 -- common/autotest_common.sh@110 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:56.333 20:56:52 -- common/autotest_common.sh@112 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:56.333 20:56:52 -- common/autotest_common.sh@114 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:56.333 20:56:52 -- common/autotest_common.sh@116 -- # : 1 00:06:56.333 20:56:52 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:56.333 20:56:52 -- common/autotest_common.sh@118 -- # : 00:06:56.333 20:56:52 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:56.333 20:56:52 -- common/autotest_common.sh@120 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:56.333 20:56:52 -- common/autotest_common.sh@122 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:56.333 20:56:52 -- common/autotest_common.sh@124 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:56.333 20:56:52 -- common/autotest_common.sh@126 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:56.333 20:56:52 -- common/autotest_common.sh@128 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:56.333 20:56:52 -- common/autotest_common.sh@130 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:56.333 20:56:52 -- common/autotest_common.sh@132 -- # : 00:06:56.333 20:56:52 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:56.333 20:56:52 -- common/autotest_common.sh@134 -- # : true 00:06:56.333 20:56:52 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:56.333 20:56:52 -- common/autotest_common.sh@136 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:56.333 20:56:52 -- common/autotest_common.sh@138 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:56.333 20:56:52 -- common/autotest_common.sh@140 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:56.333 20:56:52 -- common/autotest_common.sh@142 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:56.333 20:56:52 -- common/autotest_common.sh@144 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:56.333 20:56:52 -- common/autotest_common.sh@146 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:56.333 20:56:52 -- common/autotest_common.sh@148 -- # : e810 00:06:56.333 20:56:52 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:56.333 20:56:52 -- common/autotest_common.sh@150 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:56.333 20:56:52 -- common/autotest_common.sh@152 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:56.333 20:56:52 -- common/autotest_common.sh@154 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:56.333 20:56:52 -- common/autotest_common.sh@156 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:56.333 20:56:52 -- common/autotest_common.sh@158 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:56.333 20:56:52 -- common/autotest_common.sh@160 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:56.333 20:56:52 -- common/autotest_common.sh@163 -- # : 00:06:56.333 20:56:52 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:56.333 20:56:52 -- common/autotest_common.sh@165 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:56.333 20:56:52 -- common/autotest_common.sh@167 -- # : 0 00:06:56.333 20:56:52 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:56.333 20:56:52 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.333 20:56:52 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:56.333 20:56:52 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:56.333 20:56:52 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:56.333 20:56:52 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:56.333 20:56:52 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:56.333 20:56:52 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:56.333 20:56:52 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:56.333 20:56:52 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:56.333 20:56:52 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:56.333 20:56:52 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:56.333 20:56:52 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:56.334 20:56:52 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:56.334 20:56:52 -- common/autotest_common.sh@196 -- # cat 00:06:56.334 20:56:52 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:56.334 20:56:52 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:56.334 20:56:52 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:56.334 20:56:52 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:56.334 20:56:52 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:56.334 20:56:52 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:56.334 20:56:52 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:56.334 20:56:52 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.334 20:56:52 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.334 20:56:52 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.334 20:56:52 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.334 20:56:52 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:56.334 20:56:52 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:56.334 20:56:52 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:56.334 20:56:52 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:56.334 20:56:52 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:56.334 20:56:52 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:56.334 20:56:52 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:56.334 20:56:52 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:56.334 20:56:52 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:56.334 20:56:52 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:56.334 20:56:52 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:56.334 20:56:52 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:56.334 20:56:52 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:56.334 20:56:52 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:56.334 20:56:52 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:56.334 20:56:52 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:56.334 20:56:52 -- common/autotest_common.sh@259 -- # valgrind= 00:06:56.334 20:56:52 -- common/autotest_common.sh@265 -- # uname -s 00:06:56.334 20:56:52 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:56.334 20:56:52 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:56.334 20:56:52 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:56.334 20:56:52 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:56.334 20:56:52 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:56.334 20:56:52 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:56.334 20:56:52 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:56.334 20:56:52 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:56.334 20:56:52 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:56.334 20:56:52 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:56.334 20:56:52 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:56.334 20:56:52 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:56.334 20:56:52 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:56.334 20:56:52 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:56.334 20:56:52 -- common/autotest_common.sh@319 -- # [[ -z 3882246 ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@319 -- # kill -0 3882246 00:06:56.334 20:56:52 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:56.334 20:56:52 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:56.334 20:56:52 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:56.334 20:56:52 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:56.334 20:56:52 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:56.334 20:56:52 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:56.334 20:56:52 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:56.334 20:56:52 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.1Iry34 00:06:56.334 20:56:52 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:56.334 20:56:52 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:56.334 20:56:52 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.1Iry34/tests/target /tmp/spdk.1Iry34 00:06:56.594 20:56:52 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@328 -- # df -T 00:06:56.594 20:56:52 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:56.594 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:56.594 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=55380287488 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:06:56.594 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=6608216064 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991659008 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:56.594 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:56.594 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:56.594 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993395712 00:06:56.594 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:56.595 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=856064 00:06:56.595 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.595 20:56:52 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.595 20:56:52 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.595 20:56:52 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:56.595 20:56:52 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:56.595 20:56:52 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:56.595 20:56:52 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.595 20:56:52 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:56.595 * Looking for test storage... 00:06:56.595 20:56:52 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:56.595 20:56:52 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:56.595 20:56:52 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.595 20:56:52 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:56.595 20:56:52 -- common/autotest_common.sh@373 -- # mount=/ 00:06:56.595 20:56:52 -- common/autotest_common.sh@375 -- # target_space=55380287488 00:06:56.595 20:56:52 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:56.595 20:56:52 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:56.595 20:56:52 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@382 -- # new_size=8822808576 00:06:56.595 20:56:52 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:56.595 20:56:52 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.595 20:56:52 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.595 20:56:52 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.595 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.595 20:56:52 -- common/autotest_common.sh@390 -- # return 0 00:06:56.595 20:56:52 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:56.595 20:56:52 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:56.595 20:56:52 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:56.595 20:56:52 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1682 -- # true 00:06:56.595 20:56:52 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:56.595 20:56:52 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@27 -- # exec 00:06:56.595 20:56:52 -- common/autotest_common.sh@29 -- # exec 00:06:56.595 20:56:52 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:56.595 20:56:52 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:56.595 20:56:52 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:56.595 20:56:52 -- common/autotest_common.sh@18 -- # set -x 00:06:56.595 20:56:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:56.595 20:56:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:56.595 20:56:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:56.595 20:56:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:56.595 20:56:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:56.595 20:56:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:56.595 20:56:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:56.595 20:56:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:56.595 20:56:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:56.595 20:56:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:56.595 20:56:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:56.595 20:56:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:56.595 20:56:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:56.595 20:56:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:56.595 20:56:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:56.595 20:56:52 -- scripts/common.sh@344 -- # : 1 00:06:56.595 20:56:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:56.595 20:56:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:56.595 20:56:52 -- scripts/common.sh@364 -- # decimal 1 00:06:56.595 20:56:52 -- scripts/common.sh@352 -- # local d=1 00:06:56.595 20:56:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:56.595 20:56:52 -- scripts/common.sh@354 -- # echo 1 00:06:56.595 20:56:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:56.595 20:56:52 -- scripts/common.sh@365 -- # decimal 2 00:06:56.595 20:56:52 -- scripts/common.sh@352 -- # local d=2 00:06:56.595 20:56:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:56.595 20:56:52 -- scripts/common.sh@354 -- # echo 2 00:06:56.595 20:56:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:56.595 20:56:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:56.595 20:56:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:56.595 20:56:52 -- scripts/common.sh@367 -- # return 0 00:06:56.595 20:56:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:56.595 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.595 --rc genhtml_branch_coverage=1 00:06:56.595 --rc genhtml_function_coverage=1 00:06:56.595 --rc genhtml_legend=1 00:06:56.595 --rc geninfo_all_blocks=1 00:06:56.595 --rc geninfo_unexecuted_blocks=1 00:06:56.595 00:06:56.595 ' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:56.595 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.595 --rc genhtml_branch_coverage=1 00:06:56.595 --rc genhtml_function_coverage=1 00:06:56.595 --rc genhtml_legend=1 00:06:56.595 --rc geninfo_all_blocks=1 00:06:56.595 --rc geninfo_unexecuted_blocks=1 00:06:56.595 00:06:56.595 ' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:56.595 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.595 --rc genhtml_branch_coverage=1 00:06:56.595 --rc genhtml_function_coverage=1 00:06:56.595 --rc genhtml_legend=1 00:06:56.595 --rc geninfo_all_blocks=1 00:06:56.595 --rc geninfo_unexecuted_blocks=1 00:06:56.595 00:06:56.595 ' 00:06:56.595 20:56:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:56.595 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.595 --rc genhtml_branch_coverage=1 00:06:56.595 --rc genhtml_function_coverage=1 00:06:56.595 --rc genhtml_legend=1 00:06:56.595 --rc geninfo_all_blocks=1 00:06:56.595 --rc geninfo_unexecuted_blocks=1 00:06:56.595 00:06:56.595 ' 00:06:56.595 20:56:52 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:56.595 20:56:52 -- nvmf/common.sh@7 -- # uname -s 00:06:56.595 20:56:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:56.595 20:56:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:56.595 20:56:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:56.595 20:56:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:56.595 20:56:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:56.595 20:56:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:56.595 20:56:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:56.595 20:56:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:56.595 20:56:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:56.596 20:56:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:56.596 20:56:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:56.596 20:56:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:56.596 20:56:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:56.596 20:56:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:56.596 20:56:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:56.596 20:56:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:56.596 20:56:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:56.596 20:56:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:56.596 20:56:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:56.596 20:56:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.596 20:56:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.596 20:56:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.596 20:56:52 -- paths/export.sh@5 -- # export PATH 00:06:56.596 20:56:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.596 20:56:52 -- nvmf/common.sh@46 -- # : 0 00:06:56.596 20:56:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:56.596 20:56:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:56.596 20:56:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:56.596 20:56:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:56.596 20:56:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:56.596 20:56:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:56.596 20:56:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:56.596 20:56:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:56.596 20:56:52 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:56.596 20:56:52 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:56.596 20:56:52 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:56.596 20:56:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:56.596 20:56:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:56.596 20:56:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:56.596 20:56:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:56.596 20:56:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:56.596 20:56:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:56.596 20:56:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:56.596 20:56:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:56.596 20:56:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:56.596 20:56:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:56.596 20:56:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:56.596 20:56:52 -- common/autotest_common.sh@10 -- # set +x 00:06:58.502 20:56:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:58.502 20:56:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:58.502 20:56:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:58.502 20:56:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:58.502 20:56:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:58.502 20:56:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:58.502 20:56:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:58.502 20:56:54 -- nvmf/common.sh@294 -- # net_devs=() 00:06:58.502 20:56:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:58.502 20:56:54 -- nvmf/common.sh@295 -- # e810=() 00:06:58.502 20:56:54 -- nvmf/common.sh@295 -- # local -ga e810 00:06:58.502 20:56:54 -- nvmf/common.sh@296 -- # x722=() 00:06:58.502 20:56:54 -- nvmf/common.sh@296 -- # local -ga x722 00:06:58.502 20:56:54 -- nvmf/common.sh@297 -- # mlx=() 00:06:58.502 20:56:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:58.502 20:56:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:58.502 20:56:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:58.502 20:56:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:58.502 20:56:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:58.502 20:56:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:58.502 20:56:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:58.502 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:58.502 20:56:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:58.502 20:56:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:58.502 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:58.502 20:56:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:58.502 20:56:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:58.502 20:56:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:58.502 20:56:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:58.502 20:56:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:58.502 20:56:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:58.502 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:58.502 20:56:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:58.502 20:56:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:58.502 20:56:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:58.502 20:56:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:58.502 20:56:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:58.502 20:56:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:58.502 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:58.502 20:56:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:58.502 20:56:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:58.502 20:56:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:58.502 20:56:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:58.502 20:56:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:58.760 20:56:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:58.760 20:56:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:58.760 20:56:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:58.760 20:56:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:58.760 20:56:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:58.760 20:56:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:58.761 20:56:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:58.761 20:56:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:58.761 20:56:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:58.761 20:56:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:58.761 20:56:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:58.761 20:56:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:58.761 20:56:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:58.761 20:56:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:58.761 20:56:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:58.761 20:56:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:58.761 20:56:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:58.761 20:56:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:58.761 20:56:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:58.761 20:56:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:58.761 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:58.761 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:06:58.761 00:06:58.761 --- 10.0.0.2 ping statistics --- 00:06:58.761 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:58.761 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:06:58.761 20:56:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:58.761 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:58.761 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:06:58.761 00:06:58.761 --- 10.0.0.1 ping statistics --- 00:06:58.761 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:58.761 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:06:58.761 20:56:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:58.761 20:56:54 -- nvmf/common.sh@410 -- # return 0 00:06:58.761 20:56:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:58.761 20:56:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:58.761 20:56:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:58.761 20:56:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:58.761 20:56:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:58.761 20:56:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:58.761 20:56:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:58.761 20:56:54 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:58.761 20:56:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:58.761 20:56:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.761 20:56:54 -- common/autotest_common.sh@10 -- # set +x 00:06:58.761 ************************************ 00:06:58.761 START TEST nvmf_filesystem_no_in_capsule 00:06:58.761 ************************************ 00:06:58.761 20:56:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:58.761 20:56:54 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:58.761 20:56:54 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:58.761 20:56:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:58.761 20:56:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:58.761 20:56:54 -- common/autotest_common.sh@10 -- # set +x 00:06:58.761 20:56:54 -- nvmf/common.sh@469 -- # nvmfpid=3884012 00:06:58.761 20:56:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:58.761 20:56:54 -- nvmf/common.sh@470 -- # waitforlisten 3884012 00:06:58.761 20:56:54 -- common/autotest_common.sh@829 -- # '[' -z 3884012 ']' 00:06:58.761 20:56:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.761 20:56:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:58.761 20:56:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.761 20:56:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:58.761 20:56:54 -- common/autotest_common.sh@10 -- # set +x 00:06:58.761 [2024-11-27 20:56:54.950199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:58.761 [2024-11-27 20:56:54.950284] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:58.761 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.018 [2024-11-27 20:56:55.020339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:59.018 [2024-11-27 20:56:55.143993] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:59.018 [2024-11-27 20:56:55.144156] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:59.018 [2024-11-27 20:56:55.144176] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:59.018 [2024-11-27 20:56:55.144190] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:59.018 [2024-11-27 20:56:55.144281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:59.018 [2024-11-27 20:56:55.144339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:59.018 [2024-11-27 20:56:55.144392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:59.018 [2024-11-27 20:56:55.144395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.946 20:56:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:59.946 20:56:55 -- common/autotest_common.sh@862 -- # return 0 00:06:59.946 20:56:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:59.946 20:56:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:59.946 20:56:55 -- common/autotest_common.sh@10 -- # set +x 00:06:59.946 20:56:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:59.947 20:56:55 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:59.947 20:56:55 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:59.947 20:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:55 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 [2024-11-27 20:56:55.973136] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:59.947 20:56:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:55 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:59.947 20:56:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:55 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 Malloc1 00:06:59.947 20:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:56 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:59.947 20:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:56 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 20:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:56 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:59.947 20:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:56 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 20:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:56 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:59.947 20:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:56 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 [2024-11-27 20:56:56.158087] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:59.947 20:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:56 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:59.947 20:56:56 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:59.947 20:56:56 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:59.947 20:56:56 -- common/autotest_common.sh@1369 -- # local bs 00:06:59.947 20:56:56 -- common/autotest_common.sh@1370 -- # local nb 00:06:59.947 20:56:56 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:59.947 20:56:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:59.947 20:56:56 -- common/autotest_common.sh@10 -- # set +x 00:06:59.947 20:56:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:59.947 20:56:56 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:59.947 { 00:06:59.947 "name": "Malloc1", 00:06:59.947 "aliases": [ 00:06:59.947 "4441ced6-4020-480e-9615-364c533c97b8" 00:06:59.947 ], 00:06:59.947 "product_name": "Malloc disk", 00:06:59.947 "block_size": 512, 00:06:59.947 "num_blocks": 1048576, 00:06:59.947 "uuid": "4441ced6-4020-480e-9615-364c533c97b8", 00:06:59.947 "assigned_rate_limits": { 00:06:59.947 "rw_ios_per_sec": 0, 00:06:59.947 "rw_mbytes_per_sec": 0, 00:06:59.947 "r_mbytes_per_sec": 0, 00:06:59.947 "w_mbytes_per_sec": 0 00:06:59.947 }, 00:06:59.947 "claimed": true, 00:06:59.947 "claim_type": "exclusive_write", 00:06:59.947 "zoned": false, 00:06:59.947 "supported_io_types": { 00:06:59.947 "read": true, 00:06:59.947 "write": true, 00:06:59.947 "unmap": true, 00:06:59.947 "write_zeroes": true, 00:06:59.947 "flush": true, 00:06:59.947 "reset": true, 00:06:59.947 "compare": false, 00:06:59.947 "compare_and_write": false, 00:06:59.947 "abort": true, 00:06:59.947 "nvme_admin": false, 00:06:59.947 "nvme_io": false 00:06:59.947 }, 00:06:59.947 "memory_domains": [ 00:06:59.947 { 00:06:59.947 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:59.947 "dma_device_type": 2 00:06:59.947 } 00:06:59.947 ], 00:06:59.947 "driver_specific": {} 00:06:59.947 } 00:06:59.947 ]' 00:06:59.947 20:56:56 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:00.203 20:56:56 -- common/autotest_common.sh@1372 -- # bs=512 00:07:00.203 20:56:56 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:00.203 20:56:56 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:00.203 20:56:56 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:00.203 20:56:56 -- common/autotest_common.sh@1377 -- # echo 512 00:07:00.203 20:56:56 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:00.203 20:56:56 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:00.767 20:56:56 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:00.767 20:56:56 -- common/autotest_common.sh@1187 -- # local i=0 00:07:00.767 20:56:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:00.767 20:56:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:00.767 20:56:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:03.291 20:56:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:03.291 20:56:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:03.291 20:56:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:03.291 20:56:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:03.291 20:56:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:03.291 20:56:58 -- common/autotest_common.sh@1197 -- # return 0 00:07:03.291 20:56:58 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:03.291 20:56:58 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:03.291 20:56:58 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:03.291 20:56:58 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:03.291 20:56:58 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:03.291 20:56:58 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:03.291 20:56:58 -- setup/common.sh@80 -- # echo 536870912 00:07:03.292 20:56:58 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:03.292 20:56:58 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:03.292 20:56:58 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:03.292 20:56:58 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:03.292 20:56:59 -- target/filesystem.sh@69 -- # partprobe 00:07:03.292 20:56:59 -- target/filesystem.sh@70 -- # sleep 1 00:07:04.666 20:57:00 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:04.666 20:57:00 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:04.666 20:57:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.666 20:57:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.666 20:57:00 -- common/autotest_common.sh@10 -- # set +x 00:07:04.666 ************************************ 00:07:04.666 START TEST filesystem_ext4 00:07:04.666 ************************************ 00:07:04.666 20:57:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:04.666 20:57:00 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:04.666 20:57:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.666 20:57:00 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:04.666 20:57:00 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:04.666 20:57:00 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.666 20:57:00 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.666 20:57:00 -- common/autotest_common.sh@915 -- # local force 00:07:04.666 20:57:00 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:04.666 20:57:00 -- common/autotest_common.sh@918 -- # force=-F 00:07:04.666 20:57:00 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:04.666 mke2fs 1.47.0 (5-Feb-2023) 00:07:04.666 Discarding device blocks: 0/522240 done 00:07:04.666 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:04.666 Filesystem UUID: 36c43e25-5dcf-498a-aaaf-ed2afbadc929 00:07:04.666 Superblock backups stored on blocks: 00:07:04.666 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:04.666 00:07:04.666 Allocating group tables: 0/64 done 00:07:04.666 Writing inode tables: 0/64 done 00:07:04.666 Creating journal (8192 blocks): done 00:07:04.666 Writing superblocks and filesystem accounting information: 0/64 done 00:07:04.666 00:07:04.666 20:57:00 -- common/autotest_common.sh@931 -- # return 0 00:07:04.666 20:57:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:11.224 20:57:06 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:11.224 20:57:06 -- target/filesystem.sh@25 -- # sync 00:07:11.224 20:57:06 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:11.224 20:57:06 -- target/filesystem.sh@27 -- # sync 00:07:11.224 20:57:06 -- target/filesystem.sh@29 -- # i=0 00:07:11.224 20:57:06 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:11.224 20:57:06 -- target/filesystem.sh@37 -- # kill -0 3884012 00:07:11.224 20:57:06 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:11.224 20:57:06 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:11.224 20:57:06 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:11.224 20:57:06 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:11.224 00:07:11.224 real 0m6.279s 00:07:11.224 user 0m0.021s 00:07:11.224 sys 0m0.061s 00:07:11.224 20:57:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.224 20:57:06 -- common/autotest_common.sh@10 -- # set +x 00:07:11.224 ************************************ 00:07:11.224 END TEST filesystem_ext4 00:07:11.224 ************************************ 00:07:11.224 20:57:06 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:11.224 20:57:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:11.224 20:57:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.224 20:57:06 -- common/autotest_common.sh@10 -- # set +x 00:07:11.224 ************************************ 00:07:11.224 START TEST filesystem_btrfs 00:07:11.224 ************************************ 00:07:11.224 20:57:06 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:11.224 20:57:06 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:11.224 20:57:06 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:11.224 20:57:06 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:11.224 20:57:06 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:11.224 20:57:06 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:11.224 20:57:06 -- common/autotest_common.sh@914 -- # local i=0 00:07:11.224 20:57:06 -- common/autotest_common.sh@915 -- # local force 00:07:11.224 20:57:06 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:11.224 20:57:06 -- common/autotest_common.sh@920 -- # force=-f 00:07:11.224 20:57:06 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:11.224 btrfs-progs v6.8.1 00:07:11.224 See https://btrfs.readthedocs.io for more information. 00:07:11.224 00:07:11.224 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:11.224 NOTE: several default settings have changed in version 5.15, please make sure 00:07:11.224 this does not affect your deployments: 00:07:11.224 - DUP for metadata (-m dup) 00:07:11.225 - enabled no-holes (-O no-holes) 00:07:11.225 - enabled free-space-tree (-R free-space-tree) 00:07:11.225 00:07:11.225 Label: (null) 00:07:11.225 UUID: 3ac5221b-dbfb-4c65-a5c7-377c0d37bbd2 00:07:11.225 Node size: 16384 00:07:11.225 Sector size: 4096 (CPU page size: 4096) 00:07:11.225 Filesystem size: 510.00MiB 00:07:11.225 Block group profiles: 00:07:11.225 Data: single 8.00MiB 00:07:11.225 Metadata: DUP 32.00MiB 00:07:11.225 System: DUP 8.00MiB 00:07:11.225 SSD detected: yes 00:07:11.225 Zoned device: no 00:07:11.225 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:11.225 Checksum: crc32c 00:07:11.225 Number of devices: 1 00:07:11.225 Devices: 00:07:11.225 ID SIZE PATH 00:07:11.225 1 510.00MiB /dev/nvme0n1p1 00:07:11.225 00:07:11.225 20:57:06 -- common/autotest_common.sh@931 -- # return 0 00:07:11.225 20:57:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:11.792 20:57:07 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:11.792 20:57:07 -- target/filesystem.sh@25 -- # sync 00:07:11.792 20:57:07 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:11.792 20:57:07 -- target/filesystem.sh@27 -- # sync 00:07:11.792 20:57:07 -- target/filesystem.sh@29 -- # i=0 00:07:11.792 20:57:07 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:11.792 20:57:07 -- target/filesystem.sh@37 -- # kill -0 3884012 00:07:11.792 20:57:07 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:11.792 20:57:07 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:11.792 20:57:07 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:11.792 20:57:07 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:11.792 00:07:11.792 real 0m1.185s 00:07:11.792 user 0m0.022s 00:07:11.792 sys 0m0.091s 00:07:11.792 20:57:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.792 20:57:07 -- common/autotest_common.sh@10 -- # set +x 00:07:11.792 ************************************ 00:07:11.792 END TEST filesystem_btrfs 00:07:11.792 ************************************ 00:07:11.792 20:57:07 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:11.792 20:57:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:11.792 20:57:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.792 20:57:07 -- common/autotest_common.sh@10 -- # set +x 00:07:11.792 ************************************ 00:07:11.792 START TEST filesystem_xfs 00:07:11.792 ************************************ 00:07:11.792 20:57:07 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:11.792 20:57:07 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:11.792 20:57:07 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:11.792 20:57:07 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:11.792 20:57:07 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:11.792 20:57:07 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:11.792 20:57:07 -- common/autotest_common.sh@914 -- # local i=0 00:07:11.792 20:57:07 -- common/autotest_common.sh@915 -- # local force 00:07:11.792 20:57:07 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:11.792 20:57:07 -- common/autotest_common.sh@920 -- # force=-f 00:07:11.792 20:57:07 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:12.051 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:12.051 = sectsz=512 attr=2, projid32bit=1 00:07:12.051 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:12.051 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:12.051 data = bsize=4096 blocks=130560, imaxpct=25 00:07:12.051 = sunit=0 swidth=0 blks 00:07:12.051 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:12.051 log =internal log bsize=4096 blocks=16384, version=2 00:07:12.051 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:12.051 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:12.617 Discarding blocks...Done. 00:07:12.617 20:57:08 -- common/autotest_common.sh@931 -- # return 0 00:07:12.617 20:57:08 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:14.516 20:57:10 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:14.516 20:57:10 -- target/filesystem.sh@25 -- # sync 00:07:14.517 20:57:10 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:14.517 20:57:10 -- target/filesystem.sh@27 -- # sync 00:07:14.517 20:57:10 -- target/filesystem.sh@29 -- # i=0 00:07:14.517 20:57:10 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:14.517 20:57:10 -- target/filesystem.sh@37 -- # kill -0 3884012 00:07:14.517 20:57:10 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:14.517 20:57:10 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:14.517 20:57:10 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:14.517 20:57:10 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:14.517 00:07:14.517 real 0m2.659s 00:07:14.517 user 0m0.016s 00:07:14.517 sys 0m0.061s 00:07:14.517 20:57:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.517 20:57:10 -- common/autotest_common.sh@10 -- # set +x 00:07:14.517 ************************************ 00:07:14.517 END TEST filesystem_xfs 00:07:14.517 ************************************ 00:07:14.517 20:57:10 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:14.517 20:57:10 -- target/filesystem.sh@93 -- # sync 00:07:14.517 20:57:10 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:14.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:14.775 20:57:10 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:14.775 20:57:10 -- common/autotest_common.sh@1208 -- # local i=0 00:07:14.775 20:57:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:14.775 20:57:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.775 20:57:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:14.775 20:57:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.775 20:57:10 -- common/autotest_common.sh@1220 -- # return 0 00:07:14.775 20:57:10 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:14.775 20:57:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.775 20:57:10 -- common/autotest_common.sh@10 -- # set +x 00:07:14.775 20:57:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.775 20:57:10 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:14.775 20:57:10 -- target/filesystem.sh@101 -- # killprocess 3884012 00:07:14.775 20:57:10 -- common/autotest_common.sh@936 -- # '[' -z 3884012 ']' 00:07:14.775 20:57:10 -- common/autotest_common.sh@940 -- # kill -0 3884012 00:07:14.775 20:57:10 -- common/autotest_common.sh@941 -- # uname 00:07:14.775 20:57:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:14.775 20:57:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3884012 00:07:14.775 20:57:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:14.775 20:57:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:14.775 20:57:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3884012' 00:07:14.775 killing process with pid 3884012 00:07:14.775 20:57:10 -- common/autotest_common.sh@955 -- # kill 3884012 00:07:14.775 20:57:10 -- common/autotest_common.sh@960 -- # wait 3884012 00:07:15.341 20:57:11 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:15.341 00:07:15.341 real 0m16.430s 00:07:15.341 user 1m3.460s 00:07:15.341 sys 0m2.031s 00:07:15.341 20:57:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:15.341 20:57:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.341 ************************************ 00:07:15.341 END TEST nvmf_filesystem_no_in_capsule 00:07:15.341 ************************************ 00:07:15.341 20:57:11 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:15.341 20:57:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:15.341 20:57:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.341 20:57:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.341 ************************************ 00:07:15.341 START TEST nvmf_filesystem_in_capsule 00:07:15.341 ************************************ 00:07:15.341 20:57:11 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:15.341 20:57:11 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:15.341 20:57:11 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:15.341 20:57:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:15.341 20:57:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:15.341 20:57:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.341 20:57:11 -- nvmf/common.sh@469 -- # nvmfpid=3886787 00:07:15.341 20:57:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:15.341 20:57:11 -- nvmf/common.sh@470 -- # waitforlisten 3886787 00:07:15.341 20:57:11 -- common/autotest_common.sh@829 -- # '[' -z 3886787 ']' 00:07:15.341 20:57:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.341 20:57:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:15.341 20:57:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.341 20:57:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:15.341 20:57:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.341 [2024-11-27 20:57:11.410737] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:15.341 [2024-11-27 20:57:11.410828] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:15.341 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.341 [2024-11-27 20:57:11.479520] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:15.600 [2024-11-27 20:57:11.599535] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:15.600 [2024-11-27 20:57:11.599694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:15.600 [2024-11-27 20:57:11.599713] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:15.600 [2024-11-27 20:57:11.599727] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:15.600 [2024-11-27 20:57:11.599785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.600 [2024-11-27 20:57:11.599843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:15.600 [2024-11-27 20:57:11.599895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:15.600 [2024-11-27 20:57:11.599898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.534 20:57:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:16.534 20:57:12 -- common/autotest_common.sh@862 -- # return 0 00:07:16.534 20:57:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:16.534 20:57:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 20:57:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:16.534 20:57:12 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:16.534 20:57:12 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 [2024-11-27 20:57:12.449199] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 [2024-11-27 20:57:12.638993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:16.534 20:57:12 -- common/autotest_common.sh@1369 -- # local bs 00:07:16.534 20:57:12 -- common/autotest_common.sh@1370 -- # local nb 00:07:16.534 20:57:12 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:16.534 20:57:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.534 20:57:12 -- common/autotest_common.sh@10 -- # set +x 00:07:16.534 20:57:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.534 20:57:12 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:16.534 { 00:07:16.534 "name": "Malloc1", 00:07:16.534 "aliases": [ 00:07:16.534 "5b9d1b6c-2d6f-4a19-8d3b-ae89251bd4c0" 00:07:16.534 ], 00:07:16.534 "product_name": "Malloc disk", 00:07:16.534 "block_size": 512, 00:07:16.534 "num_blocks": 1048576, 00:07:16.534 "uuid": "5b9d1b6c-2d6f-4a19-8d3b-ae89251bd4c0", 00:07:16.534 "assigned_rate_limits": { 00:07:16.534 "rw_ios_per_sec": 0, 00:07:16.534 "rw_mbytes_per_sec": 0, 00:07:16.534 "r_mbytes_per_sec": 0, 00:07:16.534 "w_mbytes_per_sec": 0 00:07:16.534 }, 00:07:16.534 "claimed": true, 00:07:16.534 "claim_type": "exclusive_write", 00:07:16.534 "zoned": false, 00:07:16.534 "supported_io_types": { 00:07:16.534 "read": true, 00:07:16.534 "write": true, 00:07:16.534 "unmap": true, 00:07:16.534 "write_zeroes": true, 00:07:16.534 "flush": true, 00:07:16.534 "reset": true, 00:07:16.534 "compare": false, 00:07:16.534 "compare_and_write": false, 00:07:16.534 "abort": true, 00:07:16.534 "nvme_admin": false, 00:07:16.534 "nvme_io": false 00:07:16.534 }, 00:07:16.534 "memory_domains": [ 00:07:16.534 { 00:07:16.534 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:16.534 "dma_device_type": 2 00:07:16.534 } 00:07:16.534 ], 00:07:16.534 "driver_specific": {} 00:07:16.534 } 00:07:16.534 ]' 00:07:16.534 20:57:12 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:16.534 20:57:12 -- common/autotest_common.sh@1372 -- # bs=512 00:07:16.534 20:57:12 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:16.534 20:57:12 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:16.534 20:57:12 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:16.534 20:57:12 -- common/autotest_common.sh@1377 -- # echo 512 00:07:16.534 20:57:12 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:16.534 20:57:12 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:17.100 20:57:13 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:17.100 20:57:13 -- common/autotest_common.sh@1187 -- # local i=0 00:07:17.100 20:57:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:17.100 20:57:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:17.100 20:57:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:19.628 20:57:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:19.628 20:57:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:19.628 20:57:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:19.628 20:57:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:19.628 20:57:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:19.628 20:57:15 -- common/autotest_common.sh@1197 -- # return 0 00:07:19.628 20:57:15 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:19.628 20:57:15 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:19.628 20:57:15 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:19.628 20:57:15 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:19.628 20:57:15 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:19.628 20:57:15 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:19.628 20:57:15 -- setup/common.sh@80 -- # echo 536870912 00:07:19.628 20:57:15 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:19.628 20:57:15 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:19.628 20:57:15 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:19.628 20:57:15 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:19.628 20:57:15 -- target/filesystem.sh@69 -- # partprobe 00:07:20.561 20:57:16 -- target/filesystem.sh@70 -- # sleep 1 00:07:21.495 20:57:17 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:21.495 20:57:17 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:21.495 20:57:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.495 20:57:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.495 20:57:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.495 ************************************ 00:07:21.495 START TEST filesystem_in_capsule_ext4 00:07:21.495 ************************************ 00:07:21.495 20:57:17 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:21.495 20:57:17 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:21.495 20:57:17 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:21.495 20:57:17 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:21.495 20:57:17 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:21.495 20:57:17 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:21.495 20:57:17 -- common/autotest_common.sh@914 -- # local i=0 00:07:21.495 20:57:17 -- common/autotest_common.sh@915 -- # local force 00:07:21.495 20:57:17 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:21.495 20:57:17 -- common/autotest_common.sh@918 -- # force=-F 00:07:21.495 20:57:17 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:21.495 mke2fs 1.47.0 (5-Feb-2023) 00:07:21.495 Discarding device blocks: 0/522240 done 00:07:21.495 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:21.495 Filesystem UUID: d9db6f20-e533-48fc-a1b5-9014e2b64ad8 00:07:21.495 Superblock backups stored on blocks: 00:07:21.495 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:21.495 00:07:21.495 Allocating group tables: 0/64 done 00:07:21.495 Writing inode tables: 0/64 done 00:07:21.495 Creating journal (8192 blocks): done 00:07:22.626 Writing superblocks and filesystem accounting information: 0/64 done 00:07:22.626 00:07:22.626 20:57:18 -- common/autotest_common.sh@931 -- # return 0 00:07:22.626 20:57:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:29.181 20:57:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:29.181 20:57:24 -- target/filesystem.sh@25 -- # sync 00:07:29.181 20:57:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:29.181 20:57:24 -- target/filesystem.sh@27 -- # sync 00:07:29.181 20:57:24 -- target/filesystem.sh@29 -- # i=0 00:07:29.181 20:57:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:29.181 20:57:24 -- target/filesystem.sh@37 -- # kill -0 3886787 00:07:29.181 20:57:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:29.181 20:57:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:29.181 20:57:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:29.181 20:57:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:29.181 00:07:29.181 real 0m7.362s 00:07:29.181 user 0m0.019s 00:07:29.181 sys 0m0.062s 00:07:29.181 20:57:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.181 20:57:24 -- common/autotest_common.sh@10 -- # set +x 00:07:29.181 ************************************ 00:07:29.181 END TEST filesystem_in_capsule_ext4 00:07:29.181 ************************************ 00:07:29.181 20:57:24 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:29.181 20:57:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:29.181 20:57:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.181 20:57:24 -- common/autotest_common.sh@10 -- # set +x 00:07:29.181 ************************************ 00:07:29.181 START TEST filesystem_in_capsule_btrfs 00:07:29.181 ************************************ 00:07:29.181 20:57:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:29.181 20:57:24 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:29.181 20:57:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:29.181 20:57:24 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:29.181 20:57:24 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:29.181 20:57:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:29.181 20:57:24 -- common/autotest_common.sh@914 -- # local i=0 00:07:29.181 20:57:24 -- common/autotest_common.sh@915 -- # local force 00:07:29.181 20:57:24 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:29.181 20:57:24 -- common/autotest_common.sh@920 -- # force=-f 00:07:29.181 20:57:24 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:29.181 btrfs-progs v6.8.1 00:07:29.181 See https://btrfs.readthedocs.io for more information. 00:07:29.181 00:07:29.181 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:29.181 NOTE: several default settings have changed in version 5.15, please make sure 00:07:29.181 this does not affect your deployments: 00:07:29.181 - DUP for metadata (-m dup) 00:07:29.181 - enabled no-holes (-O no-holes) 00:07:29.181 - enabled free-space-tree (-R free-space-tree) 00:07:29.181 00:07:29.181 Label: (null) 00:07:29.181 UUID: 41a72fc7-6973-42da-8188-596ed950ebd4 00:07:29.181 Node size: 16384 00:07:29.181 Sector size: 4096 (CPU page size: 4096) 00:07:29.181 Filesystem size: 510.00MiB 00:07:29.181 Block group profiles: 00:07:29.181 Data: single 8.00MiB 00:07:29.181 Metadata: DUP 32.00MiB 00:07:29.181 System: DUP 8.00MiB 00:07:29.181 SSD detected: yes 00:07:29.181 Zoned device: no 00:07:29.181 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:29.181 Checksum: crc32c 00:07:29.181 Number of devices: 1 00:07:29.181 Devices: 00:07:29.181 ID SIZE PATH 00:07:29.181 1 510.00MiB /dev/nvme0n1p1 00:07:29.181 00:07:29.181 20:57:24 -- common/autotest_common.sh@931 -- # return 0 00:07:29.181 20:57:24 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:29.181 20:57:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:29.181 20:57:25 -- target/filesystem.sh@25 -- # sync 00:07:29.181 20:57:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:29.181 20:57:25 -- target/filesystem.sh@27 -- # sync 00:07:29.181 20:57:25 -- target/filesystem.sh@29 -- # i=0 00:07:29.181 20:57:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:29.181 20:57:25 -- target/filesystem.sh@37 -- # kill -0 3886787 00:07:29.181 20:57:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:29.181 20:57:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:29.181 20:57:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:29.181 20:57:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:29.181 00:07:29.181 real 0m0.504s 00:07:29.181 user 0m0.019s 00:07:29.181 sys 0m0.101s 00:07:29.181 20:57:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.181 20:57:25 -- common/autotest_common.sh@10 -- # set +x 00:07:29.181 ************************************ 00:07:29.181 END TEST filesystem_in_capsule_btrfs 00:07:29.181 ************************************ 00:07:29.181 20:57:25 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:29.181 20:57:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:29.182 20:57:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.182 20:57:25 -- common/autotest_common.sh@10 -- # set +x 00:07:29.182 ************************************ 00:07:29.182 START TEST filesystem_in_capsule_xfs 00:07:29.182 ************************************ 00:07:29.182 20:57:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:29.182 20:57:25 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:29.182 20:57:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:29.182 20:57:25 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:29.182 20:57:25 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:29.182 20:57:25 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:29.182 20:57:25 -- common/autotest_common.sh@914 -- # local i=0 00:07:29.182 20:57:25 -- common/autotest_common.sh@915 -- # local force 00:07:29.182 20:57:25 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:29.182 20:57:25 -- common/autotest_common.sh@920 -- # force=-f 00:07:29.182 20:57:25 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:29.440 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:29.440 = sectsz=512 attr=2, projid32bit=1 00:07:29.440 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:29.440 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:29.440 data = bsize=4096 blocks=130560, imaxpct=25 00:07:29.440 = sunit=0 swidth=0 blks 00:07:29.440 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:29.440 log =internal log bsize=4096 blocks=16384, version=2 00:07:29.440 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:29.440 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:30.005 Discarding blocks...Done. 00:07:30.006 20:57:26 -- common/autotest_common.sh@931 -- # return 0 00:07:30.006 20:57:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:32.532 20:57:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:32.532 20:57:28 -- target/filesystem.sh@25 -- # sync 00:07:32.532 20:57:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:32.532 20:57:28 -- target/filesystem.sh@27 -- # sync 00:07:32.532 20:57:28 -- target/filesystem.sh@29 -- # i=0 00:07:32.532 20:57:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:32.532 20:57:28 -- target/filesystem.sh@37 -- # kill -0 3886787 00:07:32.532 20:57:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:32.532 20:57:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:32.532 20:57:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:32.532 20:57:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:32.532 00:07:32.532 real 0m3.191s 00:07:32.532 user 0m0.009s 00:07:32.532 sys 0m0.063s 00:07:32.532 20:57:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.532 20:57:28 -- common/autotest_common.sh@10 -- # set +x 00:07:32.532 ************************************ 00:07:32.532 END TEST filesystem_in_capsule_xfs 00:07:32.532 ************************************ 00:07:32.532 20:57:28 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:32.532 20:57:28 -- target/filesystem.sh@93 -- # sync 00:07:32.532 20:57:28 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:32.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:32.791 20:57:28 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:32.791 20:57:28 -- common/autotest_common.sh@1208 -- # local i=0 00:07:32.791 20:57:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:32.791 20:57:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:32.791 20:57:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:32.791 20:57:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:32.791 20:57:28 -- common/autotest_common.sh@1220 -- # return 0 00:07:32.791 20:57:28 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:32.791 20:57:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.791 20:57:28 -- common/autotest_common.sh@10 -- # set +x 00:07:32.791 20:57:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.791 20:57:28 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:32.791 20:57:28 -- target/filesystem.sh@101 -- # killprocess 3886787 00:07:32.791 20:57:28 -- common/autotest_common.sh@936 -- # '[' -z 3886787 ']' 00:07:32.791 20:57:28 -- common/autotest_common.sh@940 -- # kill -0 3886787 00:07:32.791 20:57:28 -- common/autotest_common.sh@941 -- # uname 00:07:32.791 20:57:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:32.791 20:57:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3886787 00:07:32.791 20:57:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:32.791 20:57:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:32.791 20:57:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3886787' 00:07:32.791 killing process with pid 3886787 00:07:32.791 20:57:28 -- common/autotest_common.sh@955 -- # kill 3886787 00:07:32.791 20:57:28 -- common/autotest_common.sh@960 -- # wait 3886787 00:07:33.358 20:57:29 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:33.358 00:07:33.358 real 0m17.966s 00:07:33.358 user 1m9.282s 00:07:33.358 sys 0m2.334s 00:07:33.358 20:57:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.358 20:57:29 -- common/autotest_common.sh@10 -- # set +x 00:07:33.358 ************************************ 00:07:33.358 END TEST nvmf_filesystem_in_capsule 00:07:33.358 ************************************ 00:07:33.358 20:57:29 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:33.358 20:57:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:33.358 20:57:29 -- nvmf/common.sh@116 -- # sync 00:07:33.358 20:57:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:33.358 20:57:29 -- nvmf/common.sh@119 -- # set +e 00:07:33.358 20:57:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:33.358 20:57:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:33.358 rmmod nvme_tcp 00:07:33.358 rmmod nvme_fabrics 00:07:33.358 rmmod nvme_keyring 00:07:33.358 20:57:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:33.358 20:57:29 -- nvmf/common.sh@123 -- # set -e 00:07:33.358 20:57:29 -- nvmf/common.sh@124 -- # return 0 00:07:33.358 20:57:29 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:33.358 20:57:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:33.358 20:57:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:33.358 20:57:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:33.358 20:57:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:33.358 20:57:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:33.358 20:57:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:33.358 20:57:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:33.358 20:57:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:35.265 20:57:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:35.265 00:07:35.265 real 0m39.104s 00:07:35.265 user 2m13.824s 00:07:35.265 sys 0m5.992s 00:07:35.266 20:57:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.266 20:57:31 -- common/autotest_common.sh@10 -- # set +x 00:07:35.266 ************************************ 00:07:35.266 END TEST nvmf_filesystem 00:07:35.266 ************************************ 00:07:35.266 20:57:31 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:35.266 20:57:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:35.266 20:57:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.266 20:57:31 -- common/autotest_common.sh@10 -- # set +x 00:07:35.266 ************************************ 00:07:35.266 START TEST nvmf_discovery 00:07:35.266 ************************************ 00:07:35.266 20:57:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:35.524 * Looking for test storage... 00:07:35.524 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:35.524 20:57:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:35.524 20:57:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:35.524 20:57:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:35.525 20:57:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:35.525 20:57:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:35.525 20:57:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:35.525 20:57:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:35.525 20:57:31 -- scripts/common.sh@335 -- # IFS=.-: 00:07:35.525 20:57:31 -- scripts/common.sh@335 -- # read -ra ver1 00:07:35.525 20:57:31 -- scripts/common.sh@336 -- # IFS=.-: 00:07:35.525 20:57:31 -- scripts/common.sh@336 -- # read -ra ver2 00:07:35.525 20:57:31 -- scripts/common.sh@337 -- # local 'op=<' 00:07:35.525 20:57:31 -- scripts/common.sh@339 -- # ver1_l=2 00:07:35.525 20:57:31 -- scripts/common.sh@340 -- # ver2_l=1 00:07:35.525 20:57:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:35.525 20:57:31 -- scripts/common.sh@343 -- # case "$op" in 00:07:35.525 20:57:31 -- scripts/common.sh@344 -- # : 1 00:07:35.525 20:57:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:35.525 20:57:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:35.525 20:57:31 -- scripts/common.sh@364 -- # decimal 1 00:07:35.525 20:57:31 -- scripts/common.sh@352 -- # local d=1 00:07:35.525 20:57:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:35.525 20:57:31 -- scripts/common.sh@354 -- # echo 1 00:07:35.525 20:57:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:35.525 20:57:31 -- scripts/common.sh@365 -- # decimal 2 00:07:35.525 20:57:31 -- scripts/common.sh@352 -- # local d=2 00:07:35.525 20:57:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:35.525 20:57:31 -- scripts/common.sh@354 -- # echo 2 00:07:35.525 20:57:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:35.525 20:57:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:35.525 20:57:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:35.525 20:57:31 -- scripts/common.sh@367 -- # return 0 00:07:35.525 20:57:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:35.525 20:57:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:35.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.525 --rc genhtml_branch_coverage=1 00:07:35.525 --rc genhtml_function_coverage=1 00:07:35.525 --rc genhtml_legend=1 00:07:35.525 --rc geninfo_all_blocks=1 00:07:35.525 --rc geninfo_unexecuted_blocks=1 00:07:35.525 00:07:35.525 ' 00:07:35.525 20:57:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:35.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.525 --rc genhtml_branch_coverage=1 00:07:35.525 --rc genhtml_function_coverage=1 00:07:35.525 --rc genhtml_legend=1 00:07:35.525 --rc geninfo_all_blocks=1 00:07:35.525 --rc geninfo_unexecuted_blocks=1 00:07:35.525 00:07:35.525 ' 00:07:35.525 20:57:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:35.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.525 --rc genhtml_branch_coverage=1 00:07:35.525 --rc genhtml_function_coverage=1 00:07:35.525 --rc genhtml_legend=1 00:07:35.525 --rc geninfo_all_blocks=1 00:07:35.525 --rc geninfo_unexecuted_blocks=1 00:07:35.525 00:07:35.525 ' 00:07:35.525 20:57:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:35.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.525 --rc genhtml_branch_coverage=1 00:07:35.525 --rc genhtml_function_coverage=1 00:07:35.525 --rc genhtml_legend=1 00:07:35.525 --rc geninfo_all_blocks=1 00:07:35.525 --rc geninfo_unexecuted_blocks=1 00:07:35.525 00:07:35.525 ' 00:07:35.525 20:57:31 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:35.525 20:57:31 -- nvmf/common.sh@7 -- # uname -s 00:07:35.525 20:57:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:35.525 20:57:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:35.525 20:57:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:35.525 20:57:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:35.525 20:57:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:35.525 20:57:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:35.525 20:57:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:35.525 20:57:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:35.525 20:57:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:35.525 20:57:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:35.525 20:57:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:35.525 20:57:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:35.525 20:57:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:35.525 20:57:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:35.525 20:57:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:35.525 20:57:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:35.525 20:57:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:35.525 20:57:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:35.525 20:57:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:35.525 20:57:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.525 20:57:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.525 20:57:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.525 20:57:31 -- paths/export.sh@5 -- # export PATH 00:07:35.525 20:57:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.525 20:57:31 -- nvmf/common.sh@46 -- # : 0 00:07:35.525 20:57:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:35.525 20:57:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:35.525 20:57:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:35.525 20:57:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:35.525 20:57:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:35.525 20:57:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:35.525 20:57:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:35.525 20:57:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:35.525 20:57:31 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:35.525 20:57:31 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:35.525 20:57:31 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:35.525 20:57:31 -- target/discovery.sh@15 -- # hash nvme 00:07:35.525 20:57:31 -- target/discovery.sh@20 -- # nvmftestinit 00:07:35.525 20:57:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:35.525 20:57:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:35.525 20:57:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:35.525 20:57:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:35.525 20:57:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:35.525 20:57:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:35.525 20:57:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:35.525 20:57:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:35.525 20:57:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:35.525 20:57:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:35.525 20:57:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:35.525 20:57:31 -- common/autotest_common.sh@10 -- # set +x 00:07:38.059 20:57:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:38.059 20:57:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:38.059 20:57:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:38.059 20:57:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:38.059 20:57:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:38.059 20:57:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:38.059 20:57:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:38.059 20:57:33 -- nvmf/common.sh@294 -- # net_devs=() 00:07:38.059 20:57:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:38.059 20:57:33 -- nvmf/common.sh@295 -- # e810=() 00:07:38.059 20:57:33 -- nvmf/common.sh@295 -- # local -ga e810 00:07:38.059 20:57:33 -- nvmf/common.sh@296 -- # x722=() 00:07:38.059 20:57:33 -- nvmf/common.sh@296 -- # local -ga x722 00:07:38.059 20:57:33 -- nvmf/common.sh@297 -- # mlx=() 00:07:38.059 20:57:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:38.059 20:57:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:38.059 20:57:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:38.059 20:57:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:38.060 20:57:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:38.060 20:57:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:38.060 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:38.060 20:57:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:38.060 20:57:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:38.060 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:38.060 20:57:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:38.060 20:57:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:38.060 20:57:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:38.060 20:57:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:38.060 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:38.060 20:57:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:38.060 20:57:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:38.060 20:57:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:38.060 20:57:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:38.060 20:57:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:38.060 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:38.060 20:57:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:38.060 20:57:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:38.060 20:57:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:38.060 20:57:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:38.060 20:57:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:38.060 20:57:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:38.060 20:57:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:38.060 20:57:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:38.060 20:57:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:38.060 20:57:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:38.060 20:57:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:38.060 20:57:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:38.060 20:57:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:38.060 20:57:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:38.060 20:57:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:38.060 20:57:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:38.060 20:57:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:38.060 20:57:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:38.060 20:57:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:38.060 20:57:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:38.060 20:57:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:38.060 20:57:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:38.060 20:57:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:38.060 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:38.060 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.325 ms 00:07:38.060 00:07:38.060 --- 10.0.0.2 ping statistics --- 00:07:38.060 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:38.060 rtt min/avg/max/mdev = 0.325/0.325/0.325/0.000 ms 00:07:38.060 20:57:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:38.060 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:38.060 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:07:38.060 00:07:38.060 --- 10.0.0.1 ping statistics --- 00:07:38.060 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:38.060 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:07:38.060 20:57:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:38.060 20:57:33 -- nvmf/common.sh@410 -- # return 0 00:07:38.060 20:57:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:38.060 20:57:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:38.060 20:57:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:38.060 20:57:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:38.060 20:57:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:38.060 20:57:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:38.060 20:57:33 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:38.060 20:57:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:38.060 20:57:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:38.060 20:57:33 -- common/autotest_common.sh@10 -- # set +x 00:07:38.060 20:57:33 -- nvmf/common.sh@469 -- # nvmfpid=3891158 00:07:38.060 20:57:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:38.060 20:57:33 -- nvmf/common.sh@470 -- # waitforlisten 3891158 00:07:38.060 20:57:33 -- common/autotest_common.sh@829 -- # '[' -z 3891158 ']' 00:07:38.060 20:57:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:38.060 20:57:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:38.060 20:57:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:38.060 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:38.060 20:57:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:38.060 20:57:33 -- common/autotest_common.sh@10 -- # set +x 00:07:38.060 [2024-11-27 20:57:34.018619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.060 [2024-11-27 20:57:34.018694] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:38.060 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.060 [2024-11-27 20:57:34.090765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.060 [2024-11-27 20:57:34.209631] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:38.060 [2024-11-27 20:57:34.209780] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:38.060 [2024-11-27 20:57:34.209800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:38.060 [2024-11-27 20:57:34.209814] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:38.060 [2024-11-27 20:57:34.209899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.060 [2024-11-27 20:57:34.209943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.060 [2024-11-27 20:57:34.209997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.060 [2024-11-27 20:57:34.210000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.996 20:57:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:38.996 20:57:34 -- common/autotest_common.sh@862 -- # return 0 00:07:38.996 20:57:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:38.996 20:57:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:38.996 20:57:34 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 20:57:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:38.996 20:57:35 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 [2024-11-27 20:57:35.007042] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@26 -- # seq 1 4 00:07:38.996 20:57:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:38.996 20:57:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 Null1 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 [2024-11-27 20:57:35.047345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:38.996 20:57:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:38.996 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.996 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.996 Null2 00:07:38.996 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.996 20:57:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:38.997 20:57:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 Null3 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:38.997 20:57:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 Null4 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:38.997 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.997 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:38.997 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.997 20:57:35 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:39.255 00:07:39.255 Discovery Log Number of Records 6, Generation counter 6 00:07:39.255 =====Discovery Log Entry 0====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: current discovery subsystem 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4420 00:07:39.255 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: explicit discovery connections, duplicate discovery information 00:07:39.255 sectype: none 00:07:39.255 =====Discovery Log Entry 1====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: nvme subsystem 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4420 00:07:39.255 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: none 00:07:39.255 sectype: none 00:07:39.255 =====Discovery Log Entry 2====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: nvme subsystem 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4420 00:07:39.255 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: none 00:07:39.255 sectype: none 00:07:39.255 =====Discovery Log Entry 3====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: nvme subsystem 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4420 00:07:39.255 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: none 00:07:39.255 sectype: none 00:07:39.255 =====Discovery Log Entry 4====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: nvme subsystem 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4420 00:07:39.255 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: none 00:07:39.255 sectype: none 00:07:39.255 =====Discovery Log Entry 5====== 00:07:39.255 trtype: tcp 00:07:39.255 adrfam: ipv4 00:07:39.255 subtype: discovery subsystem referral 00:07:39.255 treq: not required 00:07:39.255 portid: 0 00:07:39.255 trsvcid: 4430 00:07:39.255 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:39.255 traddr: 10.0.0.2 00:07:39.255 eflags: none 00:07:39.255 sectype: none 00:07:39.255 20:57:35 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:39.255 Perform nvmf subsystem discovery via RPC 00:07:39.255 20:57:35 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:39.255 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.255 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.255 [2024-11-27 20:57:35.300007] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:39.255 [ 00:07:39.255 { 00:07:39.255 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:39.255 "subtype": "Discovery", 00:07:39.255 "listen_addresses": [ 00:07:39.255 { 00:07:39.255 "transport": "TCP", 00:07:39.255 "trtype": "TCP", 00:07:39.255 "adrfam": "IPv4", 00:07:39.255 "traddr": "10.0.0.2", 00:07:39.255 "trsvcid": "4420" 00:07:39.255 } 00:07:39.255 ], 00:07:39.255 "allow_any_host": true, 00:07:39.255 "hosts": [] 00:07:39.255 }, 00:07:39.255 { 00:07:39.255 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:39.255 "subtype": "NVMe", 00:07:39.255 "listen_addresses": [ 00:07:39.255 { 00:07:39.255 "transport": "TCP", 00:07:39.255 "trtype": "TCP", 00:07:39.255 "adrfam": "IPv4", 00:07:39.255 "traddr": "10.0.0.2", 00:07:39.255 "trsvcid": "4420" 00:07:39.255 } 00:07:39.255 ], 00:07:39.255 "allow_any_host": true, 00:07:39.255 "hosts": [], 00:07:39.255 "serial_number": "SPDK00000000000001", 00:07:39.255 "model_number": "SPDK bdev Controller", 00:07:39.255 "max_namespaces": 32, 00:07:39.255 "min_cntlid": 1, 00:07:39.255 "max_cntlid": 65519, 00:07:39.255 "namespaces": [ 00:07:39.255 { 00:07:39.255 "nsid": 1, 00:07:39.255 "bdev_name": "Null1", 00:07:39.255 "name": "Null1", 00:07:39.255 "nguid": "52B594A3A0D34565B7493D1A0525C316", 00:07:39.255 "uuid": "52b594a3-a0d3-4565-b749-3d1a0525c316" 00:07:39.255 } 00:07:39.255 ] 00:07:39.255 }, 00:07:39.255 { 00:07:39.255 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:39.255 "subtype": "NVMe", 00:07:39.255 "listen_addresses": [ 00:07:39.255 { 00:07:39.255 "transport": "TCP", 00:07:39.255 "trtype": "TCP", 00:07:39.255 "adrfam": "IPv4", 00:07:39.255 "traddr": "10.0.0.2", 00:07:39.255 "trsvcid": "4420" 00:07:39.255 } 00:07:39.255 ], 00:07:39.255 "allow_any_host": true, 00:07:39.255 "hosts": [], 00:07:39.255 "serial_number": "SPDK00000000000002", 00:07:39.255 "model_number": "SPDK bdev Controller", 00:07:39.255 "max_namespaces": 32, 00:07:39.255 "min_cntlid": 1, 00:07:39.255 "max_cntlid": 65519, 00:07:39.255 "namespaces": [ 00:07:39.255 { 00:07:39.255 "nsid": 1, 00:07:39.255 "bdev_name": "Null2", 00:07:39.255 "name": "Null2", 00:07:39.255 "nguid": "C7FFE33D6CFC4F77ACE71ECC81BDAA74", 00:07:39.255 "uuid": "c7ffe33d-6cfc-4f77-ace7-1ecc81bdaa74" 00:07:39.255 } 00:07:39.255 ] 00:07:39.255 }, 00:07:39.255 { 00:07:39.255 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:39.255 "subtype": "NVMe", 00:07:39.255 "listen_addresses": [ 00:07:39.255 { 00:07:39.255 "transport": "TCP", 00:07:39.255 "trtype": "TCP", 00:07:39.255 "adrfam": "IPv4", 00:07:39.255 "traddr": "10.0.0.2", 00:07:39.255 "trsvcid": "4420" 00:07:39.255 } 00:07:39.255 ], 00:07:39.255 "allow_any_host": true, 00:07:39.255 "hosts": [], 00:07:39.255 "serial_number": "SPDK00000000000003", 00:07:39.255 "model_number": "SPDK bdev Controller", 00:07:39.255 "max_namespaces": 32, 00:07:39.255 "min_cntlid": 1, 00:07:39.255 "max_cntlid": 65519, 00:07:39.255 "namespaces": [ 00:07:39.255 { 00:07:39.255 "nsid": 1, 00:07:39.255 "bdev_name": "Null3", 00:07:39.255 "name": "Null3", 00:07:39.255 "nguid": "38984617A96F4A2EBEF044BBE19E3140", 00:07:39.255 "uuid": "38984617-a96f-4a2e-bef0-44bbe19e3140" 00:07:39.255 } 00:07:39.255 ] 00:07:39.255 }, 00:07:39.255 { 00:07:39.255 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:39.255 "subtype": "NVMe", 00:07:39.256 "listen_addresses": [ 00:07:39.256 { 00:07:39.256 "transport": "TCP", 00:07:39.256 "trtype": "TCP", 00:07:39.256 "adrfam": "IPv4", 00:07:39.256 "traddr": "10.0.0.2", 00:07:39.256 "trsvcid": "4420" 00:07:39.256 } 00:07:39.256 ], 00:07:39.256 "allow_any_host": true, 00:07:39.256 "hosts": [], 00:07:39.256 "serial_number": "SPDK00000000000004", 00:07:39.256 "model_number": "SPDK bdev Controller", 00:07:39.256 "max_namespaces": 32, 00:07:39.256 "min_cntlid": 1, 00:07:39.256 "max_cntlid": 65519, 00:07:39.256 "namespaces": [ 00:07:39.256 { 00:07:39.256 "nsid": 1, 00:07:39.256 "bdev_name": "Null4", 00:07:39.256 "name": "Null4", 00:07:39.256 "nguid": "CE3F1C0FCF824AAAA4F3971F7BB12A8D", 00:07:39.256 "uuid": "ce3f1c0f-cf82-4aaa-a4f3-971f7bb12a8d" 00:07:39.256 } 00:07:39.256 ] 00:07:39.256 } 00:07:39.256 ] 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@42 -- # seq 1 4 00:07:39.256 20:57:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.256 20:57:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.256 20:57:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.256 20:57:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:39.256 20:57:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:39.256 20:57:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.256 20:57:35 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:39.256 20:57:35 -- common/autotest_common.sh@10 -- # set +x 00:07:39.256 20:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.256 20:57:35 -- target/discovery.sh@49 -- # check_bdevs= 00:07:39.256 20:57:35 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:39.256 20:57:35 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:39.256 20:57:35 -- target/discovery.sh@57 -- # nvmftestfini 00:07:39.256 20:57:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:39.256 20:57:35 -- nvmf/common.sh@116 -- # sync 00:07:39.256 20:57:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:39.256 20:57:35 -- nvmf/common.sh@119 -- # set +e 00:07:39.256 20:57:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:39.256 20:57:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:39.256 rmmod nvme_tcp 00:07:39.256 rmmod nvme_fabrics 00:07:39.256 rmmod nvme_keyring 00:07:39.256 20:57:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:39.514 20:57:35 -- nvmf/common.sh@123 -- # set -e 00:07:39.514 20:57:35 -- nvmf/common.sh@124 -- # return 0 00:07:39.514 20:57:35 -- nvmf/common.sh@477 -- # '[' -n 3891158 ']' 00:07:39.514 20:57:35 -- nvmf/common.sh@478 -- # killprocess 3891158 00:07:39.514 20:57:35 -- common/autotest_common.sh@936 -- # '[' -z 3891158 ']' 00:07:39.514 20:57:35 -- common/autotest_common.sh@940 -- # kill -0 3891158 00:07:39.514 20:57:35 -- common/autotest_common.sh@941 -- # uname 00:07:39.514 20:57:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:39.514 20:57:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3891158 00:07:39.514 20:57:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:39.514 20:57:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:39.514 20:57:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3891158' 00:07:39.514 killing process with pid 3891158 00:07:39.514 20:57:35 -- common/autotest_common.sh@955 -- # kill 3891158 00:07:39.514 [2024-11-27 20:57:35.541067] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:39.514 20:57:35 -- common/autotest_common.sh@960 -- # wait 3891158 00:07:39.773 20:57:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:39.773 20:57:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:39.773 20:57:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:39.773 20:57:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:39.773 20:57:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:39.773 20:57:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.773 20:57:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.773 20:57:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.678 20:57:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:41.678 00:07:41.678 real 0m6.362s 00:07:41.678 user 0m7.409s 00:07:41.678 sys 0m1.984s 00:07:41.678 20:57:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.678 20:57:37 -- common/autotest_common.sh@10 -- # set +x 00:07:41.678 ************************************ 00:07:41.678 END TEST nvmf_discovery 00:07:41.678 ************************************ 00:07:41.678 20:57:37 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:41.678 20:57:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:41.678 20:57:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.678 20:57:37 -- common/autotest_common.sh@10 -- # set +x 00:07:41.678 ************************************ 00:07:41.678 START TEST nvmf_referrals 00:07:41.678 ************************************ 00:07:41.678 20:57:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:41.937 * Looking for test storage... 00:07:41.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.937 20:57:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:41.937 20:57:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:41.937 20:57:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:41.937 20:57:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:41.937 20:57:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:41.937 20:57:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:41.937 20:57:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:41.937 20:57:38 -- scripts/common.sh@335 -- # IFS=.-: 00:07:41.937 20:57:38 -- scripts/common.sh@335 -- # read -ra ver1 00:07:41.937 20:57:38 -- scripts/common.sh@336 -- # IFS=.-: 00:07:41.937 20:57:38 -- scripts/common.sh@336 -- # read -ra ver2 00:07:41.937 20:57:38 -- scripts/common.sh@337 -- # local 'op=<' 00:07:41.937 20:57:38 -- scripts/common.sh@339 -- # ver1_l=2 00:07:41.937 20:57:38 -- scripts/common.sh@340 -- # ver2_l=1 00:07:41.937 20:57:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:41.937 20:57:38 -- scripts/common.sh@343 -- # case "$op" in 00:07:41.937 20:57:38 -- scripts/common.sh@344 -- # : 1 00:07:41.937 20:57:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:41.937 20:57:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:41.937 20:57:38 -- scripts/common.sh@364 -- # decimal 1 00:07:41.937 20:57:38 -- scripts/common.sh@352 -- # local d=1 00:07:41.937 20:57:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:41.937 20:57:38 -- scripts/common.sh@354 -- # echo 1 00:07:41.937 20:57:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:41.938 20:57:38 -- scripts/common.sh@365 -- # decimal 2 00:07:41.938 20:57:38 -- scripts/common.sh@352 -- # local d=2 00:07:41.938 20:57:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:41.938 20:57:38 -- scripts/common.sh@354 -- # echo 2 00:07:41.938 20:57:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:41.938 20:57:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:41.938 20:57:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:41.938 20:57:38 -- scripts/common.sh@367 -- # return 0 00:07:41.938 20:57:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:41.938 20:57:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:41.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.938 --rc genhtml_branch_coverage=1 00:07:41.938 --rc genhtml_function_coverage=1 00:07:41.938 --rc genhtml_legend=1 00:07:41.938 --rc geninfo_all_blocks=1 00:07:41.938 --rc geninfo_unexecuted_blocks=1 00:07:41.938 00:07:41.938 ' 00:07:41.938 20:57:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:41.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.938 --rc genhtml_branch_coverage=1 00:07:41.938 --rc genhtml_function_coverage=1 00:07:41.938 --rc genhtml_legend=1 00:07:41.938 --rc geninfo_all_blocks=1 00:07:41.938 --rc geninfo_unexecuted_blocks=1 00:07:41.938 00:07:41.938 ' 00:07:41.938 20:57:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:41.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.938 --rc genhtml_branch_coverage=1 00:07:41.938 --rc genhtml_function_coverage=1 00:07:41.938 --rc genhtml_legend=1 00:07:41.938 --rc geninfo_all_blocks=1 00:07:41.938 --rc geninfo_unexecuted_blocks=1 00:07:41.938 00:07:41.938 ' 00:07:41.938 20:57:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:41.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.938 --rc genhtml_branch_coverage=1 00:07:41.938 --rc genhtml_function_coverage=1 00:07:41.938 --rc genhtml_legend=1 00:07:41.938 --rc geninfo_all_blocks=1 00:07:41.938 --rc geninfo_unexecuted_blocks=1 00:07:41.938 00:07:41.938 ' 00:07:41.938 20:57:38 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:41.938 20:57:38 -- nvmf/common.sh@7 -- # uname -s 00:07:41.938 20:57:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:41.938 20:57:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:41.938 20:57:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:41.938 20:57:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:41.938 20:57:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:41.938 20:57:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:41.938 20:57:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:41.938 20:57:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:41.938 20:57:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:41.938 20:57:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:41.938 20:57:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.938 20:57:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.938 20:57:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:41.938 20:57:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:41.938 20:57:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:41.938 20:57:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:41.938 20:57:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:41.938 20:57:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:41.938 20:57:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:41.938 20:57:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.938 20:57:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.938 20:57:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.938 20:57:38 -- paths/export.sh@5 -- # export PATH 00:07:41.938 20:57:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.938 20:57:38 -- nvmf/common.sh@46 -- # : 0 00:07:41.938 20:57:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:41.938 20:57:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:41.938 20:57:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:41.938 20:57:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:41.938 20:57:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:41.938 20:57:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:41.938 20:57:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:41.938 20:57:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:41.938 20:57:38 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:41.938 20:57:38 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:41.938 20:57:38 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:41.938 20:57:38 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:41.938 20:57:38 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:41.938 20:57:38 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:41.938 20:57:38 -- target/referrals.sh@37 -- # nvmftestinit 00:07:41.938 20:57:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:41.938 20:57:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:41.938 20:57:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:41.938 20:57:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:41.938 20:57:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:41.938 20:57:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.938 20:57:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.938 20:57:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.938 20:57:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:41.938 20:57:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:41.938 20:57:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:41.938 20:57:38 -- common/autotest_common.sh@10 -- # set +x 00:07:43.841 20:57:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:43.841 20:57:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:43.841 20:57:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:43.841 20:57:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:43.841 20:57:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:43.841 20:57:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:43.841 20:57:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:43.841 20:57:40 -- nvmf/common.sh@294 -- # net_devs=() 00:07:43.841 20:57:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:43.841 20:57:40 -- nvmf/common.sh@295 -- # e810=() 00:07:43.841 20:57:40 -- nvmf/common.sh@295 -- # local -ga e810 00:07:43.841 20:57:40 -- nvmf/common.sh@296 -- # x722=() 00:07:43.841 20:57:40 -- nvmf/common.sh@296 -- # local -ga x722 00:07:43.841 20:57:40 -- nvmf/common.sh@297 -- # mlx=() 00:07:43.841 20:57:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:43.841 20:57:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:43.841 20:57:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:43.841 20:57:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:43.841 20:57:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:44.101 20:57:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:44.101 20:57:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:44.101 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:44.101 20:57:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:44.101 20:57:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:44.101 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:44.101 20:57:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:44.101 20:57:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.101 20:57:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.101 20:57:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:44.101 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:44.101 20:57:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:44.101 20:57:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.101 20:57:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.101 20:57:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:44.101 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:44.101 20:57:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:44.101 20:57:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:44.101 20:57:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:44.101 20:57:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:44.101 20:57:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:44.101 20:57:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:44.101 20:57:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:44.101 20:57:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:44.101 20:57:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:44.101 20:57:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:44.101 20:57:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:44.101 20:57:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:44.101 20:57:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:44.101 20:57:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:44.101 20:57:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:44.101 20:57:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:44.101 20:57:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:44.101 20:57:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:44.101 20:57:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:44.101 20:57:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:44.101 20:57:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:44.101 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:44.101 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:07:44.101 00:07:44.101 --- 10.0.0.2 ping statistics --- 00:07:44.101 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:44.101 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:07:44.101 20:57:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:44.101 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:44.101 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:07:44.101 00:07:44.101 --- 10.0.0.1 ping statistics --- 00:07:44.101 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:44.101 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:07:44.101 20:57:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:44.101 20:57:40 -- nvmf/common.sh@410 -- # return 0 00:07:44.101 20:57:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:44.101 20:57:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:44.101 20:57:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:44.101 20:57:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:44.101 20:57:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:44.101 20:57:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:44.101 20:57:40 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:44.101 20:57:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:44.101 20:57:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:44.101 20:57:40 -- common/autotest_common.sh@10 -- # set +x 00:07:44.101 20:57:40 -- nvmf/common.sh@469 -- # nvmfpid=3893282 00:07:44.101 20:57:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:44.101 20:57:40 -- nvmf/common.sh@470 -- # waitforlisten 3893282 00:07:44.101 20:57:40 -- common/autotest_common.sh@829 -- # '[' -z 3893282 ']' 00:07:44.101 20:57:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:44.101 20:57:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:44.101 20:57:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:44.101 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:44.101 20:57:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:44.101 20:57:40 -- common/autotest_common.sh@10 -- # set +x 00:07:44.101 [2024-11-27 20:57:40.284024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.101 [2024-11-27 20:57:40.284088] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:44.101 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.359 [2024-11-27 20:57:40.348409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.359 [2024-11-27 20:57:40.469797] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:44.359 [2024-11-27 20:57:40.469952] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:44.359 [2024-11-27 20:57:40.469971] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:44.359 [2024-11-27 20:57:40.469984] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:44.359 [2024-11-27 20:57:40.470052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.359 [2024-11-27 20:57:40.470126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.360 [2024-11-27 20:57:40.470201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.360 [2024-11-27 20:57:40.470204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.301 20:57:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:45.301 20:57:41 -- common/autotest_common.sh@862 -- # return 0 00:07:45.301 20:57:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:45.301 20:57:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:45.301 20:57:41 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 [2024-11-27 20:57:41.334275] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 [2024-11-27 20:57:41.346480] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:45.301 20:57:41 -- target/referrals.sh@48 -- # jq length 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:45.301 20:57:41 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:45.301 20:57:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:45.301 20:57:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:45.301 20:57:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:45.301 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.301 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.301 20:57:41 -- target/referrals.sh@21 -- # sort 00:07:45.301 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:45.301 20:57:41 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:45.301 20:57:41 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:45.301 20:57:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:45.301 20:57:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:45.301 20:57:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:45.301 20:57:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:45.301 20:57:41 -- target/referrals.sh@26 -- # sort 00:07:45.585 20:57:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:45.585 20:57:41 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:45.585 20:57:41 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:45.585 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.585 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.585 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.585 20:57:41 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:45.585 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.586 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.586 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.586 20:57:41 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:45.586 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.586 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.586 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.586 20:57:41 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:45.586 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.586 20:57:41 -- target/referrals.sh@56 -- # jq length 00:07:45.586 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.586 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.586 20:57:41 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:45.586 20:57:41 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:45.586 20:57:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:45.586 20:57:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:45.586 20:57:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:45.586 20:57:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:45.586 20:57:41 -- target/referrals.sh@26 -- # sort 00:07:45.867 20:57:41 -- target/referrals.sh@26 -- # echo 00:07:45.867 20:57:41 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:45.867 20:57:41 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:45.867 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.867 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.867 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.867 20:57:41 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:45.867 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.867 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.867 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.867 20:57:41 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:45.867 20:57:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:45.867 20:57:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:45.867 20:57:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.867 20:57:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:45.867 20:57:41 -- common/autotest_common.sh@10 -- # set +x 00:07:45.867 20:57:41 -- target/referrals.sh@21 -- # sort 00:07:45.867 20:57:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.867 20:57:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:45.867 20:57:41 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:45.867 20:57:41 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:45.867 20:57:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:45.867 20:57:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:45.867 20:57:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:45.867 20:57:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:45.867 20:57:41 -- target/referrals.sh@26 -- # sort 00:07:46.135 20:57:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:46.135 20:57:42 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:46.135 20:57:42 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:46.135 20:57:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:46.135 20:57:42 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:46.135 20:57:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.135 20:57:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:46.135 20:57:42 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:46.135 20:57:42 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:46.135 20:57:42 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:46.135 20:57:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:46.135 20:57:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.135 20:57:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:46.393 20:57:42 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:46.393 20:57:42 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:46.393 20:57:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.393 20:57:42 -- common/autotest_common.sh@10 -- # set +x 00:07:46.393 20:57:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.393 20:57:42 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:46.393 20:57:42 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:46.393 20:57:42 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.393 20:57:42 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:46.393 20:57:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.393 20:57:42 -- common/autotest_common.sh@10 -- # set +x 00:07:46.393 20:57:42 -- target/referrals.sh@21 -- # sort 00:07:46.393 20:57:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.393 20:57:42 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:46.393 20:57:42 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:46.393 20:57:42 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:46.393 20:57:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:46.393 20:57:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:46.393 20:57:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.393 20:57:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:46.393 20:57:42 -- target/referrals.sh@26 -- # sort 00:07:46.651 20:57:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:46.651 20:57:42 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:46.651 20:57:42 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:46.651 20:57:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:46.651 20:57:42 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:46.651 20:57:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.651 20:57:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:46.909 20:57:42 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:46.909 20:57:42 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:46.909 20:57:42 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:46.909 20:57:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:46.909 20:57:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.909 20:57:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:46.909 20:57:43 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:46.909 20:57:43 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:46.909 20:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.909 20:57:43 -- common/autotest_common.sh@10 -- # set +x 00:07:46.909 20:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.909 20:57:43 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:46.909 20:57:43 -- target/referrals.sh@82 -- # jq length 00:07:46.909 20:57:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.909 20:57:43 -- common/autotest_common.sh@10 -- # set +x 00:07:46.909 20:57:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.909 20:57:43 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:46.909 20:57:43 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:46.909 20:57:43 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:46.909 20:57:43 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:46.909 20:57:43 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:46.909 20:57:43 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:46.909 20:57:43 -- target/referrals.sh@26 -- # sort 00:07:47.167 20:57:43 -- target/referrals.sh@26 -- # echo 00:07:47.167 20:57:43 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:47.167 20:57:43 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:47.167 20:57:43 -- target/referrals.sh@86 -- # nvmftestfini 00:07:47.167 20:57:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:47.167 20:57:43 -- nvmf/common.sh@116 -- # sync 00:07:47.167 20:57:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:47.167 20:57:43 -- nvmf/common.sh@119 -- # set +e 00:07:47.167 20:57:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:47.167 20:57:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:47.167 rmmod nvme_tcp 00:07:47.167 rmmod nvme_fabrics 00:07:47.167 rmmod nvme_keyring 00:07:47.167 20:57:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:47.167 20:57:43 -- nvmf/common.sh@123 -- # set -e 00:07:47.167 20:57:43 -- nvmf/common.sh@124 -- # return 0 00:07:47.167 20:57:43 -- nvmf/common.sh@477 -- # '[' -n 3893282 ']' 00:07:47.167 20:57:43 -- nvmf/common.sh@478 -- # killprocess 3893282 00:07:47.167 20:57:43 -- common/autotest_common.sh@936 -- # '[' -z 3893282 ']' 00:07:47.167 20:57:43 -- common/autotest_common.sh@940 -- # kill -0 3893282 00:07:47.167 20:57:43 -- common/autotest_common.sh@941 -- # uname 00:07:47.167 20:57:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:47.167 20:57:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3893282 00:07:47.425 20:57:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:47.425 20:57:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:47.425 20:57:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3893282' 00:07:47.425 killing process with pid 3893282 00:07:47.425 20:57:43 -- common/autotest_common.sh@955 -- # kill 3893282 00:07:47.425 20:57:43 -- common/autotest_common.sh@960 -- # wait 3893282 00:07:47.685 20:57:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:47.685 20:57:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:47.685 20:57:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:47.685 20:57:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:47.685 20:57:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:47.685 20:57:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:47.685 20:57:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:47.685 20:57:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:49.590 20:57:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:49.590 00:07:49.590 real 0m7.885s 00:07:49.590 user 0m14.504s 00:07:49.590 sys 0m2.341s 00:07:49.590 20:57:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.590 20:57:45 -- common/autotest_common.sh@10 -- # set +x 00:07:49.590 ************************************ 00:07:49.590 END TEST nvmf_referrals 00:07:49.590 ************************************ 00:07:49.590 20:57:45 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:49.590 20:57:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:49.590 20:57:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.590 20:57:45 -- common/autotest_common.sh@10 -- # set +x 00:07:49.590 ************************************ 00:07:49.590 START TEST nvmf_connect_disconnect 00:07:49.590 ************************************ 00:07:49.590 20:57:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:49.849 * Looking for test storage... 00:07:49.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:49.849 20:57:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.849 20:57:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.849 20:57:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.849 20:57:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.849 20:57:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.849 20:57:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.849 20:57:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.849 20:57:45 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.849 20:57:45 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.849 20:57:45 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.849 20:57:45 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.849 20:57:45 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.849 20:57:45 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.849 20:57:45 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.849 20:57:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.849 20:57:45 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.849 20:57:45 -- scripts/common.sh@344 -- # : 1 00:07:49.849 20:57:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.849 20:57:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.849 20:57:45 -- scripts/common.sh@364 -- # decimal 1 00:07:49.849 20:57:45 -- scripts/common.sh@352 -- # local d=1 00:07:49.849 20:57:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.849 20:57:45 -- scripts/common.sh@354 -- # echo 1 00:07:49.849 20:57:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.849 20:57:45 -- scripts/common.sh@365 -- # decimal 2 00:07:49.849 20:57:45 -- scripts/common.sh@352 -- # local d=2 00:07:49.849 20:57:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.849 20:57:45 -- scripts/common.sh@354 -- # echo 2 00:07:49.849 20:57:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.849 20:57:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.849 20:57:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.849 20:57:45 -- scripts/common.sh@367 -- # return 0 00:07:49.849 20:57:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.849 20:57:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.849 --rc genhtml_branch_coverage=1 00:07:49.849 --rc genhtml_function_coverage=1 00:07:49.849 --rc genhtml_legend=1 00:07:49.849 --rc geninfo_all_blocks=1 00:07:49.849 --rc geninfo_unexecuted_blocks=1 00:07:49.849 00:07:49.849 ' 00:07:49.849 20:57:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.849 --rc genhtml_branch_coverage=1 00:07:49.849 --rc genhtml_function_coverage=1 00:07:49.849 --rc genhtml_legend=1 00:07:49.849 --rc geninfo_all_blocks=1 00:07:49.849 --rc geninfo_unexecuted_blocks=1 00:07:49.849 00:07:49.849 ' 00:07:49.849 20:57:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.849 --rc genhtml_branch_coverage=1 00:07:49.849 --rc genhtml_function_coverage=1 00:07:49.849 --rc genhtml_legend=1 00:07:49.849 --rc geninfo_all_blocks=1 00:07:49.849 --rc geninfo_unexecuted_blocks=1 00:07:49.849 00:07:49.849 ' 00:07:49.849 20:57:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.849 --rc genhtml_branch_coverage=1 00:07:49.849 --rc genhtml_function_coverage=1 00:07:49.849 --rc genhtml_legend=1 00:07:49.849 --rc geninfo_all_blocks=1 00:07:49.849 --rc geninfo_unexecuted_blocks=1 00:07:49.849 00:07:49.849 ' 00:07:49.849 20:57:45 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:49.849 20:57:45 -- nvmf/common.sh@7 -- # uname -s 00:07:49.849 20:57:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:49.849 20:57:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:49.849 20:57:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:49.849 20:57:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:49.849 20:57:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:49.849 20:57:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:49.849 20:57:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:49.849 20:57:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:49.849 20:57:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:49.849 20:57:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:49.849 20:57:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:49.849 20:57:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:49.849 20:57:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:49.849 20:57:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:49.849 20:57:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:49.850 20:57:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:49.850 20:57:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:49.850 20:57:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:49.850 20:57:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:49.850 20:57:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.850 20:57:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.850 20:57:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.850 20:57:45 -- paths/export.sh@5 -- # export PATH 00:07:49.850 20:57:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.850 20:57:45 -- nvmf/common.sh@46 -- # : 0 00:07:49.850 20:57:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:49.850 20:57:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:49.850 20:57:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:49.850 20:57:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:49.850 20:57:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:49.850 20:57:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:49.850 20:57:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:49.850 20:57:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:49.850 20:57:45 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:49.850 20:57:45 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:49.850 20:57:45 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:49.850 20:57:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:49.850 20:57:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:49.850 20:57:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:49.850 20:57:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:49.850 20:57:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:49.850 20:57:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.850 20:57:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.850 20:57:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:49.850 20:57:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:49.850 20:57:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:49.850 20:57:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:49.850 20:57:45 -- common/autotest_common.sh@10 -- # set +x 00:07:51.754 20:57:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:51.754 20:57:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:51.754 20:57:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:51.754 20:57:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:51.754 20:57:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:51.754 20:57:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:51.754 20:57:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:51.754 20:57:47 -- nvmf/common.sh@294 -- # net_devs=() 00:07:51.754 20:57:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:51.754 20:57:47 -- nvmf/common.sh@295 -- # e810=() 00:07:51.754 20:57:47 -- nvmf/common.sh@295 -- # local -ga e810 00:07:51.754 20:57:47 -- nvmf/common.sh@296 -- # x722=() 00:07:51.754 20:57:47 -- nvmf/common.sh@296 -- # local -ga x722 00:07:51.754 20:57:47 -- nvmf/common.sh@297 -- # mlx=() 00:07:51.754 20:57:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:51.754 20:57:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:51.754 20:57:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:51.754 20:57:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:51.754 20:57:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:51.754 20:57:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:51.754 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:51.754 20:57:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:51.754 20:57:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:51.754 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:51.754 20:57:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:51.754 20:57:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:51.754 20:57:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:51.754 20:57:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:51.754 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:51.754 20:57:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:51.754 20:57:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:51.754 20:57:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:51.754 20:57:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:51.754 20:57:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:51.754 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:51.754 20:57:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:51.754 20:57:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:51.754 20:57:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:51.754 20:57:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:51.754 20:57:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:51.754 20:57:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:51.754 20:57:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:51.754 20:57:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:51.754 20:57:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:51.754 20:57:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:51.754 20:57:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:51.754 20:57:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:51.754 20:57:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:51.754 20:57:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:51.754 20:57:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:51.754 20:57:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:51.754 20:57:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:52.014 20:57:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:52.014 20:57:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:52.014 20:57:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:52.014 20:57:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:52.014 20:57:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:52.014 20:57:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:52.014 20:57:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:52.014 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:52.014 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:07:52.014 00:07:52.014 --- 10.0.0.2 ping statistics --- 00:07:52.014 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.014 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:07:52.014 20:57:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:52.014 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:52.014 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:07:52.014 00:07:52.014 --- 10.0.0.1 ping statistics --- 00:07:52.014 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.014 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:07:52.014 20:57:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:52.014 20:57:48 -- nvmf/common.sh@410 -- # return 0 00:07:52.014 20:57:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:52.014 20:57:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:52.014 20:57:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:52.014 20:57:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:52.014 20:57:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:52.014 20:57:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:52.014 20:57:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:52.014 20:57:48 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:52.014 20:57:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:52.014 20:57:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:52.014 20:57:48 -- common/autotest_common.sh@10 -- # set +x 00:07:52.014 20:57:48 -- nvmf/common.sh@469 -- # nvmfpid=3895747 00:07:52.014 20:57:48 -- nvmf/common.sh@470 -- # waitforlisten 3895747 00:07:52.014 20:57:48 -- common/autotest_common.sh@829 -- # '[' -z 3895747 ']' 00:07:52.014 20:57:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:52.014 20:57:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:52.014 20:57:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:52.014 20:57:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:52.014 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:52.014 20:57:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:52.014 20:57:48 -- common/autotest_common.sh@10 -- # set +x 00:07:52.014 [2024-11-27 20:57:48.165866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:52.014 [2024-11-27 20:57:48.165949] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:52.014 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.014 [2024-11-27 20:57:48.236104] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:52.273 [2024-11-27 20:57:48.359056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:52.273 [2024-11-27 20:57:48.359216] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:52.273 [2024-11-27 20:57:48.359235] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:52.273 [2024-11-27 20:57:48.359249] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:52.273 [2024-11-27 20:57:48.359344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:52.273 [2024-11-27 20:57:48.359410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:52.273 [2024-11-27 20:57:48.359464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:52.273 [2024-11-27 20:57:48.359467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.205 20:57:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:53.205 20:57:49 -- common/autotest_common.sh@862 -- # return 0 00:07:53.205 20:57:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:53.205 20:57:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 20:57:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:53.205 20:57:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 [2024-11-27 20:57:49.181124] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:53.205 20:57:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:53.205 20:57:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 20:57:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:53.205 20:57:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 20:57:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:53.205 20:57:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 20:57:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:53.205 20:57:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.205 20:57:49 -- common/autotest_common.sh@10 -- # set +x 00:07:53.205 [2024-11-27 20:57:49.234601] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:53.205 20:57:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:53.205 20:57:49 -- target/connect_disconnect.sh@34 -- # set +x 00:07:55.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.199 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.669 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.575 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.043 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.569 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.096 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.993 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.938 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.463 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.362 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.933 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.879 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.823 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.242 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.288 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.209 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.637 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.010 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.063 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.960 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.850 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.377 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.465 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.411 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.938 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.727 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.212 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.158 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.051 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.479 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.479 21:01:41 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:45.479 21:01:41 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:45.479 21:01:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:45.479 21:01:41 -- nvmf/common.sh@116 -- # sync 00:11:45.479 21:01:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:45.479 21:01:41 -- nvmf/common.sh@119 -- # set +e 00:11:45.479 21:01:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:45.479 21:01:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:45.479 rmmod nvme_tcp 00:11:45.479 rmmod nvme_fabrics 00:11:45.479 rmmod nvme_keyring 00:11:45.479 21:01:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:45.479 21:01:41 -- nvmf/common.sh@123 -- # set -e 00:11:45.479 21:01:41 -- nvmf/common.sh@124 -- # return 0 00:11:45.479 21:01:41 -- nvmf/common.sh@477 -- # '[' -n 3895747 ']' 00:11:45.479 21:01:41 -- nvmf/common.sh@478 -- # killprocess 3895747 00:11:45.479 21:01:41 -- common/autotest_common.sh@936 -- # '[' -z 3895747 ']' 00:11:45.479 21:01:41 -- common/autotest_common.sh@940 -- # kill -0 3895747 00:11:45.479 21:01:41 -- common/autotest_common.sh@941 -- # uname 00:11:45.479 21:01:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:45.479 21:01:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3895747 00:11:45.479 21:01:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:45.479 21:01:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:45.479 21:01:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3895747' 00:11:45.479 killing process with pid 3895747 00:11:45.479 21:01:41 -- common/autotest_common.sh@955 -- # kill 3895747 00:11:45.479 21:01:41 -- common/autotest_common.sh@960 -- # wait 3895747 00:11:45.479 21:01:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:45.479 21:01:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:45.479 21:01:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:45.479 21:01:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:45.479 21:01:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:45.479 21:01:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:45.479 21:01:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:45.479 21:01:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:48.015 21:01:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:48.015 00:11:48.015 real 3m57.920s 00:11:48.015 user 15m7.889s 00:11:48.015 sys 0m34.281s 00:11:48.015 21:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:48.015 21:01:43 -- common/autotest_common.sh@10 -- # set +x 00:11:48.015 ************************************ 00:11:48.015 END TEST nvmf_connect_disconnect 00:11:48.015 ************************************ 00:11:48.015 21:01:43 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:48.015 21:01:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:48.015 21:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:48.015 21:01:43 -- common/autotest_common.sh@10 -- # set +x 00:11:48.016 ************************************ 00:11:48.016 START TEST nvmf_multitarget 00:11:48.016 ************************************ 00:11:48.016 21:01:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:48.016 * Looking for test storage... 00:11:48.016 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:48.016 21:01:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:48.016 21:01:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:48.016 21:01:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:48.016 21:01:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:48.016 21:01:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:48.016 21:01:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:48.016 21:01:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:48.016 21:01:43 -- scripts/common.sh@335 -- # IFS=.-: 00:11:48.016 21:01:43 -- scripts/common.sh@335 -- # read -ra ver1 00:11:48.016 21:01:43 -- scripts/common.sh@336 -- # IFS=.-: 00:11:48.016 21:01:43 -- scripts/common.sh@336 -- # read -ra ver2 00:11:48.016 21:01:43 -- scripts/common.sh@337 -- # local 'op=<' 00:11:48.016 21:01:43 -- scripts/common.sh@339 -- # ver1_l=2 00:11:48.016 21:01:43 -- scripts/common.sh@340 -- # ver2_l=1 00:11:48.016 21:01:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:48.016 21:01:43 -- scripts/common.sh@343 -- # case "$op" in 00:11:48.016 21:01:43 -- scripts/common.sh@344 -- # : 1 00:11:48.016 21:01:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:48.016 21:01:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:48.016 21:01:43 -- scripts/common.sh@364 -- # decimal 1 00:11:48.016 21:01:43 -- scripts/common.sh@352 -- # local d=1 00:11:48.016 21:01:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:48.016 21:01:43 -- scripts/common.sh@354 -- # echo 1 00:11:48.016 21:01:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:48.016 21:01:43 -- scripts/common.sh@365 -- # decimal 2 00:11:48.016 21:01:43 -- scripts/common.sh@352 -- # local d=2 00:11:48.016 21:01:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:48.016 21:01:43 -- scripts/common.sh@354 -- # echo 2 00:11:48.016 21:01:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:48.016 21:01:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:48.016 21:01:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:48.016 21:01:43 -- scripts/common.sh@367 -- # return 0 00:11:48.016 21:01:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:48.016 21:01:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:48.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.016 --rc genhtml_branch_coverage=1 00:11:48.016 --rc genhtml_function_coverage=1 00:11:48.016 --rc genhtml_legend=1 00:11:48.016 --rc geninfo_all_blocks=1 00:11:48.016 --rc geninfo_unexecuted_blocks=1 00:11:48.016 00:11:48.016 ' 00:11:48.016 21:01:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:48.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.016 --rc genhtml_branch_coverage=1 00:11:48.016 --rc genhtml_function_coverage=1 00:11:48.016 --rc genhtml_legend=1 00:11:48.016 --rc geninfo_all_blocks=1 00:11:48.016 --rc geninfo_unexecuted_blocks=1 00:11:48.016 00:11:48.016 ' 00:11:48.016 21:01:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:48.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.016 --rc genhtml_branch_coverage=1 00:11:48.016 --rc genhtml_function_coverage=1 00:11:48.016 --rc genhtml_legend=1 00:11:48.016 --rc geninfo_all_blocks=1 00:11:48.016 --rc geninfo_unexecuted_blocks=1 00:11:48.016 00:11:48.016 ' 00:11:48.016 21:01:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:48.016 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.016 --rc genhtml_branch_coverage=1 00:11:48.016 --rc genhtml_function_coverage=1 00:11:48.016 --rc genhtml_legend=1 00:11:48.016 --rc geninfo_all_blocks=1 00:11:48.016 --rc geninfo_unexecuted_blocks=1 00:11:48.016 00:11:48.016 ' 00:11:48.016 21:01:43 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:48.016 21:01:43 -- nvmf/common.sh@7 -- # uname -s 00:11:48.016 21:01:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:48.016 21:01:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:48.016 21:01:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:48.016 21:01:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:48.016 21:01:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:48.016 21:01:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:48.016 21:01:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:48.016 21:01:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:48.016 21:01:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:48.016 21:01:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:48.016 21:01:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:48.016 21:01:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:48.016 21:01:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:48.016 21:01:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:48.016 21:01:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:48.016 21:01:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:48.016 21:01:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:48.016 21:01:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:48.016 21:01:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:48.016 21:01:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.016 21:01:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.016 21:01:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.016 21:01:43 -- paths/export.sh@5 -- # export PATH 00:11:48.016 21:01:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.016 21:01:43 -- nvmf/common.sh@46 -- # : 0 00:11:48.016 21:01:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:48.017 21:01:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:48.017 21:01:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:48.017 21:01:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:48.017 21:01:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:48.017 21:01:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:48.017 21:01:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:48.017 21:01:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:48.017 21:01:43 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:48.017 21:01:43 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:48.017 21:01:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:48.017 21:01:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:48.017 21:01:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:48.017 21:01:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:48.017 21:01:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:48.017 21:01:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:48.017 21:01:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:48.017 21:01:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:48.017 21:01:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:48.017 21:01:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:48.017 21:01:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:48.017 21:01:43 -- common/autotest_common.sh@10 -- # set +x 00:11:49.919 21:01:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:49.919 21:01:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:49.919 21:01:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:49.919 21:01:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:49.919 21:01:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:49.919 21:01:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:49.919 21:01:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:49.919 21:01:45 -- nvmf/common.sh@294 -- # net_devs=() 00:11:49.919 21:01:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:49.919 21:01:45 -- nvmf/common.sh@295 -- # e810=() 00:11:49.920 21:01:45 -- nvmf/common.sh@295 -- # local -ga e810 00:11:49.920 21:01:45 -- nvmf/common.sh@296 -- # x722=() 00:11:49.920 21:01:45 -- nvmf/common.sh@296 -- # local -ga x722 00:11:49.920 21:01:45 -- nvmf/common.sh@297 -- # mlx=() 00:11:49.920 21:01:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:49.920 21:01:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:49.920 21:01:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:49.920 21:01:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:49.920 21:01:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.920 21:01:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:49.920 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:49.920 21:01:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.920 21:01:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:49.920 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:49.920 21:01:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.920 21:01:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.920 21:01:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.920 21:01:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:49.920 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:49.920 21:01:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.920 21:01:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.920 21:01:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.920 21:01:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.920 21:01:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:49.920 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:49.920 21:01:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.920 21:01:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:49.920 21:01:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:49.920 21:01:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:49.920 21:01:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:49.920 21:01:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:49.920 21:01:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:49.920 21:01:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:49.920 21:01:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:49.920 21:01:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:49.920 21:01:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:49.920 21:01:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:49.920 21:01:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:49.920 21:01:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:49.920 21:01:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:49.920 21:01:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:49.920 21:01:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:49.920 21:01:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:49.920 21:01:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:49.920 21:01:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:49.920 21:01:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:49.920 21:01:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:49.920 21:01:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:49.920 21:01:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:49.920 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:49.920 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:11:49.920 00:11:49.920 --- 10.0.0.2 ping statistics --- 00:11:49.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:49.920 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:11:49.920 21:01:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:49.920 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:49.920 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:11:49.920 00:11:49.920 --- 10.0.0.1 ping statistics --- 00:11:49.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:49.920 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:11:49.920 21:01:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:49.920 21:01:46 -- nvmf/common.sh@410 -- # return 0 00:11:49.920 21:01:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:49.920 21:01:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:49.920 21:01:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:49.920 21:01:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:49.920 21:01:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:49.920 21:01:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:49.920 21:01:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:49.920 21:01:46 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:49.920 21:01:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:49.920 21:01:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:49.920 21:01:46 -- common/autotest_common.sh@10 -- # set +x 00:11:49.920 21:01:46 -- nvmf/common.sh@469 -- # nvmfpid=3927913 00:11:49.921 21:01:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:49.921 21:01:46 -- nvmf/common.sh@470 -- # waitforlisten 3927913 00:11:49.921 21:01:46 -- common/autotest_common.sh@829 -- # '[' -z 3927913 ']' 00:11:49.921 21:01:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:49.921 21:01:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:49.921 21:01:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:49.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:49.921 21:01:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:49.921 21:01:46 -- common/autotest_common.sh@10 -- # set +x 00:11:49.921 [2024-11-27 21:01:46.138016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:49.921 [2024-11-27 21:01:46.138099] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:50.180 EAL: No free 2048 kB hugepages reported on node 1 00:11:50.180 [2024-11-27 21:01:46.210118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:50.180 [2024-11-27 21:01:46.330038] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:50.180 [2024-11-27 21:01:46.330207] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:50.180 [2024-11-27 21:01:46.330226] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:50.180 [2024-11-27 21:01:46.330240] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:50.180 [2024-11-27 21:01:46.330332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:50.180 [2024-11-27 21:01:46.330389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:50.180 [2024-11-27 21:01:46.330442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:50.181 [2024-11-27 21:01:46.330446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:51.113 21:01:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:51.113 21:01:47 -- common/autotest_common.sh@862 -- # return 0 00:11:51.113 21:01:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:51.113 21:01:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:51.113 21:01:47 -- common/autotest_common.sh@10 -- # set +x 00:11:51.113 21:01:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:51.113 21:01:47 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:51.113 21:01:47 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:51.113 21:01:47 -- target/multitarget.sh@21 -- # jq length 00:11:51.113 21:01:47 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:51.113 21:01:47 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:51.370 "nvmf_tgt_1" 00:11:51.370 21:01:47 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:51.370 "nvmf_tgt_2" 00:11:51.370 21:01:47 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:51.370 21:01:47 -- target/multitarget.sh@28 -- # jq length 00:11:51.627 21:01:47 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:51.627 21:01:47 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:51.627 true 00:11:51.627 21:01:47 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:51.627 true 00:11:51.627 21:01:47 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:51.627 21:01:47 -- target/multitarget.sh@35 -- # jq length 00:11:51.885 21:01:47 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:51.885 21:01:47 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:51.885 21:01:47 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:51.885 21:01:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:51.885 21:01:47 -- nvmf/common.sh@116 -- # sync 00:11:51.885 21:01:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:51.885 21:01:47 -- nvmf/common.sh@119 -- # set +e 00:11:51.885 21:01:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:51.885 21:01:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:51.885 rmmod nvme_tcp 00:11:51.885 rmmod nvme_fabrics 00:11:51.885 rmmod nvme_keyring 00:11:51.885 21:01:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:51.885 21:01:48 -- nvmf/common.sh@123 -- # set -e 00:11:51.885 21:01:48 -- nvmf/common.sh@124 -- # return 0 00:11:51.885 21:01:48 -- nvmf/common.sh@477 -- # '[' -n 3927913 ']' 00:11:51.885 21:01:48 -- nvmf/common.sh@478 -- # killprocess 3927913 00:11:51.885 21:01:48 -- common/autotest_common.sh@936 -- # '[' -z 3927913 ']' 00:11:51.885 21:01:48 -- common/autotest_common.sh@940 -- # kill -0 3927913 00:11:51.885 21:01:48 -- common/autotest_common.sh@941 -- # uname 00:11:51.885 21:01:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:51.885 21:01:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3927913 00:11:51.885 21:01:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:51.885 21:01:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:51.885 21:01:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3927913' 00:11:51.885 killing process with pid 3927913 00:11:51.885 21:01:48 -- common/autotest_common.sh@955 -- # kill 3927913 00:11:51.885 21:01:48 -- common/autotest_common.sh@960 -- # wait 3927913 00:11:52.144 21:01:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:52.144 21:01:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:52.144 21:01:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:52.144 21:01:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:52.144 21:01:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:52.144 21:01:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:52.144 21:01:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:52.144 21:01:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:54.683 21:01:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:54.683 00:11:54.683 real 0m6.620s 00:11:54.683 user 0m9.570s 00:11:54.683 sys 0m2.057s 00:11:54.683 21:01:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:54.683 21:01:50 -- common/autotest_common.sh@10 -- # set +x 00:11:54.683 ************************************ 00:11:54.683 END TEST nvmf_multitarget 00:11:54.683 ************************************ 00:11:54.683 21:01:50 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:54.683 21:01:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:54.683 21:01:50 -- common/autotest_common.sh@10 -- # set +x 00:11:54.683 ************************************ 00:11:54.683 START TEST nvmf_rpc 00:11:54.683 ************************************ 00:11:54.683 21:01:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:54.683 * Looking for test storage... 00:11:54.683 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:54.683 21:01:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:54.683 21:01:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:54.683 21:01:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:54.683 21:01:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:54.683 21:01:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:54.683 21:01:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:54.683 21:01:50 -- scripts/common.sh@335 -- # IFS=.-: 00:11:54.683 21:01:50 -- scripts/common.sh@335 -- # read -ra ver1 00:11:54.683 21:01:50 -- scripts/common.sh@336 -- # IFS=.-: 00:11:54.683 21:01:50 -- scripts/common.sh@336 -- # read -ra ver2 00:11:54.683 21:01:50 -- scripts/common.sh@337 -- # local 'op=<' 00:11:54.683 21:01:50 -- scripts/common.sh@339 -- # ver1_l=2 00:11:54.683 21:01:50 -- scripts/common.sh@340 -- # ver2_l=1 00:11:54.683 21:01:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:54.683 21:01:50 -- scripts/common.sh@343 -- # case "$op" in 00:11:54.683 21:01:50 -- scripts/common.sh@344 -- # : 1 00:11:54.683 21:01:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:54.683 21:01:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:54.683 21:01:50 -- scripts/common.sh@364 -- # decimal 1 00:11:54.683 21:01:50 -- scripts/common.sh@352 -- # local d=1 00:11:54.683 21:01:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:54.683 21:01:50 -- scripts/common.sh@354 -- # echo 1 00:11:54.683 21:01:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:54.683 21:01:50 -- scripts/common.sh@365 -- # decimal 2 00:11:54.683 21:01:50 -- scripts/common.sh@352 -- # local d=2 00:11:54.683 21:01:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:54.683 21:01:50 -- scripts/common.sh@354 -- # echo 2 00:11:54.683 21:01:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:54.683 21:01:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:54.683 21:01:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:54.683 21:01:50 -- scripts/common.sh@367 -- # return 0 00:11:54.683 21:01:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:54.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:54.683 --rc genhtml_branch_coverage=1 00:11:54.683 --rc genhtml_function_coverage=1 00:11:54.683 --rc genhtml_legend=1 00:11:54.683 --rc geninfo_all_blocks=1 00:11:54.683 --rc geninfo_unexecuted_blocks=1 00:11:54.683 00:11:54.683 ' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:54.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:54.683 --rc genhtml_branch_coverage=1 00:11:54.683 --rc genhtml_function_coverage=1 00:11:54.683 --rc genhtml_legend=1 00:11:54.683 --rc geninfo_all_blocks=1 00:11:54.683 --rc geninfo_unexecuted_blocks=1 00:11:54.683 00:11:54.683 ' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:54.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:54.683 --rc genhtml_branch_coverage=1 00:11:54.683 --rc genhtml_function_coverage=1 00:11:54.683 --rc genhtml_legend=1 00:11:54.683 --rc geninfo_all_blocks=1 00:11:54.683 --rc geninfo_unexecuted_blocks=1 00:11:54.683 00:11:54.683 ' 00:11:54.683 21:01:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:54.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:54.683 --rc genhtml_branch_coverage=1 00:11:54.683 --rc genhtml_function_coverage=1 00:11:54.683 --rc genhtml_legend=1 00:11:54.683 --rc geninfo_all_blocks=1 00:11:54.683 --rc geninfo_unexecuted_blocks=1 00:11:54.683 00:11:54.683 ' 00:11:54.683 21:01:50 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:54.683 21:01:50 -- nvmf/common.sh@7 -- # uname -s 00:11:54.683 21:01:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:54.683 21:01:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:54.683 21:01:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:54.683 21:01:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:54.683 21:01:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:54.683 21:01:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:54.683 21:01:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:54.683 21:01:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:54.683 21:01:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:54.683 21:01:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:54.683 21:01:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:54.683 21:01:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:54.683 21:01:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:54.683 21:01:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:54.683 21:01:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:54.683 21:01:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:54.683 21:01:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:54.683 21:01:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:54.683 21:01:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:54.683 21:01:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.683 21:01:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.683 21:01:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.683 21:01:50 -- paths/export.sh@5 -- # export PATH 00:11:54.683 21:01:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.683 21:01:50 -- nvmf/common.sh@46 -- # : 0 00:11:54.683 21:01:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:54.683 21:01:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:54.683 21:01:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:54.683 21:01:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:54.683 21:01:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:54.683 21:01:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:54.683 21:01:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:54.683 21:01:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:54.683 21:01:50 -- target/rpc.sh@11 -- # loops=5 00:11:54.683 21:01:50 -- target/rpc.sh@23 -- # nvmftestinit 00:11:54.683 21:01:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:54.683 21:01:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:54.683 21:01:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:54.683 21:01:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:54.683 21:01:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:54.683 21:01:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:54.683 21:01:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:54.683 21:01:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:54.683 21:01:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:54.683 21:01:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:54.683 21:01:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:54.683 21:01:50 -- common/autotest_common.sh@10 -- # set +x 00:11:56.583 21:01:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:56.583 21:01:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:56.583 21:01:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:56.583 21:01:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:56.583 21:01:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:56.583 21:01:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:56.583 21:01:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:56.583 21:01:52 -- nvmf/common.sh@294 -- # net_devs=() 00:11:56.583 21:01:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:56.583 21:01:52 -- nvmf/common.sh@295 -- # e810=() 00:11:56.583 21:01:52 -- nvmf/common.sh@295 -- # local -ga e810 00:11:56.583 21:01:52 -- nvmf/common.sh@296 -- # x722=() 00:11:56.583 21:01:52 -- nvmf/common.sh@296 -- # local -ga x722 00:11:56.583 21:01:52 -- nvmf/common.sh@297 -- # mlx=() 00:11:56.583 21:01:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:56.583 21:01:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:56.583 21:01:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:56.583 21:01:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:56.583 21:01:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:56.583 21:01:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:56.584 21:01:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:56.584 21:01:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:56.584 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:56.584 21:01:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:56.584 21:01:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:56.584 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:56.584 21:01:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:56.584 21:01:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:56.584 21:01:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:56.584 21:01:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:56.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:56.584 21:01:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:56.584 21:01:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:56.584 21:01:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:56.584 21:01:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:56.584 21:01:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:56.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:56.584 21:01:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:56.584 21:01:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:56.584 21:01:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:56.584 21:01:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:56.584 21:01:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:56.584 21:01:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:56.584 21:01:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:56.584 21:01:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:56.584 21:01:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:56.584 21:01:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:56.584 21:01:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:56.584 21:01:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:56.584 21:01:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:56.584 21:01:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:56.584 21:01:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:56.584 21:01:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:56.584 21:01:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:56.584 21:01:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:56.584 21:01:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:56.584 21:01:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:56.584 21:01:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:56.584 21:01:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:56.584 21:01:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:56.584 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:56.584 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:11:56.584 00:11:56.584 --- 10.0.0.2 ping statistics --- 00:11:56.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:56.584 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:11:56.584 21:01:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:56.584 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:56.584 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:11:56.584 00:11:56.584 --- 10.0.0.1 ping statistics --- 00:11:56.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:56.584 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:11:56.584 21:01:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:56.584 21:01:52 -- nvmf/common.sh@410 -- # return 0 00:11:56.584 21:01:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:56.584 21:01:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:56.584 21:01:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:56.584 21:01:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:56.584 21:01:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:56.584 21:01:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:56.584 21:01:52 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:56.584 21:01:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:56.584 21:01:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:56.584 21:01:52 -- common/autotest_common.sh@10 -- # set +x 00:11:56.584 21:01:52 -- nvmf/common.sh@469 -- # nvmfpid=3930160 00:11:56.584 21:01:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:56.584 21:01:52 -- nvmf/common.sh@470 -- # waitforlisten 3930160 00:11:56.584 21:01:52 -- common/autotest_common.sh@829 -- # '[' -z 3930160 ']' 00:11:56.584 21:01:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:56.584 21:01:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:56.584 21:01:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:56.584 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:56.584 21:01:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:56.584 21:01:52 -- common/autotest_common.sh@10 -- # set +x 00:11:56.584 [2024-11-27 21:01:52.808498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:56.584 [2024-11-27 21:01:52.808593] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:56.842 EAL: No free 2048 kB hugepages reported on node 1 00:11:56.842 [2024-11-27 21:01:52.885750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:56.842 [2024-11-27 21:01:53.010689] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:56.842 [2024-11-27 21:01:53.010852] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:56.842 [2024-11-27 21:01:53.010871] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:56.842 [2024-11-27 21:01:53.010892] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:56.842 [2024-11-27 21:01:53.010955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:56.842 [2024-11-27 21:01:53.011011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:56.842 [2024-11-27 21:01:53.011037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:56.842 [2024-11-27 21:01:53.011040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:57.775 21:01:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:57.775 21:01:53 -- common/autotest_common.sh@862 -- # return 0 00:11:57.775 21:01:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:57.775 21:01:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:57.775 21:01:53 -- common/autotest_common.sh@10 -- # set +x 00:11:57.775 21:01:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:57.775 21:01:53 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:57.775 21:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:57.775 21:01:53 -- common/autotest_common.sh@10 -- # set +x 00:11:57.775 21:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:57.775 21:01:53 -- target/rpc.sh@26 -- # stats='{ 00:11:57.775 "tick_rate": 2700000000, 00:11:57.775 "poll_groups": [ 00:11:57.775 { 00:11:57.775 "name": "nvmf_tgt_poll_group_0", 00:11:57.775 "admin_qpairs": 0, 00:11:57.775 "io_qpairs": 0, 00:11:57.775 "current_admin_qpairs": 0, 00:11:57.775 "current_io_qpairs": 0, 00:11:57.775 "pending_bdev_io": 0, 00:11:57.775 "completed_nvme_io": 0, 00:11:57.775 "transports": [] 00:11:57.775 }, 00:11:57.775 { 00:11:57.775 "name": "nvmf_tgt_poll_group_1", 00:11:57.775 "admin_qpairs": 0, 00:11:57.775 "io_qpairs": 0, 00:11:57.775 "current_admin_qpairs": 0, 00:11:57.775 "current_io_qpairs": 0, 00:11:57.775 "pending_bdev_io": 0, 00:11:57.775 "completed_nvme_io": 0, 00:11:57.775 "transports": [] 00:11:57.775 }, 00:11:57.775 { 00:11:57.775 "name": "nvmf_tgt_poll_group_2", 00:11:57.775 "admin_qpairs": 0, 00:11:57.775 "io_qpairs": 0, 00:11:57.775 "current_admin_qpairs": 0, 00:11:57.775 "current_io_qpairs": 0, 00:11:57.775 "pending_bdev_io": 0, 00:11:57.775 "completed_nvme_io": 0, 00:11:57.775 "transports": [] 00:11:57.775 }, 00:11:57.775 { 00:11:57.775 "name": "nvmf_tgt_poll_group_3", 00:11:57.775 "admin_qpairs": 0, 00:11:57.775 "io_qpairs": 0, 00:11:57.775 "current_admin_qpairs": 0, 00:11:57.775 "current_io_qpairs": 0, 00:11:57.775 "pending_bdev_io": 0, 00:11:57.775 "completed_nvme_io": 0, 00:11:57.775 "transports": [] 00:11:57.775 } 00:11:57.775 ] 00:11:57.775 }' 00:11:57.775 21:01:53 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:57.775 21:01:53 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:57.775 21:01:53 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:57.775 21:01:53 -- target/rpc.sh@15 -- # wc -l 00:11:57.775 21:01:53 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:57.775 21:01:53 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:57.775 21:01:53 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:57.775 21:01:53 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:57.775 21:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:57.775 21:01:53 -- common/autotest_common.sh@10 -- # set +x 00:11:57.775 [2024-11-27 21:01:53.951488] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:57.775 21:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:57.775 21:01:53 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:57.775 21:01:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:57.775 21:01:53 -- common/autotest_common.sh@10 -- # set +x 00:11:57.775 21:01:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:57.775 21:01:53 -- target/rpc.sh@33 -- # stats='{ 00:11:57.775 "tick_rate": 2700000000, 00:11:57.775 "poll_groups": [ 00:11:57.775 { 00:11:57.775 "name": "nvmf_tgt_poll_group_0", 00:11:57.776 "admin_qpairs": 0, 00:11:57.776 "io_qpairs": 0, 00:11:57.776 "current_admin_qpairs": 0, 00:11:57.776 "current_io_qpairs": 0, 00:11:57.776 "pending_bdev_io": 0, 00:11:57.776 "completed_nvme_io": 0, 00:11:57.776 "transports": [ 00:11:57.776 { 00:11:57.776 "trtype": "TCP" 00:11:57.776 } 00:11:57.776 ] 00:11:57.776 }, 00:11:57.776 { 00:11:57.776 "name": "nvmf_tgt_poll_group_1", 00:11:57.776 "admin_qpairs": 0, 00:11:57.776 "io_qpairs": 0, 00:11:57.776 "current_admin_qpairs": 0, 00:11:57.776 "current_io_qpairs": 0, 00:11:57.776 "pending_bdev_io": 0, 00:11:57.776 "completed_nvme_io": 0, 00:11:57.776 "transports": [ 00:11:57.776 { 00:11:57.776 "trtype": "TCP" 00:11:57.776 } 00:11:57.776 ] 00:11:57.776 }, 00:11:57.776 { 00:11:57.776 "name": "nvmf_tgt_poll_group_2", 00:11:57.776 "admin_qpairs": 0, 00:11:57.776 "io_qpairs": 0, 00:11:57.776 "current_admin_qpairs": 0, 00:11:57.776 "current_io_qpairs": 0, 00:11:57.776 "pending_bdev_io": 0, 00:11:57.776 "completed_nvme_io": 0, 00:11:57.776 "transports": [ 00:11:57.776 { 00:11:57.776 "trtype": "TCP" 00:11:57.776 } 00:11:57.776 ] 00:11:57.776 }, 00:11:57.776 { 00:11:57.776 "name": "nvmf_tgt_poll_group_3", 00:11:57.776 "admin_qpairs": 0, 00:11:57.776 "io_qpairs": 0, 00:11:57.776 "current_admin_qpairs": 0, 00:11:57.776 "current_io_qpairs": 0, 00:11:57.776 "pending_bdev_io": 0, 00:11:57.776 "completed_nvme_io": 0, 00:11:57.776 "transports": [ 00:11:57.776 { 00:11:57.776 "trtype": "TCP" 00:11:57.776 } 00:11:57.776 ] 00:11:57.776 } 00:11:57.776 ] 00:11:57.776 }' 00:11:57.776 21:01:53 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:57.776 21:01:53 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:57.776 21:01:53 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:57.776 21:01:53 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:57.776 21:01:54 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:57.776 21:01:54 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:57.776 21:01:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:57.776 21:01:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:57.776 21:01:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:58.033 21:01:54 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:58.033 21:01:54 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:58.033 21:01:54 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:58.033 21:01:54 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:58.033 21:01:54 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:58.033 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.033 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.033 Malloc1 00:11:58.033 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.033 21:01:54 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:58.033 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.033 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.033 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.033 21:01:54 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:58.033 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.033 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.033 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.033 21:01:54 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:58.033 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.033 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.033 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.033 21:01:54 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:58.034 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.034 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.034 [2024-11-27 21:01:54.104384] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:58.034 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.034 21:01:54 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:58.034 21:01:54 -- common/autotest_common.sh@650 -- # local es=0 00:11:58.034 21:01:54 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:58.034 21:01:54 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:58.034 21:01:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.034 21:01:54 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:58.034 21:01:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.034 21:01:54 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:58.034 21:01:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.034 21:01:54 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:58.034 21:01:54 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:58.034 21:01:54 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:58.034 [2024-11-27 21:01:54.126842] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:58.034 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:58.034 could not add new controller: failed to write to nvme-fabrics device 00:11:58.034 21:01:54 -- common/autotest_common.sh@653 -- # es=1 00:11:58.034 21:01:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:58.034 21:01:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:58.034 21:01:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:58.034 21:01:54 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.034 21:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.034 21:01:54 -- common/autotest_common.sh@10 -- # set +x 00:11:58.034 21:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.034 21:01:54 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.660 21:01:54 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:58.660 21:01:54 -- common/autotest_common.sh@1187 -- # local i=0 00:11:58.660 21:01:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.660 21:01:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:58.660 21:01:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.188 21:01:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.188 21:01:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.188 21:01:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.188 21:01:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.188 21:01:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.188 21:01:56 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.188 21:01:56 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.188 21:01:56 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.188 21:01:56 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.188 21:01:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.188 21:01:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.188 21:01:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.188 21:01:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.188 21:01:56 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.188 21:01:56 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:01.188 21:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.188 21:01:56 -- common/autotest_common.sh@10 -- # set +x 00:12:01.188 21:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.188 21:01:56 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.188 21:01:56 -- common/autotest_common.sh@650 -- # local es=0 00:12:01.188 21:01:56 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.188 21:01:56 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:01.188 21:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.188 21:01:56 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:01.188 21:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.188 21:01:56 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:01.188 21:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.188 21:01:56 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:01.188 21:01:56 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:01.188 21:01:56 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.188 [2024-11-27 21:01:56.966002] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:01.188 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:01.188 could not add new controller: failed to write to nvme-fabrics device 00:12:01.188 21:01:56 -- common/autotest_common.sh@653 -- # es=1 00:12:01.188 21:01:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:01.188 21:01:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:01.188 21:01:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:01.188 21:01:56 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:01.188 21:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.188 21:01:56 -- common/autotest_common.sh@10 -- # set +x 00:12:01.188 21:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.188 21:01:56 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.753 21:01:57 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:01.754 21:01:57 -- common/autotest_common.sh@1187 -- # local i=0 00:12:01.754 21:01:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:01.754 21:01:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:01.754 21:01:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:03.654 21:01:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:03.654 21:01:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:03.654 21:01:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:03.654 21:01:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:03.654 21:01:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:03.654 21:01:59 -- common/autotest_common.sh@1197 -- # return 0 00:12:03.654 21:01:59 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:03.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.654 21:01:59 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:03.654 21:01:59 -- common/autotest_common.sh@1208 -- # local i=0 00:12:03.654 21:01:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:03.654 21:01:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.654 21:01:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:03.654 21:01:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.654 21:01:59 -- common/autotest_common.sh@1220 -- # return 0 00:12:03.654 21:01:59 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:03.654 21:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.654 21:01:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.654 21:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.654 21:01:59 -- target/rpc.sh@81 -- # seq 1 5 00:12:03.654 21:01:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:03.654 21:01:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:03.654 21:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.654 21:01:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.654 21:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.654 21:01:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:03.654 21:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.654 21:01:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.654 [2024-11-27 21:01:59.894063] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:03.912 21:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.912 21:01:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:03.912 21:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.912 21:01:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.912 21:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.912 21:01:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:03.912 21:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.912 21:01:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.912 21:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.912 21:01:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.479 21:02:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.479 21:02:00 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.479 21:02:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.479 21:02:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.479 21:02:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:06.378 21:02:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:06.378 21:02:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:06.378 21:02:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:06.378 21:02:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:06.378 21:02:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:06.378 21:02:02 -- common/autotest_common.sh@1197 -- # return 0 00:12:06.378 21:02:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:06.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.636 21:02:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:06.636 21:02:02 -- common/autotest_common.sh@1208 -- # local i=0 00:12:06.636 21:02:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:06.636 21:02:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.636 21:02:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:06.636 21:02:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.636 21:02:02 -- common/autotest_common.sh@1220 -- # return 0 00:12:06.636 21:02:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:06.636 21:02:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 [2024-11-27 21:02:02.681728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.636 21:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.636 21:02:02 -- common/autotest_common.sh@10 -- # set +x 00:12:06.636 21:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.636 21:02:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:07.202 21:02:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:07.203 21:02:03 -- common/autotest_common.sh@1187 -- # local i=0 00:12:07.203 21:02:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:07.203 21:02:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:07.203 21:02:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:09.732 21:02:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:09.732 21:02:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:09.732 21:02:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:09.732 21:02:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:09.732 21:02:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:09.732 21:02:05 -- common/autotest_common.sh@1197 -- # return 0 00:12:09.732 21:02:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:09.732 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.732 21:02:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:09.732 21:02:05 -- common/autotest_common.sh@1208 -- # local i=0 00:12:09.732 21:02:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:09.732 21:02:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.732 21:02:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:09.732 21:02:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.732 21:02:05 -- common/autotest_common.sh@1220 -- # return 0 00:12:09.732 21:02:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:09.732 21:02:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 [2024-11-27 21:02:05.516063] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.732 21:02:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.732 21:02:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.732 21:02:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.732 21:02:05 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:09.990 21:02:06 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:09.990 21:02:06 -- common/autotest_common.sh@1187 -- # local i=0 00:12:09.990 21:02:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:09.990 21:02:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:09.990 21:02:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:12.519 21:02:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:12.519 21:02:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:12.519 21:02:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:12.519 21:02:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:12.519 21:02:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:12.519 21:02:08 -- common/autotest_common.sh@1197 -- # return 0 00:12:12.519 21:02:08 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:12.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.519 21:02:08 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:12.519 21:02:08 -- common/autotest_common.sh@1208 -- # local i=0 00:12:12.519 21:02:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:12.519 21:02:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.519 21:02:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:12.519 21:02:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.519 21:02:08 -- common/autotest_common.sh@1220 -- # return 0 00:12:12.519 21:02:08 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:12.519 21:02:08 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 [2024-11-27 21:02:08.316550] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.519 21:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.519 21:02:08 -- common/autotest_common.sh@10 -- # set +x 00:12:12.519 21:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.519 21:02:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:12.777 21:02:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:12.777 21:02:08 -- common/autotest_common.sh@1187 -- # local i=0 00:12:12.777 21:02:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:12.777 21:02:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:12.777 21:02:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:15.303 21:02:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:15.303 21:02:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:15.303 21:02:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:15.303 21:02:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:15.303 21:02:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:15.303 21:02:10 -- common/autotest_common.sh@1197 -- # return 0 00:12:15.303 21:02:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:15.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.303 21:02:11 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:15.303 21:02:11 -- common/autotest_common.sh@1208 -- # local i=0 00:12:15.303 21:02:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:15.303 21:02:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.303 21:02:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:15.303 21:02:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.303 21:02:11 -- common/autotest_common.sh@1220 -- # return 0 00:12:15.303 21:02:11 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:15.303 21:02:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 [2024-11-27 21:02:11.100592] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.303 21:02:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.303 21:02:11 -- common/autotest_common.sh@10 -- # set +x 00:12:15.303 21:02:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.303 21:02:11 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:15.561 21:02:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:15.561 21:02:11 -- common/autotest_common.sh@1187 -- # local i=0 00:12:15.561 21:02:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:15.561 21:02:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:15.561 21:02:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:18.089 21:02:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:18.089 21:02:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:18.089 21:02:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:18.089 21:02:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:18.089 21:02:13 -- common/autotest_common.sh@1197 -- # return 0 00:12:18.089 21:02:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:18.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.089 21:02:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@1208 -- # local i=0 00:12:18.089 21:02:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:18.089 21:02:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:18.089 21:02:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@1220 -- # return 0 00:12:18.089 21:02:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@99 -- # seq 1 5 00:12:18.089 21:02:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:18.089 21:02:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 [2024-11-27 21:02:13.895078] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:18.089 21:02:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 [2024-11-27 21:02:13.943119] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:18.089 21:02:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 [2024-11-27 21:02:13.991298] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.089 21:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:18.089 21:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:13 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.089 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.089 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.089 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.089 21:02:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:18.090 21:02:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 [2024-11-27 21:02:14.039449] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:18.090 21:02:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 [2024-11-27 21:02:14.087649] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:18.090 21:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.090 21:02:14 -- common/autotest_common.sh@10 -- # set +x 00:12:18.090 21:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.090 21:02:14 -- target/rpc.sh@110 -- # stats='{ 00:12:18.090 "tick_rate": 2700000000, 00:12:18.090 "poll_groups": [ 00:12:18.090 { 00:12:18.090 "name": "nvmf_tgt_poll_group_0", 00:12:18.090 "admin_qpairs": 2, 00:12:18.090 "io_qpairs": 84, 00:12:18.090 "current_admin_qpairs": 0, 00:12:18.090 "current_io_qpairs": 0, 00:12:18.090 "pending_bdev_io": 0, 00:12:18.090 "completed_nvme_io": 135, 00:12:18.090 "transports": [ 00:12:18.090 { 00:12:18.090 "trtype": "TCP" 00:12:18.090 } 00:12:18.090 ] 00:12:18.090 }, 00:12:18.090 { 00:12:18.090 "name": "nvmf_tgt_poll_group_1", 00:12:18.090 "admin_qpairs": 2, 00:12:18.090 "io_qpairs": 84, 00:12:18.090 "current_admin_qpairs": 0, 00:12:18.090 "current_io_qpairs": 0, 00:12:18.090 "pending_bdev_io": 0, 00:12:18.090 "completed_nvme_io": 85, 00:12:18.090 "transports": [ 00:12:18.090 { 00:12:18.090 "trtype": "TCP" 00:12:18.090 } 00:12:18.090 ] 00:12:18.090 }, 00:12:18.090 { 00:12:18.090 "name": "nvmf_tgt_poll_group_2", 00:12:18.090 "admin_qpairs": 1, 00:12:18.090 "io_qpairs": 84, 00:12:18.090 "current_admin_qpairs": 0, 00:12:18.090 "current_io_qpairs": 0, 00:12:18.090 "pending_bdev_io": 0, 00:12:18.090 "completed_nvme_io": 134, 00:12:18.090 "transports": [ 00:12:18.090 { 00:12:18.090 "trtype": "TCP" 00:12:18.090 } 00:12:18.090 ] 00:12:18.090 }, 00:12:18.090 { 00:12:18.090 "name": "nvmf_tgt_poll_group_3", 00:12:18.090 "admin_qpairs": 2, 00:12:18.090 "io_qpairs": 84, 00:12:18.090 "current_admin_qpairs": 0, 00:12:18.090 "current_io_qpairs": 0, 00:12:18.090 "pending_bdev_io": 0, 00:12:18.090 "completed_nvme_io": 332, 00:12:18.090 "transports": [ 00:12:18.090 { 00:12:18.090 "trtype": "TCP" 00:12:18.090 } 00:12:18.090 ] 00:12:18.090 } 00:12:18.090 ] 00:12:18.090 }' 00:12:18.090 21:02:14 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:18.090 21:02:14 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:18.090 21:02:14 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:18.090 21:02:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:18.090 21:02:14 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:18.090 21:02:14 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:18.090 21:02:14 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:18.090 21:02:14 -- target/rpc.sh@123 -- # nvmftestfini 00:12:18.090 21:02:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:18.090 21:02:14 -- nvmf/common.sh@116 -- # sync 00:12:18.090 21:02:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:18.090 21:02:14 -- nvmf/common.sh@119 -- # set +e 00:12:18.090 21:02:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:18.090 21:02:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:18.090 rmmod nvme_tcp 00:12:18.090 rmmod nvme_fabrics 00:12:18.090 rmmod nvme_keyring 00:12:18.090 21:02:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:18.090 21:02:14 -- nvmf/common.sh@123 -- # set -e 00:12:18.090 21:02:14 -- nvmf/common.sh@124 -- # return 0 00:12:18.090 21:02:14 -- nvmf/common.sh@477 -- # '[' -n 3930160 ']' 00:12:18.090 21:02:14 -- nvmf/common.sh@478 -- # killprocess 3930160 00:12:18.090 21:02:14 -- common/autotest_common.sh@936 -- # '[' -z 3930160 ']' 00:12:18.090 21:02:14 -- common/autotest_common.sh@940 -- # kill -0 3930160 00:12:18.090 21:02:14 -- common/autotest_common.sh@941 -- # uname 00:12:18.090 21:02:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:18.090 21:02:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3930160 00:12:18.090 21:02:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:18.090 21:02:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:18.090 21:02:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3930160' 00:12:18.090 killing process with pid 3930160 00:12:18.090 21:02:14 -- common/autotest_common.sh@955 -- # kill 3930160 00:12:18.090 21:02:14 -- common/autotest_common.sh@960 -- # wait 3930160 00:12:18.658 21:02:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:18.658 21:02:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:18.658 21:02:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:18.658 21:02:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:18.658 21:02:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:18.658 21:02:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:18.658 21:02:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:18.658 21:02:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:20.562 21:02:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:20.562 00:12:20.562 real 0m26.266s 00:12:20.562 user 1m25.893s 00:12:20.562 sys 0m4.183s 00:12:20.562 21:02:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:20.562 21:02:16 -- common/autotest_common.sh@10 -- # set +x 00:12:20.562 ************************************ 00:12:20.562 END TEST nvmf_rpc 00:12:20.562 ************************************ 00:12:20.562 21:02:16 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:20.562 21:02:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:20.562 21:02:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:20.562 21:02:16 -- common/autotest_common.sh@10 -- # set +x 00:12:20.562 ************************************ 00:12:20.562 START TEST nvmf_invalid 00:12:20.562 ************************************ 00:12:20.562 21:02:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:20.562 * Looking for test storage... 00:12:20.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:20.562 21:02:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:20.562 21:02:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:20.562 21:02:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:20.821 21:02:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:20.821 21:02:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:20.821 21:02:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:20.821 21:02:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:20.821 21:02:16 -- scripts/common.sh@335 -- # IFS=.-: 00:12:20.821 21:02:16 -- scripts/common.sh@335 -- # read -ra ver1 00:12:20.821 21:02:16 -- scripts/common.sh@336 -- # IFS=.-: 00:12:20.821 21:02:16 -- scripts/common.sh@336 -- # read -ra ver2 00:12:20.821 21:02:16 -- scripts/common.sh@337 -- # local 'op=<' 00:12:20.821 21:02:16 -- scripts/common.sh@339 -- # ver1_l=2 00:12:20.821 21:02:16 -- scripts/common.sh@340 -- # ver2_l=1 00:12:20.821 21:02:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:20.821 21:02:16 -- scripts/common.sh@343 -- # case "$op" in 00:12:20.821 21:02:16 -- scripts/common.sh@344 -- # : 1 00:12:20.822 21:02:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:20.822 21:02:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:20.822 21:02:16 -- scripts/common.sh@364 -- # decimal 1 00:12:20.822 21:02:16 -- scripts/common.sh@352 -- # local d=1 00:12:20.822 21:02:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:20.822 21:02:16 -- scripts/common.sh@354 -- # echo 1 00:12:20.822 21:02:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:20.822 21:02:16 -- scripts/common.sh@365 -- # decimal 2 00:12:20.822 21:02:16 -- scripts/common.sh@352 -- # local d=2 00:12:20.822 21:02:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:20.822 21:02:16 -- scripts/common.sh@354 -- # echo 2 00:12:20.822 21:02:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:20.822 21:02:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:20.822 21:02:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:20.822 21:02:16 -- scripts/common.sh@367 -- # return 0 00:12:20.822 21:02:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:20.822 21:02:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:20.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.822 --rc genhtml_branch_coverage=1 00:12:20.822 --rc genhtml_function_coverage=1 00:12:20.822 --rc genhtml_legend=1 00:12:20.822 --rc geninfo_all_blocks=1 00:12:20.822 --rc geninfo_unexecuted_blocks=1 00:12:20.822 00:12:20.822 ' 00:12:20.822 21:02:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:20.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.822 --rc genhtml_branch_coverage=1 00:12:20.822 --rc genhtml_function_coverage=1 00:12:20.822 --rc genhtml_legend=1 00:12:20.822 --rc geninfo_all_blocks=1 00:12:20.822 --rc geninfo_unexecuted_blocks=1 00:12:20.822 00:12:20.822 ' 00:12:20.822 21:02:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:20.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.822 --rc genhtml_branch_coverage=1 00:12:20.822 --rc genhtml_function_coverage=1 00:12:20.822 --rc genhtml_legend=1 00:12:20.822 --rc geninfo_all_blocks=1 00:12:20.822 --rc geninfo_unexecuted_blocks=1 00:12:20.822 00:12:20.822 ' 00:12:20.822 21:02:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:20.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.822 --rc genhtml_branch_coverage=1 00:12:20.822 --rc genhtml_function_coverage=1 00:12:20.822 --rc genhtml_legend=1 00:12:20.822 --rc geninfo_all_blocks=1 00:12:20.822 --rc geninfo_unexecuted_blocks=1 00:12:20.822 00:12:20.822 ' 00:12:20.822 21:02:16 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:20.822 21:02:16 -- nvmf/common.sh@7 -- # uname -s 00:12:20.822 21:02:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:20.822 21:02:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:20.822 21:02:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:20.822 21:02:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:20.822 21:02:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:20.822 21:02:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:20.822 21:02:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:20.822 21:02:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:20.822 21:02:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:20.822 21:02:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:20.822 21:02:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:20.822 21:02:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:20.822 21:02:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:20.822 21:02:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:20.822 21:02:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:20.822 21:02:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:20.822 21:02:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:20.822 21:02:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:20.822 21:02:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:20.822 21:02:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.822 21:02:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.822 21:02:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.822 21:02:16 -- paths/export.sh@5 -- # export PATH 00:12:20.822 21:02:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.822 21:02:16 -- nvmf/common.sh@46 -- # : 0 00:12:20.822 21:02:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:20.822 21:02:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:20.822 21:02:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:20.822 21:02:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:20.822 21:02:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:20.822 21:02:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:20.822 21:02:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:20.822 21:02:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:20.822 21:02:16 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:20.822 21:02:16 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:20.822 21:02:16 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:20.822 21:02:16 -- target/invalid.sh@14 -- # target=foobar 00:12:20.822 21:02:16 -- target/invalid.sh@16 -- # RANDOM=0 00:12:20.822 21:02:16 -- target/invalid.sh@34 -- # nvmftestinit 00:12:20.822 21:02:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:20.822 21:02:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:20.822 21:02:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:20.822 21:02:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:20.822 21:02:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:20.822 21:02:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:20.822 21:02:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:20.822 21:02:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:20.822 21:02:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:20.822 21:02:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:20.822 21:02:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:20.822 21:02:16 -- common/autotest_common.sh@10 -- # set +x 00:12:22.723 21:02:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:22.981 21:02:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:22.981 21:02:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:22.981 21:02:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:22.981 21:02:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:22.981 21:02:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:22.981 21:02:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:22.981 21:02:18 -- nvmf/common.sh@294 -- # net_devs=() 00:12:22.981 21:02:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:22.981 21:02:18 -- nvmf/common.sh@295 -- # e810=() 00:12:22.981 21:02:18 -- nvmf/common.sh@295 -- # local -ga e810 00:12:22.981 21:02:18 -- nvmf/common.sh@296 -- # x722=() 00:12:22.981 21:02:18 -- nvmf/common.sh@296 -- # local -ga x722 00:12:22.981 21:02:18 -- nvmf/common.sh@297 -- # mlx=() 00:12:22.981 21:02:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:22.981 21:02:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:22.981 21:02:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:22.982 21:02:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:22.982 21:02:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:22.982 21:02:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:22.982 21:02:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:22.982 21:02:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:22.982 21:02:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:22.982 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:22.982 21:02:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:22.982 21:02:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:22.982 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:22.982 21:02:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:22.982 21:02:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:22.982 21:02:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:22.982 21:02:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:22.982 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:22.982 21:02:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:22.982 21:02:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:22.982 21:02:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:22.982 21:02:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:22.982 21:02:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:22.982 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:22.982 21:02:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:22.982 21:02:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:22.982 21:02:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:22.982 21:02:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:22.982 21:02:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:22.982 21:02:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:22.982 21:02:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:22.982 21:02:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:22.982 21:02:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:22.982 21:02:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:22.982 21:02:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:22.982 21:02:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:22.982 21:02:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:22.982 21:02:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:22.982 21:02:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:22.982 21:02:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:22.982 21:02:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:22.982 21:02:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:22.982 21:02:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:22.982 21:02:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:22.982 21:02:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:22.982 21:02:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:22.982 21:02:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:22.982 21:02:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:22.982 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:22.982 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.143 ms 00:12:22.982 00:12:22.982 --- 10.0.0.2 ping statistics --- 00:12:22.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:22.982 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:12:22.982 21:02:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:22.982 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:22.982 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:12:22.982 00:12:22.982 --- 10.0.0.1 ping statistics --- 00:12:22.982 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:22.982 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:12:22.982 21:02:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:22.982 21:02:19 -- nvmf/common.sh@410 -- # return 0 00:12:22.982 21:02:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:22.982 21:02:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:22.982 21:02:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:22.982 21:02:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:22.982 21:02:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:22.982 21:02:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:22.982 21:02:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:22.982 21:02:19 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:22.982 21:02:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:22.982 21:02:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:22.982 21:02:19 -- common/autotest_common.sh@10 -- # set +x 00:12:22.982 21:02:19 -- nvmf/common.sh@469 -- # nvmfpid=3934917 00:12:22.982 21:02:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:22.982 21:02:19 -- nvmf/common.sh@470 -- # waitforlisten 3934917 00:12:22.982 21:02:19 -- common/autotest_common.sh@829 -- # '[' -z 3934917 ']' 00:12:22.982 21:02:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:22.982 21:02:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:22.982 21:02:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:22.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:22.982 21:02:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:22.982 21:02:19 -- common/autotest_common.sh@10 -- # set +x 00:12:22.982 [2024-11-27 21:02:19.183647] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:22.982 [2024-11-27 21:02:19.183734] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:22.982 EAL: No free 2048 kB hugepages reported on node 1 00:12:23.240 [2024-11-27 21:02:19.251802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:23.240 [2024-11-27 21:02:19.362438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:23.240 [2024-11-27 21:02:19.362613] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:23.240 [2024-11-27 21:02:19.362632] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:23.240 [2024-11-27 21:02:19.362645] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:23.240 [2024-11-27 21:02:19.362708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:23.240 [2024-11-27 21:02:19.362735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:23.240 [2024-11-27 21:02:19.362862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:23.240 [2024-11-27 21:02:19.362865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:24.172 21:02:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:24.172 21:02:20 -- common/autotest_common.sh@862 -- # return 0 00:12:24.172 21:02:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:24.172 21:02:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:24.172 21:02:20 -- common/autotest_common.sh@10 -- # set +x 00:12:24.172 21:02:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:24.172 21:02:20 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:24.172 21:02:20 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode765 00:12:24.430 [2024-11-27 21:02:20.471029] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:24.430 21:02:20 -- target/invalid.sh@40 -- # out='request: 00:12:24.430 { 00:12:24.430 "nqn": "nqn.2016-06.io.spdk:cnode765", 00:12:24.430 "tgt_name": "foobar", 00:12:24.430 "method": "nvmf_create_subsystem", 00:12:24.430 "req_id": 1 00:12:24.430 } 00:12:24.430 Got JSON-RPC error response 00:12:24.430 response: 00:12:24.430 { 00:12:24.430 "code": -32603, 00:12:24.430 "message": "Unable to find target foobar" 00:12:24.430 }' 00:12:24.430 21:02:20 -- target/invalid.sh@41 -- # [[ request: 00:12:24.430 { 00:12:24.430 "nqn": "nqn.2016-06.io.spdk:cnode765", 00:12:24.430 "tgt_name": "foobar", 00:12:24.430 "method": "nvmf_create_subsystem", 00:12:24.430 "req_id": 1 00:12:24.430 } 00:12:24.430 Got JSON-RPC error response 00:12:24.430 response: 00:12:24.430 { 00:12:24.430 "code": -32603, 00:12:24.430 "message": "Unable to find target foobar" 00:12:24.430 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:24.430 21:02:20 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:24.430 21:02:20 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode15095 00:12:24.687 [2024-11-27 21:02:20.731895] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15095: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:24.687 21:02:20 -- target/invalid.sh@45 -- # out='request: 00:12:24.687 { 00:12:24.687 "nqn": "nqn.2016-06.io.spdk:cnode15095", 00:12:24.687 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:24.687 "method": "nvmf_create_subsystem", 00:12:24.687 "req_id": 1 00:12:24.687 } 00:12:24.687 Got JSON-RPC error response 00:12:24.687 response: 00:12:24.687 { 00:12:24.687 "code": -32602, 00:12:24.687 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:24.687 }' 00:12:24.687 21:02:20 -- target/invalid.sh@46 -- # [[ request: 00:12:24.687 { 00:12:24.687 "nqn": "nqn.2016-06.io.spdk:cnode15095", 00:12:24.687 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:24.687 "method": "nvmf_create_subsystem", 00:12:24.687 "req_id": 1 00:12:24.687 } 00:12:24.687 Got JSON-RPC error response 00:12:24.687 response: 00:12:24.687 { 00:12:24.687 "code": -32602, 00:12:24.687 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:24.687 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:24.687 21:02:20 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:24.687 21:02:20 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode7875 00:12:24.946 [2024-11-27 21:02:20.976672] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7875: invalid model number 'SPDK_Controller' 00:12:24.946 21:02:20 -- target/invalid.sh@50 -- # out='request: 00:12:24.946 { 00:12:24.946 "nqn": "nqn.2016-06.io.spdk:cnode7875", 00:12:24.946 "model_number": "SPDK_Controller\u001f", 00:12:24.946 "method": "nvmf_create_subsystem", 00:12:24.946 "req_id": 1 00:12:24.946 } 00:12:24.946 Got JSON-RPC error response 00:12:24.946 response: 00:12:24.946 { 00:12:24.946 "code": -32602, 00:12:24.946 "message": "Invalid MN SPDK_Controller\u001f" 00:12:24.946 }' 00:12:24.946 21:02:20 -- target/invalid.sh@51 -- # [[ request: 00:12:24.946 { 00:12:24.946 "nqn": "nqn.2016-06.io.spdk:cnode7875", 00:12:24.946 "model_number": "SPDK_Controller\u001f", 00:12:24.946 "method": "nvmf_create_subsystem", 00:12:24.946 "req_id": 1 00:12:24.946 } 00:12:24.946 Got JSON-RPC error response 00:12:24.946 response: 00:12:24.946 { 00:12:24.946 "code": -32602, 00:12:24.946 "message": "Invalid MN SPDK_Controller\u001f" 00:12:24.946 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:24.946 21:02:20 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:24.946 21:02:20 -- target/invalid.sh@19 -- # local length=21 ll 00:12:24.946 21:02:20 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:24.946 21:02:20 -- target/invalid.sh@21 -- # local chars 00:12:24.946 21:02:20 -- target/invalid.sh@22 -- # local string 00:12:24.946 21:02:20 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:24.946 21:02:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 96 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+='`' 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 80 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=P 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 68 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=D 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 61 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+== 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 113 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=q 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 122 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=z 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 46 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=. 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 80 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=P 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 110 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=n 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 38 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+='&' 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 60 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+='<' 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 119 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=w 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 93 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=']' 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 46 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # string+=. 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.946 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # printf %x 103 00:12:24.946 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=g 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 117 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=u 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 58 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=: 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 67 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=C 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 69 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=E 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 124 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+='|' 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # printf %x 121 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:24.947 21:02:21 -- target/invalid.sh@25 -- # string+=y 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:24.947 21:02:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:24.947 21:02:21 -- target/invalid.sh@28 -- # [[ ` == \- ]] 00:12:24.947 21:02:21 -- target/invalid.sh@31 -- # echo '`PD=qz.Pn& /dev/null' 00:12:28.040 21:02:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.578 21:02:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:30.578 00:12:30.578 real 0m9.592s 00:12:30.578 user 0m23.450s 00:12:30.578 sys 0m2.464s 00:12:30.578 21:02:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:30.578 21:02:26 -- common/autotest_common.sh@10 -- # set +x 00:12:30.578 ************************************ 00:12:30.578 END TEST nvmf_invalid 00:12:30.578 ************************************ 00:12:30.578 21:02:26 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:30.578 21:02:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:30.578 21:02:26 -- common/autotest_common.sh@10 -- # set +x 00:12:30.578 ************************************ 00:12:30.578 START TEST nvmf_abort 00:12:30.578 ************************************ 00:12:30.578 21:02:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:30.578 * Looking for test storage... 00:12:30.578 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:30.578 21:02:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:30.578 21:02:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:30.578 21:02:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:30.578 21:02:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:30.578 21:02:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:30.578 21:02:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:30.578 21:02:26 -- scripts/common.sh@335 -- # IFS=.-: 00:12:30.578 21:02:26 -- scripts/common.sh@335 -- # read -ra ver1 00:12:30.578 21:02:26 -- scripts/common.sh@336 -- # IFS=.-: 00:12:30.578 21:02:26 -- scripts/common.sh@336 -- # read -ra ver2 00:12:30.578 21:02:26 -- scripts/common.sh@337 -- # local 'op=<' 00:12:30.578 21:02:26 -- scripts/common.sh@339 -- # ver1_l=2 00:12:30.578 21:02:26 -- scripts/common.sh@340 -- # ver2_l=1 00:12:30.578 21:02:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:30.578 21:02:26 -- scripts/common.sh@343 -- # case "$op" in 00:12:30.578 21:02:26 -- scripts/common.sh@344 -- # : 1 00:12:30.578 21:02:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:30.578 21:02:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:30.578 21:02:26 -- scripts/common.sh@364 -- # decimal 1 00:12:30.578 21:02:26 -- scripts/common.sh@352 -- # local d=1 00:12:30.578 21:02:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:30.578 21:02:26 -- scripts/common.sh@354 -- # echo 1 00:12:30.578 21:02:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:30.578 21:02:26 -- scripts/common.sh@365 -- # decimal 2 00:12:30.578 21:02:26 -- scripts/common.sh@352 -- # local d=2 00:12:30.578 21:02:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:30.578 21:02:26 -- scripts/common.sh@354 -- # echo 2 00:12:30.578 21:02:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:30.578 21:02:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:30.578 21:02:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:30.578 21:02:26 -- scripts/common.sh@367 -- # return 0 00:12:30.578 21:02:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:30.578 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.578 --rc genhtml_branch_coverage=1 00:12:30.578 --rc genhtml_function_coverage=1 00:12:30.578 --rc genhtml_legend=1 00:12:30.578 --rc geninfo_all_blocks=1 00:12:30.578 --rc geninfo_unexecuted_blocks=1 00:12:30.578 00:12:30.578 ' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:30.578 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.578 --rc genhtml_branch_coverage=1 00:12:30.578 --rc genhtml_function_coverage=1 00:12:30.578 --rc genhtml_legend=1 00:12:30.578 --rc geninfo_all_blocks=1 00:12:30.578 --rc geninfo_unexecuted_blocks=1 00:12:30.578 00:12:30.578 ' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:30.578 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.578 --rc genhtml_branch_coverage=1 00:12:30.578 --rc genhtml_function_coverage=1 00:12:30.578 --rc genhtml_legend=1 00:12:30.578 --rc geninfo_all_blocks=1 00:12:30.578 --rc geninfo_unexecuted_blocks=1 00:12:30.578 00:12:30.578 ' 00:12:30.578 21:02:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:30.578 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.578 --rc genhtml_branch_coverage=1 00:12:30.578 --rc genhtml_function_coverage=1 00:12:30.578 --rc genhtml_legend=1 00:12:30.578 --rc geninfo_all_blocks=1 00:12:30.578 --rc geninfo_unexecuted_blocks=1 00:12:30.578 00:12:30.578 ' 00:12:30.578 21:02:26 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:30.578 21:02:26 -- nvmf/common.sh@7 -- # uname -s 00:12:30.578 21:02:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:30.578 21:02:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:30.578 21:02:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:30.578 21:02:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:30.578 21:02:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:30.578 21:02:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:30.578 21:02:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:30.578 21:02:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:30.578 21:02:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:30.578 21:02:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:30.578 21:02:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.578 21:02:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.578 21:02:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:30.578 21:02:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:30.578 21:02:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:30.578 21:02:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:30.578 21:02:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:30.578 21:02:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:30.578 21:02:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:30.578 21:02:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.578 21:02:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.578 21:02:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.578 21:02:26 -- paths/export.sh@5 -- # export PATH 00:12:30.579 21:02:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.579 21:02:26 -- nvmf/common.sh@46 -- # : 0 00:12:30.579 21:02:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:30.579 21:02:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:30.579 21:02:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:30.579 21:02:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:30.579 21:02:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:30.579 21:02:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:30.579 21:02:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:30.579 21:02:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:30.579 21:02:26 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:30.579 21:02:26 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:30.579 21:02:26 -- target/abort.sh@14 -- # nvmftestinit 00:12:30.579 21:02:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:30.579 21:02:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:30.579 21:02:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:30.579 21:02:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:30.579 21:02:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:30.579 21:02:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.579 21:02:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.579 21:02:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.579 21:02:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:30.579 21:02:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:30.579 21:02:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:30.579 21:02:26 -- common/autotest_common.sh@10 -- # set +x 00:12:32.481 21:02:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:32.481 21:02:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:32.481 21:02:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:32.481 21:02:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:32.481 21:02:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:32.481 21:02:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:32.481 21:02:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:32.481 21:02:28 -- nvmf/common.sh@294 -- # net_devs=() 00:12:32.481 21:02:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:32.481 21:02:28 -- nvmf/common.sh@295 -- # e810=() 00:12:32.481 21:02:28 -- nvmf/common.sh@295 -- # local -ga e810 00:12:32.481 21:02:28 -- nvmf/common.sh@296 -- # x722=() 00:12:32.481 21:02:28 -- nvmf/common.sh@296 -- # local -ga x722 00:12:32.481 21:02:28 -- nvmf/common.sh@297 -- # mlx=() 00:12:32.481 21:02:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:32.481 21:02:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:32.481 21:02:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:32.481 21:02:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:32.481 21:02:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:32.481 21:02:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.481 21:02:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:32.481 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:32.481 21:02:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:32.481 21:02:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:32.481 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:32.481 21:02:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:32.481 21:02:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:32.481 21:02:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.481 21:02:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.481 21:02:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.481 21:02:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.481 21:02:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:32.481 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:32.481 21:02:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.481 21:02:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:32.481 21:02:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.481 21:02:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:32.481 21:02:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.481 21:02:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:32.481 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:32.481 21:02:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.481 21:02:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:32.481 21:02:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:32.481 21:02:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:32.482 21:02:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:32.482 21:02:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:32.482 21:02:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:32.482 21:02:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:32.482 21:02:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:32.482 21:02:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:32.482 21:02:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:32.482 21:02:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:32.482 21:02:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:32.482 21:02:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:32.482 21:02:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:32.482 21:02:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:32.482 21:02:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:32.482 21:02:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:32.482 21:02:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:32.482 21:02:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:32.482 21:02:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:32.482 21:02:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:32.482 21:02:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:32.482 21:02:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:32.482 21:02:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:32.482 21:02:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:32.482 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:32.482 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:12:32.482 00:12:32.482 --- 10.0.0.2 ping statistics --- 00:12:32.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.482 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:12:32.482 21:02:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:32.482 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:32.482 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:12:32.482 00:12:32.482 --- 10.0.0.1 ping statistics --- 00:12:32.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:32.482 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:12:32.482 21:02:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:32.482 21:02:28 -- nvmf/common.sh@410 -- # return 0 00:12:32.482 21:02:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:32.482 21:02:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:32.482 21:02:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:32.482 21:02:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:32.482 21:02:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:32.482 21:02:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:32.482 21:02:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:32.482 21:02:28 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:32.482 21:02:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:32.482 21:02:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:32.482 21:02:28 -- common/autotest_common.sh@10 -- # set +x 00:12:32.482 21:02:28 -- nvmf/common.sh@469 -- # nvmfpid=3937687 00:12:32.482 21:02:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:32.482 21:02:28 -- nvmf/common.sh@470 -- # waitforlisten 3937687 00:12:32.482 21:02:28 -- common/autotest_common.sh@829 -- # '[' -z 3937687 ']' 00:12:32.482 21:02:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:32.482 21:02:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:32.482 21:02:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:32.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:32.482 21:02:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:32.482 21:02:28 -- common/autotest_common.sh@10 -- # set +x 00:12:32.741 [2024-11-27 21:02:28.743507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:32.741 [2024-11-27 21:02:28.743651] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:32.741 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.741 [2024-11-27 21:02:28.812544] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:32.741 [2024-11-27 21:02:28.930589] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:32.741 [2024-11-27 21:02:28.930756] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:32.741 [2024-11-27 21:02:28.930784] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:32.741 [2024-11-27 21:02:28.930799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:32.741 [2024-11-27 21:02:28.930892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:32.741 [2024-11-27 21:02:28.930952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:32.741 [2024-11-27 21:02:28.930956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:33.674 21:02:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:33.674 21:02:29 -- common/autotest_common.sh@862 -- # return 0 00:12:33.674 21:02:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:33.674 21:02:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 21:02:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:33.674 21:02:29 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 [2024-11-27 21:02:29.753961] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 Malloc0 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 Delay0 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 [2024-11-27 21:02:29.826187] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:33.674 21:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.674 21:02:29 -- common/autotest_common.sh@10 -- # set +x 00:12:33.674 21:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.674 21:02:29 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:33.674 EAL: No free 2048 kB hugepages reported on node 1 00:12:33.961 [2024-11-27 21:02:29.931494] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:35.913 Initializing NVMe Controllers 00:12:35.913 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:35.913 controller IO queue size 128 less than required 00:12:35.913 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:35.913 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:35.913 Initialization complete. Launching workers. 00:12:35.913 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34522 00:12:35.913 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34583, failed to submit 62 00:12:35.913 success 34522, unsuccess 61, failed 0 00:12:35.913 21:02:32 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:35.913 21:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:35.913 21:02:32 -- common/autotest_common.sh@10 -- # set +x 00:12:35.913 21:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:35.913 21:02:32 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:35.913 21:02:32 -- target/abort.sh@38 -- # nvmftestfini 00:12:35.913 21:02:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:35.913 21:02:32 -- nvmf/common.sh@116 -- # sync 00:12:35.913 21:02:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:35.913 21:02:32 -- nvmf/common.sh@119 -- # set +e 00:12:35.913 21:02:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:35.913 21:02:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:35.913 rmmod nvme_tcp 00:12:35.913 rmmod nvme_fabrics 00:12:35.913 rmmod nvme_keyring 00:12:35.913 21:02:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:35.913 21:02:32 -- nvmf/common.sh@123 -- # set -e 00:12:35.913 21:02:32 -- nvmf/common.sh@124 -- # return 0 00:12:35.913 21:02:32 -- nvmf/common.sh@477 -- # '[' -n 3937687 ']' 00:12:35.913 21:02:32 -- nvmf/common.sh@478 -- # killprocess 3937687 00:12:35.913 21:02:32 -- common/autotest_common.sh@936 -- # '[' -z 3937687 ']' 00:12:35.913 21:02:32 -- common/autotest_common.sh@940 -- # kill -0 3937687 00:12:35.913 21:02:32 -- common/autotest_common.sh@941 -- # uname 00:12:35.913 21:02:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:35.913 21:02:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3937687 00:12:36.170 21:02:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:36.170 21:02:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:36.170 21:02:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3937687' 00:12:36.170 killing process with pid 3937687 00:12:36.170 21:02:32 -- common/autotest_common.sh@955 -- # kill 3937687 00:12:36.170 21:02:32 -- common/autotest_common.sh@960 -- # wait 3937687 00:12:36.428 21:02:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:36.428 21:02:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:36.428 21:02:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:36.428 21:02:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:36.428 21:02:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:36.428 21:02:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:36.428 21:02:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:36.428 21:02:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:38.329 21:02:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:38.329 00:12:38.329 real 0m8.233s 00:12:38.329 user 0m13.213s 00:12:38.329 sys 0m2.678s 00:12:38.329 21:02:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:38.329 21:02:34 -- common/autotest_common.sh@10 -- # set +x 00:12:38.329 ************************************ 00:12:38.329 END TEST nvmf_abort 00:12:38.329 ************************************ 00:12:38.329 21:02:34 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:38.329 21:02:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:38.329 21:02:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:38.329 21:02:34 -- common/autotest_common.sh@10 -- # set +x 00:12:38.588 ************************************ 00:12:38.588 START TEST nvmf_ns_hotplug_stress 00:12:38.588 ************************************ 00:12:38.588 21:02:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:38.588 * Looking for test storage... 00:12:38.588 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:38.588 21:02:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:38.588 21:02:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:38.588 21:02:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:38.588 21:02:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:38.588 21:02:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:38.588 21:02:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:38.588 21:02:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:38.588 21:02:34 -- scripts/common.sh@335 -- # IFS=.-: 00:12:38.588 21:02:34 -- scripts/common.sh@335 -- # read -ra ver1 00:12:38.588 21:02:34 -- scripts/common.sh@336 -- # IFS=.-: 00:12:38.588 21:02:34 -- scripts/common.sh@336 -- # read -ra ver2 00:12:38.588 21:02:34 -- scripts/common.sh@337 -- # local 'op=<' 00:12:38.588 21:02:34 -- scripts/common.sh@339 -- # ver1_l=2 00:12:38.588 21:02:34 -- scripts/common.sh@340 -- # ver2_l=1 00:12:38.588 21:02:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:38.588 21:02:34 -- scripts/common.sh@343 -- # case "$op" in 00:12:38.588 21:02:34 -- scripts/common.sh@344 -- # : 1 00:12:38.588 21:02:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:38.588 21:02:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:38.588 21:02:34 -- scripts/common.sh@364 -- # decimal 1 00:12:38.588 21:02:34 -- scripts/common.sh@352 -- # local d=1 00:12:38.588 21:02:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:38.588 21:02:34 -- scripts/common.sh@354 -- # echo 1 00:12:38.588 21:02:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:38.588 21:02:34 -- scripts/common.sh@365 -- # decimal 2 00:12:38.588 21:02:34 -- scripts/common.sh@352 -- # local d=2 00:12:38.588 21:02:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:38.588 21:02:34 -- scripts/common.sh@354 -- # echo 2 00:12:38.588 21:02:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:38.588 21:02:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:38.588 21:02:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:38.588 21:02:34 -- scripts/common.sh@367 -- # return 0 00:12:38.588 21:02:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:38.588 21:02:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:38.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:38.588 --rc genhtml_branch_coverage=1 00:12:38.588 --rc genhtml_function_coverage=1 00:12:38.588 --rc genhtml_legend=1 00:12:38.588 --rc geninfo_all_blocks=1 00:12:38.588 --rc geninfo_unexecuted_blocks=1 00:12:38.588 00:12:38.588 ' 00:12:38.588 21:02:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:38.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:38.588 --rc genhtml_branch_coverage=1 00:12:38.588 --rc genhtml_function_coverage=1 00:12:38.588 --rc genhtml_legend=1 00:12:38.588 --rc geninfo_all_blocks=1 00:12:38.588 --rc geninfo_unexecuted_blocks=1 00:12:38.588 00:12:38.588 ' 00:12:38.588 21:02:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:38.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:38.588 --rc genhtml_branch_coverage=1 00:12:38.588 --rc genhtml_function_coverage=1 00:12:38.588 --rc genhtml_legend=1 00:12:38.588 --rc geninfo_all_blocks=1 00:12:38.588 --rc geninfo_unexecuted_blocks=1 00:12:38.588 00:12:38.588 ' 00:12:38.588 21:02:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:38.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:38.588 --rc genhtml_branch_coverage=1 00:12:38.588 --rc genhtml_function_coverage=1 00:12:38.588 --rc genhtml_legend=1 00:12:38.588 --rc geninfo_all_blocks=1 00:12:38.588 --rc geninfo_unexecuted_blocks=1 00:12:38.588 00:12:38.588 ' 00:12:38.588 21:02:34 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:38.588 21:02:34 -- nvmf/common.sh@7 -- # uname -s 00:12:38.588 21:02:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:38.588 21:02:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:38.589 21:02:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:38.589 21:02:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:38.589 21:02:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:38.589 21:02:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:38.589 21:02:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:38.589 21:02:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:38.589 21:02:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:38.589 21:02:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:38.589 21:02:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:38.589 21:02:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:38.589 21:02:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:38.589 21:02:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:38.589 21:02:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:38.589 21:02:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:38.589 21:02:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:38.589 21:02:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:38.589 21:02:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:38.589 21:02:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:38.589 21:02:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:38.589 21:02:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:38.589 21:02:34 -- paths/export.sh@5 -- # export PATH 00:12:38.589 21:02:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:38.589 21:02:34 -- nvmf/common.sh@46 -- # : 0 00:12:38.589 21:02:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:38.589 21:02:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:38.589 21:02:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:38.589 21:02:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:38.589 21:02:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:38.589 21:02:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:38.589 21:02:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:38.589 21:02:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:38.589 21:02:34 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:38.589 21:02:34 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:38.589 21:02:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:38.589 21:02:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:38.589 21:02:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:38.589 21:02:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:38.589 21:02:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:38.589 21:02:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:38.589 21:02:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:38.589 21:02:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:38.589 21:02:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:38.589 21:02:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:38.589 21:02:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:38.589 21:02:34 -- common/autotest_common.sh@10 -- # set +x 00:12:41.124 21:02:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:41.124 21:02:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:41.124 21:02:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:41.124 21:02:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:41.124 21:02:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:41.124 21:02:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:41.124 21:02:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:41.124 21:02:36 -- nvmf/common.sh@294 -- # net_devs=() 00:12:41.124 21:02:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:41.124 21:02:36 -- nvmf/common.sh@295 -- # e810=() 00:12:41.124 21:02:36 -- nvmf/common.sh@295 -- # local -ga e810 00:12:41.124 21:02:36 -- nvmf/common.sh@296 -- # x722=() 00:12:41.124 21:02:36 -- nvmf/common.sh@296 -- # local -ga x722 00:12:41.124 21:02:36 -- nvmf/common.sh@297 -- # mlx=() 00:12:41.124 21:02:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:41.124 21:02:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:41.124 21:02:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:41.124 21:02:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:41.124 21:02:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:41.124 21:02:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:41.124 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:41.124 21:02:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:41.124 21:02:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:41.124 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:41.124 21:02:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:41.124 21:02:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:41.124 21:02:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:41.124 21:02:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:41.124 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:41.124 21:02:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:41.124 21:02:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:41.124 21:02:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:41.124 21:02:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:41.124 21:02:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:41.124 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:41.124 21:02:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:41.124 21:02:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:41.124 21:02:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:41.124 21:02:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:41.124 21:02:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:41.124 21:02:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:41.124 21:02:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:41.124 21:02:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:41.124 21:02:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:41.124 21:02:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:41.124 21:02:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:41.124 21:02:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:41.124 21:02:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:41.124 21:02:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:41.125 21:02:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:41.125 21:02:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:41.125 21:02:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:41.125 21:02:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:41.125 21:02:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:41.125 21:02:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:41.125 21:02:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:41.125 21:02:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:41.125 21:02:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:41.125 21:02:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:41.125 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:41.125 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:12:41.125 00:12:41.125 --- 10.0.0.2 ping statistics --- 00:12:41.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:41.125 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:12:41.125 21:02:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:41.125 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:41.125 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:12:41.125 00:12:41.125 --- 10.0.0.1 ping statistics --- 00:12:41.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:41.125 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:12:41.125 21:02:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:41.125 21:02:37 -- nvmf/common.sh@410 -- # return 0 00:12:41.125 21:02:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:41.125 21:02:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:41.125 21:02:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:41.125 21:02:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:41.125 21:02:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:41.125 21:02:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:41.125 21:02:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:41.125 21:02:37 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:41.125 21:02:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:41.125 21:02:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:41.125 21:02:37 -- common/autotest_common.sh@10 -- # set +x 00:12:41.125 21:02:37 -- nvmf/common.sh@469 -- # nvmfpid=3940076 00:12:41.125 21:02:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:41.125 21:02:37 -- nvmf/common.sh@470 -- # waitforlisten 3940076 00:12:41.125 21:02:37 -- common/autotest_common.sh@829 -- # '[' -z 3940076 ']' 00:12:41.125 21:02:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:41.125 21:02:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:41.125 21:02:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:41.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:41.125 21:02:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:41.125 21:02:37 -- common/autotest_common.sh@10 -- # set +x 00:12:41.125 [2024-11-27 21:02:37.071980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:41.125 [2024-11-27 21:02:37.072050] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:41.125 EAL: No free 2048 kB hugepages reported on node 1 00:12:41.125 [2024-11-27 21:02:37.140191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:41.125 [2024-11-27 21:02:37.264420] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:41.125 [2024-11-27 21:02:37.264613] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:41.125 [2024-11-27 21:02:37.264635] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:41.125 [2024-11-27 21:02:37.264649] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:41.125 [2024-11-27 21:02:37.264715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:41.125 [2024-11-27 21:02:37.264772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:41.125 [2024-11-27 21:02:37.264776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:42.059 21:02:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:42.059 21:02:38 -- common/autotest_common.sh@862 -- # return 0 00:12:42.059 21:02:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:42.059 21:02:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:42.059 21:02:38 -- common/autotest_common.sh@10 -- # set +x 00:12:42.059 21:02:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:42.059 21:02:38 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:42.059 21:02:38 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:42.317 [2024-11-27 21:02:38.389518] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:42.317 21:02:38 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:42.575 21:02:38 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:42.833 [2024-11-27 21:02:38.896593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:42.833 21:02:38 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:43.090 21:02:39 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:43.348 Malloc0 00:12:43.348 21:02:39 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:43.606 Delay0 00:12:43.606 21:02:39 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.864 21:02:39 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:44.122 NULL1 00:12:44.122 21:02:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:44.380 21:02:40 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3940512 00:12:44.380 21:02:40 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:44.380 21:02:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:44.380 21:02:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.381 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.639 21:02:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.897 21:02:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:44.897 21:02:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:45.154 true 00:12:45.154 21:02:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:45.154 21:02:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.412 21:02:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.670 21:02:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:45.670 21:02:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:45.928 true 00:12:45.928 21:02:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:45.928 21:02:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.864 Read completed with error (sct=0, sc=11) 00:12:46.864 21:02:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.864 21:02:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:46.864 21:02:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:47.122 true 00:12:47.122 21:02:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:47.122 21:02:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.379 21:02:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.637 21:02:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:47.637 21:02:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:47.895 true 00:12:47.895 21:02:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:47.895 21:02:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.827 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.827 21:02:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.827 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.827 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.084 21:02:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:49.084 21:02:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:49.342 true 00:12:49.342 21:02:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:49.342 21:02:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.600 21:02:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.857 21:02:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:49.857 21:02:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:50.115 true 00:12:50.115 21:02:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:50.115 21:02:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.047 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.047 21:02:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.047 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.304 21:02:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:51.304 21:02:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:51.563 true 00:12:51.563 21:02:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:51.563 21:02:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.820 21:02:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.077 21:02:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:52.077 21:02:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:52.334 true 00:12:52.334 21:02:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:52.334 21:02:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.266 21:02:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:53.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:53.524 21:02:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:53.524 21:02:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:53.781 true 00:12:53.781 21:02:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:53.781 21:02:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.039 21:02:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.297 21:02:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:54.297 21:02:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:54.555 true 00:12:54.555 21:02:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:54.555 21:02:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.487 21:02:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.745 21:02:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:55.745 21:02:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:56.003 true 00:12:56.003 21:02:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:56.003 21:02:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.261 21:02:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.519 21:02:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:56.519 21:02:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:56.777 true 00:12:56.777 21:02:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:56.777 21:02:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.035 21:02:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.293 21:02:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:57.293 21:02:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:57.551 true 00:12:57.551 21:02:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:57.551 21:02:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.485 21:02:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.485 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.743 21:02:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:58.743 21:02:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:59.000 true 00:12:59.000 21:02:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:59.000 21:02:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.257 21:02:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.515 21:02:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:59.515 21:02:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:59.772 true 00:12:59.772 21:02:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:12:59.772 21:02:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.704 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.704 21:02:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.961 21:02:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:00.961 21:02:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:01.219 true 00:13:01.219 21:02:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:01.219 21:02:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.476 21:02:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.733 21:02:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:01.733 21:02:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:01.733 true 00:13:01.733 21:02:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:01.733 21:02:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.991 21:02:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.249 21:02:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:02.249 21:02:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:02.507 true 00:13:02.507 21:02:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:02.507 21:02:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.881 21:02:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.881 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.881 21:03:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:03.881 21:03:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:04.139 true 00:13:04.139 21:03:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:04.139 21:03:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.397 21:03:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.655 21:03:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:04.655 21:03:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:04.913 true 00:13:05.171 21:03:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:05.171 21:03:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.429 21:03:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.687 21:03:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:05.687 21:03:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:05.947 true 00:13:05.947 21:03:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:05.947 21:03:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.589 21:03:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.846 21:03:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:06.846 21:03:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:07.104 true 00:13:07.104 21:03:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:07.104 21:03:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.363 21:03:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.621 21:03:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:07.621 21:03:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:07.879 true 00:13:07.879 21:03:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:07.879 21:03:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.811 21:03:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.811 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.069 21:03:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:09.069 21:03:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:09.327 true 00:13:09.327 21:03:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:09.327 21:03:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.584 21:03:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.841 21:03:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:09.841 21:03:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:10.098 true 00:13:10.098 21:03:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:10.098 21:03:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.030 21:03:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.030 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.030 21:03:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:11.030 21:03:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:11.288 true 00:13:11.288 21:03:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:11.288 21:03:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.545 21:03:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.803 21:03:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:11.803 21:03:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:12.060 true 00:13:12.060 21:03:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:12.060 21:03:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.318 21:03:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.576 21:03:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:12.576 21:03:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:12.833 true 00:13:12.833 21:03:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:12.833 21:03:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.215 21:03:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.215 21:03:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:14.215 21:03:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:14.473 true 00:13:14.473 21:03:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:14.473 21:03:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.730 21:03:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.730 Initializing NVMe Controllers 00:13:14.730 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:14.730 Controller IO queue size 128, less than required. 00:13:14.730 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:14.730 Controller IO queue size 128, less than required. 00:13:14.730 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:14.730 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:14.730 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:14.730 Initialization complete. Launching workers. 00:13:14.730 ======================================================== 00:13:14.730 Latency(us) 00:13:14.730 Device Information : IOPS MiB/s Average min max 00:13:14.730 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 531.38 0.26 106878.37 1961.24 1012552.59 00:13:14.730 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 9219.08 4.50 13843.40 1938.36 362754.04 00:13:14.730 ======================================================== 00:13:14.730 Total : 9750.47 4.76 18913.66 1938.36 1012552.59 00:13:14.730 00:13:14.988 21:03:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:14.989 21:03:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:15.246 true 00:13:15.246 21:03:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3940512 00:13:15.246 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3940512) - No such process 00:13:15.246 21:03:11 -- target/ns_hotplug_stress.sh@53 -- # wait 3940512 00:13:15.246 21:03:11 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.504 21:03:11 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.761 21:03:11 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:15.761 21:03:11 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:15.761 21:03:11 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:15.761 21:03:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:15.761 21:03:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:16.019 null0 00:13:16.019 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:16.019 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:16.019 21:03:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:16.277 null1 00:13:16.277 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:16.277 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:16.277 21:03:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:16.535 null2 00:13:16.535 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:16.535 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:16.535 21:03:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:16.792 null3 00:13:16.793 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:16.793 21:03:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:16.793 21:03:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:17.050 null4 00:13:17.050 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.050 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.050 21:03:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:17.308 null5 00:13:17.308 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.308 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.308 21:03:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:17.565 null6 00:13:17.565 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.565 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.565 21:03:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:17.823 null7 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.823 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@66 -- # wait 3945298 3945299 3945301 3945303 3945305 3945307 3945309 3945311 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.824 21:03:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:18.082 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.340 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.598 21:03:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.856 21:03:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.115 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.372 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.373 21:03:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.631 21:03:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.889 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.147 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.406 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.664 21:03:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.922 21:03:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.180 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.438 21:03:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.696 21:03:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.955 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.214 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.473 21:03:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.731 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.732 21:03:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.990 21:03:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:23.247 21:03:19 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:23.247 21:03:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:23.247 21:03:19 -- nvmf/common.sh@116 -- # sync 00:13:23.247 21:03:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:23.247 21:03:19 -- nvmf/common.sh@119 -- # set +e 00:13:23.247 21:03:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:23.247 21:03:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:23.247 rmmod nvme_tcp 00:13:23.503 rmmod nvme_fabrics 00:13:23.503 rmmod nvme_keyring 00:13:23.503 21:03:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:23.503 21:03:19 -- nvmf/common.sh@123 -- # set -e 00:13:23.503 21:03:19 -- nvmf/common.sh@124 -- # return 0 00:13:23.503 21:03:19 -- nvmf/common.sh@477 -- # '[' -n 3940076 ']' 00:13:23.503 21:03:19 -- nvmf/common.sh@478 -- # killprocess 3940076 00:13:23.503 21:03:19 -- common/autotest_common.sh@936 -- # '[' -z 3940076 ']' 00:13:23.503 21:03:19 -- common/autotest_common.sh@940 -- # kill -0 3940076 00:13:23.503 21:03:19 -- common/autotest_common.sh@941 -- # uname 00:13:23.503 21:03:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:23.503 21:03:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3940076 00:13:23.503 21:03:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:23.503 21:03:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:23.503 21:03:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3940076' 00:13:23.503 killing process with pid 3940076 00:13:23.503 21:03:19 -- common/autotest_common.sh@955 -- # kill 3940076 00:13:23.503 21:03:19 -- common/autotest_common.sh@960 -- # wait 3940076 00:13:23.761 21:03:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:23.761 21:03:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:23.761 21:03:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:23.761 21:03:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:23.761 21:03:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:23.761 21:03:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.761 21:03:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.761 21:03:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:25.666 21:03:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:25.666 00:13:25.666 real 0m47.319s 00:13:25.666 user 3m33.908s 00:13:25.666 sys 0m16.542s 00:13:25.666 21:03:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:25.666 21:03:21 -- common/autotest_common.sh@10 -- # set +x 00:13:25.666 ************************************ 00:13:25.666 END TEST nvmf_ns_hotplug_stress 00:13:25.666 ************************************ 00:13:25.924 21:03:21 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:25.924 21:03:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:25.924 21:03:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:25.924 21:03:21 -- common/autotest_common.sh@10 -- # set +x 00:13:25.924 ************************************ 00:13:25.924 START TEST nvmf_connect_stress 00:13:25.924 ************************************ 00:13:25.924 21:03:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:25.924 * Looking for test storage... 00:13:25.924 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:25.924 21:03:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:25.924 21:03:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:25.924 21:03:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:25.924 21:03:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:25.924 21:03:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:25.924 21:03:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:25.924 21:03:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:25.924 21:03:22 -- scripts/common.sh@335 -- # IFS=.-: 00:13:25.924 21:03:22 -- scripts/common.sh@335 -- # read -ra ver1 00:13:25.924 21:03:22 -- scripts/common.sh@336 -- # IFS=.-: 00:13:25.924 21:03:22 -- scripts/common.sh@336 -- # read -ra ver2 00:13:25.924 21:03:22 -- scripts/common.sh@337 -- # local 'op=<' 00:13:25.924 21:03:22 -- scripts/common.sh@339 -- # ver1_l=2 00:13:25.924 21:03:22 -- scripts/common.sh@340 -- # ver2_l=1 00:13:25.924 21:03:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:25.924 21:03:22 -- scripts/common.sh@343 -- # case "$op" in 00:13:25.924 21:03:22 -- scripts/common.sh@344 -- # : 1 00:13:25.924 21:03:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:25.924 21:03:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:25.924 21:03:22 -- scripts/common.sh@364 -- # decimal 1 00:13:25.924 21:03:22 -- scripts/common.sh@352 -- # local d=1 00:13:25.924 21:03:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:25.924 21:03:22 -- scripts/common.sh@354 -- # echo 1 00:13:25.924 21:03:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:25.924 21:03:22 -- scripts/common.sh@365 -- # decimal 2 00:13:25.924 21:03:22 -- scripts/common.sh@352 -- # local d=2 00:13:25.924 21:03:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:25.924 21:03:22 -- scripts/common.sh@354 -- # echo 2 00:13:25.924 21:03:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:25.925 21:03:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:25.925 21:03:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:25.925 21:03:22 -- scripts/common.sh@367 -- # return 0 00:13:25.925 21:03:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:25.925 21:03:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:25.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.925 --rc genhtml_branch_coverage=1 00:13:25.925 --rc genhtml_function_coverage=1 00:13:25.925 --rc genhtml_legend=1 00:13:25.925 --rc geninfo_all_blocks=1 00:13:25.925 --rc geninfo_unexecuted_blocks=1 00:13:25.925 00:13:25.925 ' 00:13:25.925 21:03:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:25.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.925 --rc genhtml_branch_coverage=1 00:13:25.925 --rc genhtml_function_coverage=1 00:13:25.925 --rc genhtml_legend=1 00:13:25.925 --rc geninfo_all_blocks=1 00:13:25.925 --rc geninfo_unexecuted_blocks=1 00:13:25.925 00:13:25.925 ' 00:13:25.925 21:03:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:25.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.925 --rc genhtml_branch_coverage=1 00:13:25.925 --rc genhtml_function_coverage=1 00:13:25.925 --rc genhtml_legend=1 00:13:25.925 --rc geninfo_all_blocks=1 00:13:25.925 --rc geninfo_unexecuted_blocks=1 00:13:25.925 00:13:25.925 ' 00:13:25.925 21:03:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:25.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:25.925 --rc genhtml_branch_coverage=1 00:13:25.925 --rc genhtml_function_coverage=1 00:13:25.925 --rc genhtml_legend=1 00:13:25.925 --rc geninfo_all_blocks=1 00:13:25.925 --rc geninfo_unexecuted_blocks=1 00:13:25.925 00:13:25.925 ' 00:13:25.925 21:03:22 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:25.925 21:03:22 -- nvmf/common.sh@7 -- # uname -s 00:13:25.925 21:03:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:25.925 21:03:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:25.925 21:03:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:25.925 21:03:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:25.925 21:03:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:25.925 21:03:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:25.925 21:03:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:25.925 21:03:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:25.925 21:03:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:25.925 21:03:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:25.925 21:03:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:25.925 21:03:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:25.925 21:03:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:25.925 21:03:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:25.925 21:03:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:25.925 21:03:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:25.925 21:03:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:25.925 21:03:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:25.925 21:03:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:25.925 21:03:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.925 21:03:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.925 21:03:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.925 21:03:22 -- paths/export.sh@5 -- # export PATH 00:13:25.925 21:03:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:25.925 21:03:22 -- nvmf/common.sh@46 -- # : 0 00:13:25.925 21:03:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:25.925 21:03:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:25.925 21:03:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:25.925 21:03:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:25.925 21:03:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:25.925 21:03:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:25.925 21:03:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:25.925 21:03:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:25.925 21:03:22 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:25.925 21:03:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:25.925 21:03:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:25.925 21:03:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:25.925 21:03:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:25.925 21:03:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:25.925 21:03:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:25.925 21:03:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:25.925 21:03:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:25.925 21:03:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:25.925 21:03:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:25.925 21:03:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:25.925 21:03:22 -- common/autotest_common.sh@10 -- # set +x 00:13:28.462 21:03:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:28.462 21:03:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:28.462 21:03:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:28.462 21:03:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:28.463 21:03:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:28.463 21:03:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:28.463 21:03:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:28.463 21:03:24 -- nvmf/common.sh@294 -- # net_devs=() 00:13:28.463 21:03:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:28.463 21:03:24 -- nvmf/common.sh@295 -- # e810=() 00:13:28.463 21:03:24 -- nvmf/common.sh@295 -- # local -ga e810 00:13:28.463 21:03:24 -- nvmf/common.sh@296 -- # x722=() 00:13:28.463 21:03:24 -- nvmf/common.sh@296 -- # local -ga x722 00:13:28.463 21:03:24 -- nvmf/common.sh@297 -- # mlx=() 00:13:28.463 21:03:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:28.463 21:03:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:28.463 21:03:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:28.463 21:03:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:28.463 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:28.463 21:03:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:28.463 21:03:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:28.463 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:28.463 21:03:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:28.463 21:03:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.463 21:03:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.463 21:03:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:28.463 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:28.463 21:03:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:28.463 21:03:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.463 21:03:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.463 21:03:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:28.463 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:28.463 21:03:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:28.463 21:03:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:28.463 21:03:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:28.463 21:03:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:28.463 21:03:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:28.463 21:03:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:28.463 21:03:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:28.463 21:03:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:28.463 21:03:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:28.463 21:03:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:28.463 21:03:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:28.463 21:03:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:28.463 21:03:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:28.463 21:03:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:28.463 21:03:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:28.463 21:03:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:28.463 21:03:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:28.463 21:03:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:28.463 21:03:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:28.463 21:03:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:28.463 21:03:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:28.463 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:28.463 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:13:28.463 00:13:28.463 --- 10.0.0.2 ping statistics --- 00:13:28.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.463 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:13:28.463 21:03:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:28.463 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:28.463 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:13:28.463 00:13:28.463 --- 10.0.0.1 ping statistics --- 00:13:28.463 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.463 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:13:28.463 21:03:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:28.463 21:03:24 -- nvmf/common.sh@410 -- # return 0 00:13:28.463 21:03:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:28.463 21:03:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:28.463 21:03:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:28.463 21:03:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:28.463 21:03:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:28.463 21:03:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:28.463 21:03:24 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:28.463 21:03:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:28.463 21:03:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:28.463 21:03:24 -- common/autotest_common.sh@10 -- # set +x 00:13:28.463 21:03:24 -- nvmf/common.sh@469 -- # nvmfpid=3948227 00:13:28.463 21:03:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:28.463 21:03:24 -- nvmf/common.sh@470 -- # waitforlisten 3948227 00:13:28.463 21:03:24 -- common/autotest_common.sh@829 -- # '[' -z 3948227 ']' 00:13:28.463 21:03:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:28.463 21:03:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:28.463 21:03:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:28.463 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:28.463 21:03:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:28.463 21:03:24 -- common/autotest_common.sh@10 -- # set +x 00:13:28.463 [2024-11-27 21:03:24.298566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:28.463 [2024-11-27 21:03:24.298658] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:28.463 EAL: No free 2048 kB hugepages reported on node 1 00:13:28.463 [2024-11-27 21:03:24.362723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:28.463 [2024-11-27 21:03:24.473136] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:28.463 [2024-11-27 21:03:24.473305] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:28.463 [2024-11-27 21:03:24.473322] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:28.463 [2024-11-27 21:03:24.473334] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:28.463 [2024-11-27 21:03:24.473425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:28.463 [2024-11-27 21:03:24.473458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:28.463 [2024-11-27 21:03:24.473460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:29.029 21:03:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:29.029 21:03:25 -- common/autotest_common.sh@862 -- # return 0 00:13:29.029 21:03:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:29.029 21:03:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:29.029 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.287 21:03:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:29.287 21:03:25 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:29.287 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.287 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.287 [2024-11-27 21:03:25.292073] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:29.287 21:03:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.287 21:03:25 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:29.287 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.287 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.287 21:03:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.287 21:03:25 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.287 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.287 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.287 [2024-11-27 21:03:25.317677] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.287 21:03:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.287 21:03:25 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:29.287 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.287 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.287 NULL1 00:13:29.287 21:03:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.287 21:03:25 -- target/connect_stress.sh@21 -- # PERF_PID=3948352 00:13:29.287 21:03:25 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:29.287 21:03:25 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:29.287 21:03:25 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 EAL: No free 2048 kB hugepages reported on node 1 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:29.287 21:03:25 -- target/connect_stress.sh@28 -- # cat 00:13:29.287 21:03:25 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:29.287 21:03:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.287 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.287 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.544 21:03:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.544 21:03:25 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:29.544 21:03:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.544 21:03:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.544 21:03:25 -- common/autotest_common.sh@10 -- # set +x 00:13:29.802 21:03:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.802 21:03:26 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:29.802 21:03:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.802 21:03:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.802 21:03:26 -- common/autotest_common.sh@10 -- # set +x 00:13:30.366 21:03:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.366 21:03:26 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:30.366 21:03:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.366 21:03:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.366 21:03:26 -- common/autotest_common.sh@10 -- # set +x 00:13:30.624 21:03:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.624 21:03:26 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:30.624 21:03:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.624 21:03:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.624 21:03:26 -- common/autotest_common.sh@10 -- # set +x 00:13:30.882 21:03:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.882 21:03:26 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:30.882 21:03:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.882 21:03:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.882 21:03:26 -- common/autotest_common.sh@10 -- # set +x 00:13:31.140 21:03:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.140 21:03:27 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:31.140 21:03:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.140 21:03:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.140 21:03:27 -- common/autotest_common.sh@10 -- # set +x 00:13:31.397 21:03:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.397 21:03:27 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:31.397 21:03:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.397 21:03:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.397 21:03:27 -- common/autotest_common.sh@10 -- # set +x 00:13:31.962 21:03:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.962 21:03:27 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:31.962 21:03:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.962 21:03:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.962 21:03:27 -- common/autotest_common.sh@10 -- # set +x 00:13:32.219 21:03:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.219 21:03:28 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:32.219 21:03:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.219 21:03:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.219 21:03:28 -- common/autotest_common.sh@10 -- # set +x 00:13:32.477 21:03:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.477 21:03:28 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:32.477 21:03:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.477 21:03:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.477 21:03:28 -- common/autotest_common.sh@10 -- # set +x 00:13:32.734 21:03:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.734 21:03:28 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:32.734 21:03:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.734 21:03:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.734 21:03:28 -- common/autotest_common.sh@10 -- # set +x 00:13:33.298 21:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.298 21:03:29 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:33.298 21:03:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.298 21:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.298 21:03:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.555 21:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.555 21:03:29 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:33.555 21:03:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.555 21:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.555 21:03:29 -- common/autotest_common.sh@10 -- # set +x 00:13:33.813 21:03:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.813 21:03:29 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:33.813 21:03:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.813 21:03:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.813 21:03:29 -- common/autotest_common.sh@10 -- # set +x 00:13:34.071 21:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.071 21:03:30 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:34.071 21:03:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.071 21:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.071 21:03:30 -- common/autotest_common.sh@10 -- # set +x 00:13:34.329 21:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.329 21:03:30 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:34.329 21:03:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.329 21:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.329 21:03:30 -- common/autotest_common.sh@10 -- # set +x 00:13:34.895 21:03:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.895 21:03:30 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:34.895 21:03:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.895 21:03:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.895 21:03:30 -- common/autotest_common.sh@10 -- # set +x 00:13:35.152 21:03:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.152 21:03:31 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:35.152 21:03:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.152 21:03:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.152 21:03:31 -- common/autotest_common.sh@10 -- # set +x 00:13:35.410 21:03:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.410 21:03:31 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:35.410 21:03:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.410 21:03:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.410 21:03:31 -- common/autotest_common.sh@10 -- # set +x 00:13:35.696 21:03:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.696 21:03:31 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:35.696 21:03:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.696 21:03:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.696 21:03:31 -- common/autotest_common.sh@10 -- # set +x 00:13:35.977 21:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.977 21:03:32 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:35.977 21:03:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.977 21:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.978 21:03:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.235 21:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.235 21:03:32 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:36.235 21:03:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.235 21:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.235 21:03:32 -- common/autotest_common.sh@10 -- # set +x 00:13:36.800 21:03:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.801 21:03:32 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:36.801 21:03:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.801 21:03:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.801 21:03:32 -- common/autotest_common.sh@10 -- # set +x 00:13:37.058 21:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.058 21:03:33 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:37.058 21:03:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.058 21:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.058 21:03:33 -- common/autotest_common.sh@10 -- # set +x 00:13:37.315 21:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.315 21:03:33 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:37.315 21:03:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.315 21:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.315 21:03:33 -- common/autotest_common.sh@10 -- # set +x 00:13:37.573 21:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.573 21:03:33 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:37.573 21:03:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.573 21:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.573 21:03:33 -- common/autotest_common.sh@10 -- # set +x 00:13:37.830 21:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.830 21:03:34 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:37.830 21:03:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.830 21:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.830 21:03:34 -- common/autotest_common.sh@10 -- # set +x 00:13:38.395 21:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.395 21:03:34 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:38.395 21:03:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.395 21:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.395 21:03:34 -- common/autotest_common.sh@10 -- # set +x 00:13:38.652 21:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.652 21:03:34 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:38.652 21:03:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.652 21:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.652 21:03:34 -- common/autotest_common.sh@10 -- # set +x 00:13:38.910 21:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.910 21:03:35 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:38.910 21:03:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.910 21:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.910 21:03:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.167 21:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.167 21:03:35 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:39.167 21:03:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.167 21:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.167 21:03:35 -- common/autotest_common.sh@10 -- # set +x 00:13:39.424 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:39.424 21:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.424 21:03:35 -- target/connect_stress.sh@34 -- # kill -0 3948352 00:13:39.424 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3948352) - No such process 00:13:39.424 21:03:35 -- target/connect_stress.sh@38 -- # wait 3948352 00:13:39.424 21:03:35 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:39.682 21:03:35 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:39.682 21:03:35 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:39.682 21:03:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:39.682 21:03:35 -- nvmf/common.sh@116 -- # sync 00:13:39.682 21:03:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:39.682 21:03:35 -- nvmf/common.sh@119 -- # set +e 00:13:39.682 21:03:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:39.682 21:03:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:39.682 rmmod nvme_tcp 00:13:39.682 rmmod nvme_fabrics 00:13:39.682 rmmod nvme_keyring 00:13:39.682 21:03:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:39.682 21:03:35 -- nvmf/common.sh@123 -- # set -e 00:13:39.682 21:03:35 -- nvmf/common.sh@124 -- # return 0 00:13:39.682 21:03:35 -- nvmf/common.sh@477 -- # '[' -n 3948227 ']' 00:13:39.682 21:03:35 -- nvmf/common.sh@478 -- # killprocess 3948227 00:13:39.682 21:03:35 -- common/autotest_common.sh@936 -- # '[' -z 3948227 ']' 00:13:39.682 21:03:35 -- common/autotest_common.sh@940 -- # kill -0 3948227 00:13:39.682 21:03:35 -- common/autotest_common.sh@941 -- # uname 00:13:39.682 21:03:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:39.682 21:03:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3948227 00:13:39.682 21:03:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:39.682 21:03:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:39.682 21:03:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3948227' 00:13:39.682 killing process with pid 3948227 00:13:39.682 21:03:35 -- common/autotest_common.sh@955 -- # kill 3948227 00:13:39.682 21:03:35 -- common/autotest_common.sh@960 -- # wait 3948227 00:13:39.941 21:03:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:39.941 21:03:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:39.941 21:03:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:39.941 21:03:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:39.941 21:03:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:39.941 21:03:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.942 21:03:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.942 21:03:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:41.847 21:03:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:41.847 00:13:41.847 real 0m16.143s 00:13:41.847 user 0m41.042s 00:13:41.847 sys 0m5.766s 00:13:41.847 21:03:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:41.847 21:03:38 -- common/autotest_common.sh@10 -- # set +x 00:13:41.847 ************************************ 00:13:41.847 END TEST nvmf_connect_stress 00:13:41.847 ************************************ 00:13:42.105 21:03:38 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:42.105 21:03:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:42.105 21:03:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.105 21:03:38 -- common/autotest_common.sh@10 -- # set +x 00:13:42.105 ************************************ 00:13:42.105 START TEST nvmf_fused_ordering 00:13:42.105 ************************************ 00:13:42.105 21:03:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:42.105 * Looking for test storage... 00:13:42.105 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:42.105 21:03:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:42.105 21:03:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:42.106 21:03:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:42.106 21:03:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:42.106 21:03:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:42.106 21:03:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:42.106 21:03:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:42.106 21:03:38 -- scripts/common.sh@335 -- # IFS=.-: 00:13:42.106 21:03:38 -- scripts/common.sh@335 -- # read -ra ver1 00:13:42.106 21:03:38 -- scripts/common.sh@336 -- # IFS=.-: 00:13:42.106 21:03:38 -- scripts/common.sh@336 -- # read -ra ver2 00:13:42.106 21:03:38 -- scripts/common.sh@337 -- # local 'op=<' 00:13:42.106 21:03:38 -- scripts/common.sh@339 -- # ver1_l=2 00:13:42.106 21:03:38 -- scripts/common.sh@340 -- # ver2_l=1 00:13:42.106 21:03:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:42.106 21:03:38 -- scripts/common.sh@343 -- # case "$op" in 00:13:42.106 21:03:38 -- scripts/common.sh@344 -- # : 1 00:13:42.106 21:03:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:42.106 21:03:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:42.106 21:03:38 -- scripts/common.sh@364 -- # decimal 1 00:13:42.106 21:03:38 -- scripts/common.sh@352 -- # local d=1 00:13:42.106 21:03:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:42.106 21:03:38 -- scripts/common.sh@354 -- # echo 1 00:13:42.106 21:03:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:42.106 21:03:38 -- scripts/common.sh@365 -- # decimal 2 00:13:42.106 21:03:38 -- scripts/common.sh@352 -- # local d=2 00:13:42.106 21:03:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:42.106 21:03:38 -- scripts/common.sh@354 -- # echo 2 00:13:42.106 21:03:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:42.106 21:03:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:42.106 21:03:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:42.106 21:03:38 -- scripts/common.sh@367 -- # return 0 00:13:42.106 21:03:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:42.106 21:03:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:42.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.106 --rc genhtml_branch_coverage=1 00:13:42.106 --rc genhtml_function_coverage=1 00:13:42.106 --rc genhtml_legend=1 00:13:42.106 --rc geninfo_all_blocks=1 00:13:42.106 --rc geninfo_unexecuted_blocks=1 00:13:42.106 00:13:42.106 ' 00:13:42.106 21:03:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:42.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.106 --rc genhtml_branch_coverage=1 00:13:42.106 --rc genhtml_function_coverage=1 00:13:42.106 --rc genhtml_legend=1 00:13:42.106 --rc geninfo_all_blocks=1 00:13:42.106 --rc geninfo_unexecuted_blocks=1 00:13:42.106 00:13:42.106 ' 00:13:42.106 21:03:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:42.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.106 --rc genhtml_branch_coverage=1 00:13:42.106 --rc genhtml_function_coverage=1 00:13:42.106 --rc genhtml_legend=1 00:13:42.106 --rc geninfo_all_blocks=1 00:13:42.106 --rc geninfo_unexecuted_blocks=1 00:13:42.106 00:13:42.106 ' 00:13:42.106 21:03:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:42.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.106 --rc genhtml_branch_coverage=1 00:13:42.106 --rc genhtml_function_coverage=1 00:13:42.106 --rc genhtml_legend=1 00:13:42.106 --rc geninfo_all_blocks=1 00:13:42.106 --rc geninfo_unexecuted_blocks=1 00:13:42.106 00:13:42.106 ' 00:13:42.106 21:03:38 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:42.106 21:03:38 -- nvmf/common.sh@7 -- # uname -s 00:13:42.106 21:03:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:42.106 21:03:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:42.106 21:03:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:42.106 21:03:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:42.106 21:03:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:42.106 21:03:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:42.106 21:03:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:42.106 21:03:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:42.106 21:03:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:42.106 21:03:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:42.106 21:03:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.106 21:03:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.106 21:03:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:42.106 21:03:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:42.106 21:03:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:42.106 21:03:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:42.106 21:03:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:42.106 21:03:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:42.106 21:03:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:42.106 21:03:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.106 21:03:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.106 21:03:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.106 21:03:38 -- paths/export.sh@5 -- # export PATH 00:13:42.106 21:03:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.106 21:03:38 -- nvmf/common.sh@46 -- # : 0 00:13:42.106 21:03:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:42.106 21:03:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:42.106 21:03:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:42.106 21:03:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:42.106 21:03:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:42.106 21:03:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:42.106 21:03:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:42.106 21:03:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:42.106 21:03:38 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:42.106 21:03:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:42.107 21:03:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:42.107 21:03:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:42.107 21:03:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:42.107 21:03:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:42.107 21:03:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.107 21:03:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.107 21:03:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.107 21:03:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:42.107 21:03:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:42.107 21:03:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:42.107 21:03:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.638 21:03:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:44.638 21:03:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:44.638 21:03:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:44.638 21:03:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:44.638 21:03:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:44.638 21:03:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:44.638 21:03:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:44.638 21:03:40 -- nvmf/common.sh@294 -- # net_devs=() 00:13:44.638 21:03:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:44.638 21:03:40 -- nvmf/common.sh@295 -- # e810=() 00:13:44.638 21:03:40 -- nvmf/common.sh@295 -- # local -ga e810 00:13:44.638 21:03:40 -- nvmf/common.sh@296 -- # x722=() 00:13:44.638 21:03:40 -- nvmf/common.sh@296 -- # local -ga x722 00:13:44.638 21:03:40 -- nvmf/common.sh@297 -- # mlx=() 00:13:44.638 21:03:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:44.638 21:03:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:44.638 21:03:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.638 21:03:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:44.638 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:44.638 21:03:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.638 21:03:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:44.638 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:44.638 21:03:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.638 21:03:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.638 21:03:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.638 21:03:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:44.638 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:44.638 21:03:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.638 21:03:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.638 21:03:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.638 21:03:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:44.638 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:44.638 21:03:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:44.638 21:03:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:44.638 21:03:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:44.638 21:03:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:44.638 21:03:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:44.638 21:03:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:44.638 21:03:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:44.638 21:03:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:44.638 21:03:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:44.638 21:03:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:44.638 21:03:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:44.638 21:03:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:44.638 21:03:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:44.638 21:03:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:44.638 21:03:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:44.638 21:03:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:44.638 21:03:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:44.638 21:03:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:44.638 21:03:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:44.638 21:03:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:44.638 21:03:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:44.638 21:03:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:44.638 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:44.638 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:13:44.638 00:13:44.638 --- 10.0.0.2 ping statistics --- 00:13:44.638 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.638 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:13:44.638 21:03:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:44.638 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:44.638 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:13:44.638 00:13:44.638 --- 10.0.0.1 ping statistics --- 00:13:44.638 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.638 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:13:44.638 21:03:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:44.638 21:03:40 -- nvmf/common.sh@410 -- # return 0 00:13:44.638 21:03:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:44.638 21:03:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:44.639 21:03:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:44.639 21:03:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:44.639 21:03:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:44.639 21:03:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:44.639 21:03:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:44.639 21:03:40 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:44.639 21:03:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:44.639 21:03:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:44.639 21:03:40 -- common/autotest_common.sh@10 -- # set +x 00:13:44.639 21:03:40 -- nvmf/common.sh@469 -- # nvmfpid=3951590 00:13:44.639 21:03:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:44.639 21:03:40 -- nvmf/common.sh@470 -- # waitforlisten 3951590 00:13:44.639 21:03:40 -- common/autotest_common.sh@829 -- # '[' -z 3951590 ']' 00:13:44.639 21:03:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:44.639 21:03:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:44.639 21:03:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:44.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:44.639 21:03:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:44.639 21:03:40 -- common/autotest_common.sh@10 -- # set +x 00:13:44.639 [2024-11-27 21:03:40.495961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:44.639 [2024-11-27 21:03:40.496039] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:44.639 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.639 [2024-11-27 21:03:40.564152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:44.639 [2024-11-27 21:03:40.678645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:44.639 [2024-11-27 21:03:40.678815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:44.639 [2024-11-27 21:03:40.678835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:44.639 [2024-11-27 21:03:40.678850] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:44.639 [2024-11-27 21:03:40.678882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:45.573 21:03:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:45.573 21:03:41 -- common/autotest_common.sh@862 -- # return 0 00:13:45.573 21:03:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:45.573 21:03:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 21:03:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:45.573 21:03:41 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 [2024-11-27 21:03:41.478421] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 [2024-11-27 21:03:41.494657] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 NULL1 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:45.573 21:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.573 21:03:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.573 21:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.573 21:03:41 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:45.573 [2024-11-27 21:03:41.540401] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.573 [2024-11-27 21:03:41.540435] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3951743 ] 00:13:45.573 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.831 Attached to nqn.2016-06.io.spdk:cnode1 00:13:45.831 Namespace ID: 1 size: 1GB 00:13:45.831 fused_ordering(0) 00:13:45.831 fused_ordering(1) 00:13:45.831 fused_ordering(2) 00:13:45.831 fused_ordering(3) 00:13:45.831 fused_ordering(4) 00:13:45.831 fused_ordering(5) 00:13:45.831 fused_ordering(6) 00:13:45.831 fused_ordering(7) 00:13:45.831 fused_ordering(8) 00:13:45.831 fused_ordering(9) 00:13:45.831 fused_ordering(10) 00:13:45.831 fused_ordering(11) 00:13:45.831 fused_ordering(12) 00:13:45.831 fused_ordering(13) 00:13:45.831 fused_ordering(14) 00:13:45.831 fused_ordering(15) 00:13:45.831 fused_ordering(16) 00:13:45.831 fused_ordering(17) 00:13:45.831 fused_ordering(18) 00:13:45.831 fused_ordering(19) 00:13:45.831 fused_ordering(20) 00:13:45.831 fused_ordering(21) 00:13:45.831 fused_ordering(22) 00:13:45.831 fused_ordering(23) 00:13:45.831 fused_ordering(24) 00:13:45.831 fused_ordering(25) 00:13:45.831 fused_ordering(26) 00:13:45.831 fused_ordering(27) 00:13:45.831 fused_ordering(28) 00:13:45.831 fused_ordering(29) 00:13:45.831 fused_ordering(30) 00:13:45.831 fused_ordering(31) 00:13:45.831 fused_ordering(32) 00:13:45.831 fused_ordering(33) 00:13:45.831 fused_ordering(34) 00:13:45.831 fused_ordering(35) 00:13:45.831 fused_ordering(36) 00:13:45.831 fused_ordering(37) 00:13:45.831 fused_ordering(38) 00:13:45.831 fused_ordering(39) 00:13:45.831 fused_ordering(40) 00:13:45.831 fused_ordering(41) 00:13:45.831 fused_ordering(42) 00:13:45.831 fused_ordering(43) 00:13:45.831 fused_ordering(44) 00:13:45.831 fused_ordering(45) 00:13:45.831 fused_ordering(46) 00:13:45.831 fused_ordering(47) 00:13:45.831 fused_ordering(48) 00:13:45.831 fused_ordering(49) 00:13:45.831 fused_ordering(50) 00:13:45.831 fused_ordering(51) 00:13:45.831 fused_ordering(52) 00:13:45.831 fused_ordering(53) 00:13:45.831 fused_ordering(54) 00:13:45.831 fused_ordering(55) 00:13:45.831 fused_ordering(56) 00:13:45.831 fused_ordering(57) 00:13:45.831 fused_ordering(58) 00:13:45.831 fused_ordering(59) 00:13:45.831 fused_ordering(60) 00:13:45.831 fused_ordering(61) 00:13:45.831 fused_ordering(62) 00:13:45.831 fused_ordering(63) 00:13:45.831 fused_ordering(64) 00:13:45.831 fused_ordering(65) 00:13:45.831 fused_ordering(66) 00:13:45.831 fused_ordering(67) 00:13:45.831 fused_ordering(68) 00:13:45.831 fused_ordering(69) 00:13:45.831 fused_ordering(70) 00:13:45.831 fused_ordering(71) 00:13:45.831 fused_ordering(72) 00:13:45.831 fused_ordering(73) 00:13:45.831 fused_ordering(74) 00:13:45.831 fused_ordering(75) 00:13:45.831 fused_ordering(76) 00:13:45.831 fused_ordering(77) 00:13:45.831 fused_ordering(78) 00:13:45.831 fused_ordering(79) 00:13:45.831 fused_ordering(80) 00:13:45.831 fused_ordering(81) 00:13:45.831 fused_ordering(82) 00:13:45.831 fused_ordering(83) 00:13:45.831 fused_ordering(84) 00:13:45.831 fused_ordering(85) 00:13:45.831 fused_ordering(86) 00:13:45.831 fused_ordering(87) 00:13:45.831 fused_ordering(88) 00:13:45.831 fused_ordering(89) 00:13:45.831 fused_ordering(90) 00:13:45.831 fused_ordering(91) 00:13:45.831 fused_ordering(92) 00:13:45.831 fused_ordering(93) 00:13:45.831 fused_ordering(94) 00:13:45.831 fused_ordering(95) 00:13:45.831 fused_ordering(96) 00:13:45.831 fused_ordering(97) 00:13:45.831 fused_ordering(98) 00:13:45.831 fused_ordering(99) 00:13:45.831 fused_ordering(100) 00:13:45.831 fused_ordering(101) 00:13:45.831 fused_ordering(102) 00:13:45.831 fused_ordering(103) 00:13:45.831 fused_ordering(104) 00:13:45.831 fused_ordering(105) 00:13:45.831 fused_ordering(106) 00:13:45.831 fused_ordering(107) 00:13:45.831 fused_ordering(108) 00:13:45.831 fused_ordering(109) 00:13:45.831 fused_ordering(110) 00:13:45.831 fused_ordering(111) 00:13:45.831 fused_ordering(112) 00:13:45.831 fused_ordering(113) 00:13:45.831 fused_ordering(114) 00:13:45.831 fused_ordering(115) 00:13:45.831 fused_ordering(116) 00:13:45.831 fused_ordering(117) 00:13:45.831 fused_ordering(118) 00:13:45.831 fused_ordering(119) 00:13:45.831 fused_ordering(120) 00:13:45.831 fused_ordering(121) 00:13:45.831 fused_ordering(122) 00:13:45.831 fused_ordering(123) 00:13:45.831 fused_ordering(124) 00:13:45.831 fused_ordering(125) 00:13:45.831 fused_ordering(126) 00:13:45.831 fused_ordering(127) 00:13:45.831 fused_ordering(128) 00:13:45.831 fused_ordering(129) 00:13:45.831 fused_ordering(130) 00:13:45.831 fused_ordering(131) 00:13:45.831 fused_ordering(132) 00:13:45.831 fused_ordering(133) 00:13:45.831 fused_ordering(134) 00:13:45.831 fused_ordering(135) 00:13:45.831 fused_ordering(136) 00:13:45.831 fused_ordering(137) 00:13:45.831 fused_ordering(138) 00:13:45.831 fused_ordering(139) 00:13:45.831 fused_ordering(140) 00:13:45.831 fused_ordering(141) 00:13:45.831 fused_ordering(142) 00:13:45.831 fused_ordering(143) 00:13:45.831 fused_ordering(144) 00:13:45.831 fused_ordering(145) 00:13:45.831 fused_ordering(146) 00:13:45.831 fused_ordering(147) 00:13:45.831 fused_ordering(148) 00:13:45.831 fused_ordering(149) 00:13:45.831 fused_ordering(150) 00:13:45.831 fused_ordering(151) 00:13:45.831 fused_ordering(152) 00:13:45.831 fused_ordering(153) 00:13:45.831 fused_ordering(154) 00:13:45.831 fused_ordering(155) 00:13:45.831 fused_ordering(156) 00:13:45.831 fused_ordering(157) 00:13:45.831 fused_ordering(158) 00:13:45.831 fused_ordering(159) 00:13:45.831 fused_ordering(160) 00:13:45.831 fused_ordering(161) 00:13:45.831 fused_ordering(162) 00:13:45.831 fused_ordering(163) 00:13:45.831 fused_ordering(164) 00:13:45.831 fused_ordering(165) 00:13:45.831 fused_ordering(166) 00:13:45.831 fused_ordering(167) 00:13:45.831 fused_ordering(168) 00:13:45.831 fused_ordering(169) 00:13:45.831 fused_ordering(170) 00:13:45.831 fused_ordering(171) 00:13:45.831 fused_ordering(172) 00:13:45.831 fused_ordering(173) 00:13:45.831 fused_ordering(174) 00:13:45.831 fused_ordering(175) 00:13:45.831 fused_ordering(176) 00:13:45.831 fused_ordering(177) 00:13:45.831 fused_ordering(178) 00:13:45.831 fused_ordering(179) 00:13:45.832 fused_ordering(180) 00:13:45.832 fused_ordering(181) 00:13:45.832 fused_ordering(182) 00:13:45.832 fused_ordering(183) 00:13:45.832 fused_ordering(184) 00:13:45.832 fused_ordering(185) 00:13:45.832 fused_ordering(186) 00:13:45.832 fused_ordering(187) 00:13:45.832 fused_ordering(188) 00:13:45.832 fused_ordering(189) 00:13:45.832 fused_ordering(190) 00:13:45.832 fused_ordering(191) 00:13:45.832 fused_ordering(192) 00:13:45.832 fused_ordering(193) 00:13:45.832 fused_ordering(194) 00:13:45.832 fused_ordering(195) 00:13:45.832 fused_ordering(196) 00:13:45.832 fused_ordering(197) 00:13:45.832 fused_ordering(198) 00:13:45.832 fused_ordering(199) 00:13:45.832 fused_ordering(200) 00:13:45.832 fused_ordering(201) 00:13:45.832 fused_ordering(202) 00:13:45.832 fused_ordering(203) 00:13:45.832 fused_ordering(204) 00:13:45.832 fused_ordering(205) 00:13:46.089 fused_ordering(206) 00:13:46.089 fused_ordering(207) 00:13:46.089 fused_ordering(208) 00:13:46.089 fused_ordering(209) 00:13:46.089 fused_ordering(210) 00:13:46.089 fused_ordering(211) 00:13:46.089 fused_ordering(212) 00:13:46.089 fused_ordering(213) 00:13:46.089 fused_ordering(214) 00:13:46.089 fused_ordering(215) 00:13:46.089 fused_ordering(216) 00:13:46.090 fused_ordering(217) 00:13:46.090 fused_ordering(218) 00:13:46.090 fused_ordering(219) 00:13:46.090 fused_ordering(220) 00:13:46.090 fused_ordering(221) 00:13:46.090 fused_ordering(222) 00:13:46.090 fused_ordering(223) 00:13:46.090 fused_ordering(224) 00:13:46.090 fused_ordering(225) 00:13:46.090 fused_ordering(226) 00:13:46.090 fused_ordering(227) 00:13:46.090 fused_ordering(228) 00:13:46.090 fused_ordering(229) 00:13:46.090 fused_ordering(230) 00:13:46.090 fused_ordering(231) 00:13:46.090 fused_ordering(232) 00:13:46.090 fused_ordering(233) 00:13:46.090 fused_ordering(234) 00:13:46.090 fused_ordering(235) 00:13:46.090 fused_ordering(236) 00:13:46.090 fused_ordering(237) 00:13:46.090 fused_ordering(238) 00:13:46.090 fused_ordering(239) 00:13:46.090 fused_ordering(240) 00:13:46.090 fused_ordering(241) 00:13:46.090 fused_ordering(242) 00:13:46.090 fused_ordering(243) 00:13:46.090 fused_ordering(244) 00:13:46.090 fused_ordering(245) 00:13:46.090 fused_ordering(246) 00:13:46.090 fused_ordering(247) 00:13:46.090 fused_ordering(248) 00:13:46.090 fused_ordering(249) 00:13:46.090 fused_ordering(250) 00:13:46.090 fused_ordering(251) 00:13:46.090 fused_ordering(252) 00:13:46.090 fused_ordering(253) 00:13:46.090 fused_ordering(254) 00:13:46.090 fused_ordering(255) 00:13:46.090 fused_ordering(256) 00:13:46.090 fused_ordering(257) 00:13:46.090 fused_ordering(258) 00:13:46.090 fused_ordering(259) 00:13:46.090 fused_ordering(260) 00:13:46.090 fused_ordering(261) 00:13:46.090 fused_ordering(262) 00:13:46.090 fused_ordering(263) 00:13:46.090 fused_ordering(264) 00:13:46.090 fused_ordering(265) 00:13:46.090 fused_ordering(266) 00:13:46.090 fused_ordering(267) 00:13:46.090 fused_ordering(268) 00:13:46.090 fused_ordering(269) 00:13:46.090 fused_ordering(270) 00:13:46.090 fused_ordering(271) 00:13:46.090 fused_ordering(272) 00:13:46.090 fused_ordering(273) 00:13:46.090 fused_ordering(274) 00:13:46.090 fused_ordering(275) 00:13:46.090 fused_ordering(276) 00:13:46.090 fused_ordering(277) 00:13:46.090 fused_ordering(278) 00:13:46.090 fused_ordering(279) 00:13:46.090 fused_ordering(280) 00:13:46.090 fused_ordering(281) 00:13:46.090 fused_ordering(282) 00:13:46.090 fused_ordering(283) 00:13:46.090 fused_ordering(284) 00:13:46.090 fused_ordering(285) 00:13:46.090 fused_ordering(286) 00:13:46.090 fused_ordering(287) 00:13:46.090 fused_ordering(288) 00:13:46.090 fused_ordering(289) 00:13:46.090 fused_ordering(290) 00:13:46.090 fused_ordering(291) 00:13:46.090 fused_ordering(292) 00:13:46.090 fused_ordering(293) 00:13:46.090 fused_ordering(294) 00:13:46.090 fused_ordering(295) 00:13:46.090 fused_ordering(296) 00:13:46.090 fused_ordering(297) 00:13:46.090 fused_ordering(298) 00:13:46.090 fused_ordering(299) 00:13:46.090 fused_ordering(300) 00:13:46.090 fused_ordering(301) 00:13:46.090 fused_ordering(302) 00:13:46.090 fused_ordering(303) 00:13:46.090 fused_ordering(304) 00:13:46.090 fused_ordering(305) 00:13:46.090 fused_ordering(306) 00:13:46.090 fused_ordering(307) 00:13:46.090 fused_ordering(308) 00:13:46.090 fused_ordering(309) 00:13:46.090 fused_ordering(310) 00:13:46.090 fused_ordering(311) 00:13:46.090 fused_ordering(312) 00:13:46.090 fused_ordering(313) 00:13:46.090 fused_ordering(314) 00:13:46.090 fused_ordering(315) 00:13:46.090 fused_ordering(316) 00:13:46.090 fused_ordering(317) 00:13:46.090 fused_ordering(318) 00:13:46.090 fused_ordering(319) 00:13:46.090 fused_ordering(320) 00:13:46.090 fused_ordering(321) 00:13:46.090 fused_ordering(322) 00:13:46.090 fused_ordering(323) 00:13:46.090 fused_ordering(324) 00:13:46.090 fused_ordering(325) 00:13:46.090 fused_ordering(326) 00:13:46.090 fused_ordering(327) 00:13:46.090 fused_ordering(328) 00:13:46.090 fused_ordering(329) 00:13:46.090 fused_ordering(330) 00:13:46.090 fused_ordering(331) 00:13:46.090 fused_ordering(332) 00:13:46.090 fused_ordering(333) 00:13:46.090 fused_ordering(334) 00:13:46.090 fused_ordering(335) 00:13:46.090 fused_ordering(336) 00:13:46.090 fused_ordering(337) 00:13:46.090 fused_ordering(338) 00:13:46.090 fused_ordering(339) 00:13:46.090 fused_ordering(340) 00:13:46.090 fused_ordering(341) 00:13:46.090 fused_ordering(342) 00:13:46.090 fused_ordering(343) 00:13:46.090 fused_ordering(344) 00:13:46.090 fused_ordering(345) 00:13:46.090 fused_ordering(346) 00:13:46.090 fused_ordering(347) 00:13:46.090 fused_ordering(348) 00:13:46.090 fused_ordering(349) 00:13:46.090 fused_ordering(350) 00:13:46.090 fused_ordering(351) 00:13:46.090 fused_ordering(352) 00:13:46.090 fused_ordering(353) 00:13:46.090 fused_ordering(354) 00:13:46.090 fused_ordering(355) 00:13:46.090 fused_ordering(356) 00:13:46.090 fused_ordering(357) 00:13:46.090 fused_ordering(358) 00:13:46.090 fused_ordering(359) 00:13:46.090 fused_ordering(360) 00:13:46.090 fused_ordering(361) 00:13:46.090 fused_ordering(362) 00:13:46.090 fused_ordering(363) 00:13:46.090 fused_ordering(364) 00:13:46.090 fused_ordering(365) 00:13:46.090 fused_ordering(366) 00:13:46.090 fused_ordering(367) 00:13:46.090 fused_ordering(368) 00:13:46.090 fused_ordering(369) 00:13:46.090 fused_ordering(370) 00:13:46.090 fused_ordering(371) 00:13:46.090 fused_ordering(372) 00:13:46.090 fused_ordering(373) 00:13:46.090 fused_ordering(374) 00:13:46.090 fused_ordering(375) 00:13:46.090 fused_ordering(376) 00:13:46.090 fused_ordering(377) 00:13:46.090 fused_ordering(378) 00:13:46.090 fused_ordering(379) 00:13:46.090 fused_ordering(380) 00:13:46.090 fused_ordering(381) 00:13:46.090 fused_ordering(382) 00:13:46.090 fused_ordering(383) 00:13:46.090 fused_ordering(384) 00:13:46.090 fused_ordering(385) 00:13:46.090 fused_ordering(386) 00:13:46.090 fused_ordering(387) 00:13:46.090 fused_ordering(388) 00:13:46.090 fused_ordering(389) 00:13:46.090 fused_ordering(390) 00:13:46.090 fused_ordering(391) 00:13:46.090 fused_ordering(392) 00:13:46.090 fused_ordering(393) 00:13:46.090 fused_ordering(394) 00:13:46.090 fused_ordering(395) 00:13:46.090 fused_ordering(396) 00:13:46.090 fused_ordering(397) 00:13:46.090 fused_ordering(398) 00:13:46.090 fused_ordering(399) 00:13:46.090 fused_ordering(400) 00:13:46.090 fused_ordering(401) 00:13:46.090 fused_ordering(402) 00:13:46.090 fused_ordering(403) 00:13:46.090 fused_ordering(404) 00:13:46.090 fused_ordering(405) 00:13:46.090 fused_ordering(406) 00:13:46.090 fused_ordering(407) 00:13:46.090 fused_ordering(408) 00:13:46.090 fused_ordering(409) 00:13:46.090 fused_ordering(410) 00:13:46.654 fused_ordering(411) 00:13:46.654 fused_ordering(412) 00:13:46.654 fused_ordering(413) 00:13:46.654 fused_ordering(414) 00:13:46.654 fused_ordering(415) 00:13:46.654 fused_ordering(416) 00:13:46.654 fused_ordering(417) 00:13:46.654 fused_ordering(418) 00:13:46.654 fused_ordering(419) 00:13:46.654 fused_ordering(420) 00:13:46.654 fused_ordering(421) 00:13:46.654 fused_ordering(422) 00:13:46.654 fused_ordering(423) 00:13:46.654 fused_ordering(424) 00:13:46.654 fused_ordering(425) 00:13:46.654 fused_ordering(426) 00:13:46.654 fused_ordering(427) 00:13:46.654 fused_ordering(428) 00:13:46.654 fused_ordering(429) 00:13:46.654 fused_ordering(430) 00:13:46.654 fused_ordering(431) 00:13:46.654 fused_ordering(432) 00:13:46.654 fused_ordering(433) 00:13:46.654 fused_ordering(434) 00:13:46.654 fused_ordering(435) 00:13:46.654 fused_ordering(436) 00:13:46.654 fused_ordering(437) 00:13:46.654 fused_ordering(438) 00:13:46.655 fused_ordering(439) 00:13:46.655 fused_ordering(440) 00:13:46.655 fused_ordering(441) 00:13:46.655 fused_ordering(442) 00:13:46.655 fused_ordering(443) 00:13:46.655 fused_ordering(444) 00:13:46.655 fused_ordering(445) 00:13:46.655 fused_ordering(446) 00:13:46.655 fused_ordering(447) 00:13:46.655 fused_ordering(448) 00:13:46.655 fused_ordering(449) 00:13:46.655 fused_ordering(450) 00:13:46.655 fused_ordering(451) 00:13:46.655 fused_ordering(452) 00:13:46.655 fused_ordering(453) 00:13:46.655 fused_ordering(454) 00:13:46.655 fused_ordering(455) 00:13:46.655 fused_ordering(456) 00:13:46.655 fused_ordering(457) 00:13:46.655 fused_ordering(458) 00:13:46.655 fused_ordering(459) 00:13:46.655 fused_ordering(460) 00:13:46.655 fused_ordering(461) 00:13:46.655 fused_ordering(462) 00:13:46.655 fused_ordering(463) 00:13:46.655 fused_ordering(464) 00:13:46.655 fused_ordering(465) 00:13:46.655 fused_ordering(466) 00:13:46.655 fused_ordering(467) 00:13:46.655 fused_ordering(468) 00:13:46.655 fused_ordering(469) 00:13:46.655 fused_ordering(470) 00:13:46.655 fused_ordering(471) 00:13:46.655 fused_ordering(472) 00:13:46.655 fused_ordering(473) 00:13:46.655 fused_ordering(474) 00:13:46.655 fused_ordering(475) 00:13:46.655 fused_ordering(476) 00:13:46.655 fused_ordering(477) 00:13:46.655 fused_ordering(478) 00:13:46.655 fused_ordering(479) 00:13:46.655 fused_ordering(480) 00:13:46.655 fused_ordering(481) 00:13:46.655 fused_ordering(482) 00:13:46.655 fused_ordering(483) 00:13:46.655 fused_ordering(484) 00:13:46.655 fused_ordering(485) 00:13:46.655 fused_ordering(486) 00:13:46.655 fused_ordering(487) 00:13:46.655 fused_ordering(488) 00:13:46.655 fused_ordering(489) 00:13:46.655 fused_ordering(490) 00:13:46.655 fused_ordering(491) 00:13:46.655 fused_ordering(492) 00:13:46.655 fused_ordering(493) 00:13:46.655 fused_ordering(494) 00:13:46.655 fused_ordering(495) 00:13:46.655 fused_ordering(496) 00:13:46.655 fused_ordering(497) 00:13:46.655 fused_ordering(498) 00:13:46.655 fused_ordering(499) 00:13:46.655 fused_ordering(500) 00:13:46.655 fused_ordering(501) 00:13:46.655 fused_ordering(502) 00:13:46.655 fused_ordering(503) 00:13:46.655 fused_ordering(504) 00:13:46.655 fused_ordering(505) 00:13:46.655 fused_ordering(506) 00:13:46.655 fused_ordering(507) 00:13:46.655 fused_ordering(508) 00:13:46.655 fused_ordering(509) 00:13:46.655 fused_ordering(510) 00:13:46.655 fused_ordering(511) 00:13:46.655 fused_ordering(512) 00:13:46.655 fused_ordering(513) 00:13:46.655 fused_ordering(514) 00:13:46.655 fused_ordering(515) 00:13:46.655 fused_ordering(516) 00:13:46.655 fused_ordering(517) 00:13:46.655 fused_ordering(518) 00:13:46.655 fused_ordering(519) 00:13:46.655 fused_ordering(520) 00:13:46.655 fused_ordering(521) 00:13:46.655 fused_ordering(522) 00:13:46.655 fused_ordering(523) 00:13:46.655 fused_ordering(524) 00:13:46.655 fused_ordering(525) 00:13:46.655 fused_ordering(526) 00:13:46.655 fused_ordering(527) 00:13:46.655 fused_ordering(528) 00:13:46.655 fused_ordering(529) 00:13:46.655 fused_ordering(530) 00:13:46.655 fused_ordering(531) 00:13:46.655 fused_ordering(532) 00:13:46.655 fused_ordering(533) 00:13:46.655 fused_ordering(534) 00:13:46.655 fused_ordering(535) 00:13:46.655 fused_ordering(536) 00:13:46.655 fused_ordering(537) 00:13:46.655 fused_ordering(538) 00:13:46.655 fused_ordering(539) 00:13:46.655 fused_ordering(540) 00:13:46.655 fused_ordering(541) 00:13:46.655 fused_ordering(542) 00:13:46.655 fused_ordering(543) 00:13:46.655 fused_ordering(544) 00:13:46.655 fused_ordering(545) 00:13:46.655 fused_ordering(546) 00:13:46.655 fused_ordering(547) 00:13:46.655 fused_ordering(548) 00:13:46.655 fused_ordering(549) 00:13:46.655 fused_ordering(550) 00:13:46.655 fused_ordering(551) 00:13:46.655 fused_ordering(552) 00:13:46.655 fused_ordering(553) 00:13:46.655 fused_ordering(554) 00:13:46.655 fused_ordering(555) 00:13:46.655 fused_ordering(556) 00:13:46.655 fused_ordering(557) 00:13:46.655 fused_ordering(558) 00:13:46.655 fused_ordering(559) 00:13:46.655 fused_ordering(560) 00:13:46.655 fused_ordering(561) 00:13:46.655 fused_ordering(562) 00:13:46.655 fused_ordering(563) 00:13:46.655 fused_ordering(564) 00:13:46.655 fused_ordering(565) 00:13:46.655 fused_ordering(566) 00:13:46.655 fused_ordering(567) 00:13:46.655 fused_ordering(568) 00:13:46.655 fused_ordering(569) 00:13:46.655 fused_ordering(570) 00:13:46.655 fused_ordering(571) 00:13:46.655 fused_ordering(572) 00:13:46.655 fused_ordering(573) 00:13:46.655 fused_ordering(574) 00:13:46.655 fused_ordering(575) 00:13:46.655 fused_ordering(576) 00:13:46.655 fused_ordering(577) 00:13:46.655 fused_ordering(578) 00:13:46.655 fused_ordering(579) 00:13:46.655 fused_ordering(580) 00:13:46.655 fused_ordering(581) 00:13:46.655 fused_ordering(582) 00:13:46.655 fused_ordering(583) 00:13:46.655 fused_ordering(584) 00:13:46.655 fused_ordering(585) 00:13:46.655 fused_ordering(586) 00:13:46.655 fused_ordering(587) 00:13:46.655 fused_ordering(588) 00:13:46.655 fused_ordering(589) 00:13:46.655 fused_ordering(590) 00:13:46.655 fused_ordering(591) 00:13:46.655 fused_ordering(592) 00:13:46.655 fused_ordering(593) 00:13:46.655 fused_ordering(594) 00:13:46.655 fused_ordering(595) 00:13:46.655 fused_ordering(596) 00:13:46.655 fused_ordering(597) 00:13:46.655 fused_ordering(598) 00:13:46.655 fused_ordering(599) 00:13:46.655 fused_ordering(600) 00:13:46.655 fused_ordering(601) 00:13:46.655 fused_ordering(602) 00:13:46.655 fused_ordering(603) 00:13:46.655 fused_ordering(604) 00:13:46.655 fused_ordering(605) 00:13:46.655 fused_ordering(606) 00:13:46.655 fused_ordering(607) 00:13:46.655 fused_ordering(608) 00:13:46.655 fused_ordering(609) 00:13:46.655 fused_ordering(610) 00:13:46.655 fused_ordering(611) 00:13:46.655 fused_ordering(612) 00:13:46.655 fused_ordering(613) 00:13:46.655 fused_ordering(614) 00:13:46.655 fused_ordering(615) 00:13:47.222 fused_ordering(616) 00:13:47.222 fused_ordering(617) 00:13:47.222 fused_ordering(618) 00:13:47.222 fused_ordering(619) 00:13:47.222 fused_ordering(620) 00:13:47.222 fused_ordering(621) 00:13:47.222 fused_ordering(622) 00:13:47.222 fused_ordering(623) 00:13:47.222 fused_ordering(624) 00:13:47.222 fused_ordering(625) 00:13:47.222 fused_ordering(626) 00:13:47.222 fused_ordering(627) 00:13:47.222 fused_ordering(628) 00:13:47.222 fused_ordering(629) 00:13:47.222 fused_ordering(630) 00:13:47.222 fused_ordering(631) 00:13:47.222 fused_ordering(632) 00:13:47.222 fused_ordering(633) 00:13:47.222 fused_ordering(634) 00:13:47.222 fused_ordering(635) 00:13:47.222 fused_ordering(636) 00:13:47.222 fused_ordering(637) 00:13:47.222 fused_ordering(638) 00:13:47.222 fused_ordering(639) 00:13:47.222 fused_ordering(640) 00:13:47.222 fused_ordering(641) 00:13:47.222 fused_ordering(642) 00:13:47.222 fused_ordering(643) 00:13:47.222 fused_ordering(644) 00:13:47.222 fused_ordering(645) 00:13:47.222 fused_ordering(646) 00:13:47.222 fused_ordering(647) 00:13:47.222 fused_ordering(648) 00:13:47.222 fused_ordering(649) 00:13:47.222 fused_ordering(650) 00:13:47.222 fused_ordering(651) 00:13:47.222 fused_ordering(652) 00:13:47.222 fused_ordering(653) 00:13:47.222 fused_ordering(654) 00:13:47.222 fused_ordering(655) 00:13:47.222 fused_ordering(656) 00:13:47.222 fused_ordering(657) 00:13:47.222 fused_ordering(658) 00:13:47.222 fused_ordering(659) 00:13:47.222 fused_ordering(660) 00:13:47.222 fused_ordering(661) 00:13:47.222 fused_ordering(662) 00:13:47.222 fused_ordering(663) 00:13:47.222 fused_ordering(664) 00:13:47.222 fused_ordering(665) 00:13:47.222 fused_ordering(666) 00:13:47.222 fused_ordering(667) 00:13:47.222 fused_ordering(668) 00:13:47.222 fused_ordering(669) 00:13:47.222 fused_ordering(670) 00:13:47.222 fused_ordering(671) 00:13:47.222 fused_ordering(672) 00:13:47.222 fused_ordering(673) 00:13:47.222 fused_ordering(674) 00:13:47.222 fused_ordering(675) 00:13:47.222 fused_ordering(676) 00:13:47.222 fused_ordering(677) 00:13:47.222 fused_ordering(678) 00:13:47.222 fused_ordering(679) 00:13:47.222 fused_ordering(680) 00:13:47.222 fused_ordering(681) 00:13:47.222 fused_ordering(682) 00:13:47.222 fused_ordering(683) 00:13:47.222 fused_ordering(684) 00:13:47.222 fused_ordering(685) 00:13:47.222 fused_ordering(686) 00:13:47.222 fused_ordering(687) 00:13:47.222 fused_ordering(688) 00:13:47.222 fused_ordering(689) 00:13:47.222 fused_ordering(690) 00:13:47.222 fused_ordering(691) 00:13:47.222 fused_ordering(692) 00:13:47.222 fused_ordering(693) 00:13:47.222 fused_ordering(694) 00:13:47.222 fused_ordering(695) 00:13:47.222 fused_ordering(696) 00:13:47.222 fused_ordering(697) 00:13:47.222 fused_ordering(698) 00:13:47.222 fused_ordering(699) 00:13:47.222 fused_ordering(700) 00:13:47.222 fused_ordering(701) 00:13:47.222 fused_ordering(702) 00:13:47.222 fused_ordering(703) 00:13:47.222 fused_ordering(704) 00:13:47.222 fused_ordering(705) 00:13:47.222 fused_ordering(706) 00:13:47.222 fused_ordering(707) 00:13:47.222 fused_ordering(708) 00:13:47.222 fused_ordering(709) 00:13:47.222 fused_ordering(710) 00:13:47.222 fused_ordering(711) 00:13:47.222 fused_ordering(712) 00:13:47.222 fused_ordering(713) 00:13:47.222 fused_ordering(714) 00:13:47.222 fused_ordering(715) 00:13:47.222 fused_ordering(716) 00:13:47.222 fused_ordering(717) 00:13:47.222 fused_ordering(718) 00:13:47.222 fused_ordering(719) 00:13:47.222 fused_ordering(720) 00:13:47.222 fused_ordering(721) 00:13:47.222 fused_ordering(722) 00:13:47.222 fused_ordering(723) 00:13:47.222 fused_ordering(724) 00:13:47.222 fused_ordering(725) 00:13:47.222 fused_ordering(726) 00:13:47.222 fused_ordering(727) 00:13:47.222 fused_ordering(728) 00:13:47.222 fused_ordering(729) 00:13:47.222 fused_ordering(730) 00:13:47.222 fused_ordering(731) 00:13:47.222 fused_ordering(732) 00:13:47.222 fused_ordering(733) 00:13:47.222 fused_ordering(734) 00:13:47.222 fused_ordering(735) 00:13:47.222 fused_ordering(736) 00:13:47.222 fused_ordering(737) 00:13:47.222 fused_ordering(738) 00:13:47.222 fused_ordering(739) 00:13:47.222 fused_ordering(740) 00:13:47.222 fused_ordering(741) 00:13:47.222 fused_ordering(742) 00:13:47.222 fused_ordering(743) 00:13:47.222 fused_ordering(744) 00:13:47.222 fused_ordering(745) 00:13:47.222 fused_ordering(746) 00:13:47.222 fused_ordering(747) 00:13:47.222 fused_ordering(748) 00:13:47.222 fused_ordering(749) 00:13:47.222 fused_ordering(750) 00:13:47.222 fused_ordering(751) 00:13:47.222 fused_ordering(752) 00:13:47.222 fused_ordering(753) 00:13:47.222 fused_ordering(754) 00:13:47.222 fused_ordering(755) 00:13:47.222 fused_ordering(756) 00:13:47.222 fused_ordering(757) 00:13:47.222 fused_ordering(758) 00:13:47.222 fused_ordering(759) 00:13:47.222 fused_ordering(760) 00:13:47.222 fused_ordering(761) 00:13:47.222 fused_ordering(762) 00:13:47.222 fused_ordering(763) 00:13:47.222 fused_ordering(764) 00:13:47.222 fused_ordering(765) 00:13:47.222 fused_ordering(766) 00:13:47.222 fused_ordering(767) 00:13:47.222 fused_ordering(768) 00:13:47.222 fused_ordering(769) 00:13:47.222 fused_ordering(770) 00:13:47.222 fused_ordering(771) 00:13:47.222 fused_ordering(772) 00:13:47.222 fused_ordering(773) 00:13:47.222 fused_ordering(774) 00:13:47.222 fused_ordering(775) 00:13:47.222 fused_ordering(776) 00:13:47.222 fused_ordering(777) 00:13:47.222 fused_ordering(778) 00:13:47.222 fused_ordering(779) 00:13:47.222 fused_ordering(780) 00:13:47.222 fused_ordering(781) 00:13:47.222 fused_ordering(782) 00:13:47.222 fused_ordering(783) 00:13:47.222 fused_ordering(784) 00:13:47.222 fused_ordering(785) 00:13:47.222 fused_ordering(786) 00:13:47.222 fused_ordering(787) 00:13:47.222 fused_ordering(788) 00:13:47.222 fused_ordering(789) 00:13:47.222 fused_ordering(790) 00:13:47.222 fused_ordering(791) 00:13:47.222 fused_ordering(792) 00:13:47.222 fused_ordering(793) 00:13:47.222 fused_ordering(794) 00:13:47.222 fused_ordering(795) 00:13:47.222 fused_ordering(796) 00:13:47.222 fused_ordering(797) 00:13:47.222 fused_ordering(798) 00:13:47.222 fused_ordering(799) 00:13:47.222 fused_ordering(800) 00:13:47.222 fused_ordering(801) 00:13:47.222 fused_ordering(802) 00:13:47.222 fused_ordering(803) 00:13:47.222 fused_ordering(804) 00:13:47.222 fused_ordering(805) 00:13:47.222 fused_ordering(806) 00:13:47.222 fused_ordering(807) 00:13:47.222 fused_ordering(808) 00:13:47.222 fused_ordering(809) 00:13:47.222 fused_ordering(810) 00:13:47.222 fused_ordering(811) 00:13:47.222 fused_ordering(812) 00:13:47.222 fused_ordering(813) 00:13:47.222 fused_ordering(814) 00:13:47.222 fused_ordering(815) 00:13:47.222 fused_ordering(816) 00:13:47.222 fused_ordering(817) 00:13:47.222 fused_ordering(818) 00:13:47.222 fused_ordering(819) 00:13:47.222 fused_ordering(820) 00:13:47.788 fused_ordering(821) 00:13:47.788 fused_ordering(822) 00:13:47.788 fused_ordering(823) 00:13:47.788 fused_ordering(824) 00:13:47.788 fused_ordering(825) 00:13:47.788 fused_ordering(826) 00:13:47.788 fused_ordering(827) 00:13:47.788 fused_ordering(828) 00:13:47.788 fused_ordering(829) 00:13:47.788 fused_ordering(830) 00:13:47.788 fused_ordering(831) 00:13:47.788 fused_ordering(832) 00:13:47.788 fused_ordering(833) 00:13:47.788 fused_ordering(834) 00:13:47.788 fused_ordering(835) 00:13:47.788 fused_ordering(836) 00:13:47.788 fused_ordering(837) 00:13:47.788 fused_ordering(838) 00:13:47.788 fused_ordering(839) 00:13:47.788 fused_ordering(840) 00:13:47.788 fused_ordering(841) 00:13:47.788 fused_ordering(842) 00:13:47.788 fused_ordering(843) 00:13:47.788 fused_ordering(844) 00:13:47.788 fused_ordering(845) 00:13:47.788 fused_ordering(846) 00:13:47.788 fused_ordering(847) 00:13:47.788 fused_ordering(848) 00:13:47.788 fused_ordering(849) 00:13:47.788 fused_ordering(850) 00:13:47.788 fused_ordering(851) 00:13:47.788 fused_ordering(852) 00:13:47.788 fused_ordering(853) 00:13:47.788 fused_ordering(854) 00:13:47.788 fused_ordering(855) 00:13:47.788 fused_ordering(856) 00:13:47.788 fused_ordering(857) 00:13:47.788 fused_ordering(858) 00:13:47.788 fused_ordering(859) 00:13:47.788 fused_ordering(860) 00:13:47.788 fused_ordering(861) 00:13:47.788 fused_ordering(862) 00:13:47.788 fused_ordering(863) 00:13:47.788 fused_ordering(864) 00:13:47.788 fused_ordering(865) 00:13:47.788 fused_ordering(866) 00:13:47.788 fused_ordering(867) 00:13:47.788 fused_ordering(868) 00:13:47.788 fused_ordering(869) 00:13:47.788 fused_ordering(870) 00:13:47.788 fused_ordering(871) 00:13:47.788 fused_ordering(872) 00:13:47.788 fused_ordering(873) 00:13:47.788 fused_ordering(874) 00:13:47.788 fused_ordering(875) 00:13:47.788 fused_ordering(876) 00:13:47.788 fused_ordering(877) 00:13:47.788 fused_ordering(878) 00:13:47.788 fused_ordering(879) 00:13:47.788 fused_ordering(880) 00:13:47.788 fused_ordering(881) 00:13:47.788 fused_ordering(882) 00:13:47.788 fused_ordering(883) 00:13:47.788 fused_ordering(884) 00:13:47.788 fused_ordering(885) 00:13:47.788 fused_ordering(886) 00:13:47.788 fused_ordering(887) 00:13:47.788 fused_ordering(888) 00:13:47.788 fused_ordering(889) 00:13:47.788 fused_ordering(890) 00:13:47.788 fused_ordering(891) 00:13:47.788 fused_ordering(892) 00:13:47.788 fused_ordering(893) 00:13:47.788 fused_ordering(894) 00:13:47.788 fused_ordering(895) 00:13:47.788 fused_ordering(896) 00:13:47.788 fused_ordering(897) 00:13:47.788 fused_ordering(898) 00:13:47.788 fused_ordering(899) 00:13:47.788 fused_ordering(900) 00:13:47.788 fused_ordering(901) 00:13:47.788 fused_ordering(902) 00:13:47.788 fused_ordering(903) 00:13:47.788 fused_ordering(904) 00:13:47.788 fused_ordering(905) 00:13:47.788 fused_ordering(906) 00:13:47.788 fused_ordering(907) 00:13:47.788 fused_ordering(908) 00:13:47.788 fused_ordering(909) 00:13:47.788 fused_ordering(910) 00:13:47.788 fused_ordering(911) 00:13:47.788 fused_ordering(912) 00:13:47.788 fused_ordering(913) 00:13:47.788 fused_ordering(914) 00:13:47.788 fused_ordering(915) 00:13:47.788 fused_ordering(916) 00:13:47.788 fused_ordering(917) 00:13:47.788 fused_ordering(918) 00:13:47.788 fused_ordering(919) 00:13:47.788 fused_ordering(920) 00:13:47.788 fused_ordering(921) 00:13:47.788 fused_ordering(922) 00:13:47.788 fused_ordering(923) 00:13:47.788 fused_ordering(924) 00:13:47.788 fused_ordering(925) 00:13:47.788 fused_ordering(926) 00:13:47.788 fused_ordering(927) 00:13:47.788 fused_ordering(928) 00:13:47.788 fused_ordering(929) 00:13:47.788 fused_ordering(930) 00:13:47.788 fused_ordering(931) 00:13:47.788 fused_ordering(932) 00:13:47.788 fused_ordering(933) 00:13:47.788 fused_ordering(934) 00:13:47.788 fused_ordering(935) 00:13:47.788 fused_ordering(936) 00:13:47.788 fused_ordering(937) 00:13:47.788 fused_ordering(938) 00:13:47.788 fused_ordering(939) 00:13:47.788 fused_ordering(940) 00:13:47.788 fused_ordering(941) 00:13:47.788 fused_ordering(942) 00:13:47.788 fused_ordering(943) 00:13:47.788 fused_ordering(944) 00:13:47.788 fused_ordering(945) 00:13:47.788 fused_ordering(946) 00:13:47.788 fused_ordering(947) 00:13:47.788 fused_ordering(948) 00:13:47.788 fused_ordering(949) 00:13:47.788 fused_ordering(950) 00:13:47.788 fused_ordering(951) 00:13:47.788 fused_ordering(952) 00:13:47.788 fused_ordering(953) 00:13:47.788 fused_ordering(954) 00:13:47.788 fused_ordering(955) 00:13:47.788 fused_ordering(956) 00:13:47.788 fused_ordering(957) 00:13:47.788 fused_ordering(958) 00:13:47.788 fused_ordering(959) 00:13:47.788 fused_ordering(960) 00:13:47.788 fused_ordering(961) 00:13:47.788 fused_ordering(962) 00:13:47.788 fused_ordering(963) 00:13:47.788 fused_ordering(964) 00:13:47.788 fused_ordering(965) 00:13:47.788 fused_ordering(966) 00:13:47.788 fused_ordering(967) 00:13:47.788 fused_ordering(968) 00:13:47.788 fused_ordering(969) 00:13:47.788 fused_ordering(970) 00:13:47.788 fused_ordering(971) 00:13:47.788 fused_ordering(972) 00:13:47.788 fused_ordering(973) 00:13:47.788 fused_ordering(974) 00:13:47.788 fused_ordering(975) 00:13:47.788 fused_ordering(976) 00:13:47.788 fused_ordering(977) 00:13:47.788 fused_ordering(978) 00:13:47.788 fused_ordering(979) 00:13:47.788 fused_ordering(980) 00:13:47.788 fused_ordering(981) 00:13:47.788 fused_ordering(982) 00:13:47.788 fused_ordering(983) 00:13:47.788 fused_ordering(984) 00:13:47.788 fused_ordering(985) 00:13:47.788 fused_ordering(986) 00:13:47.788 fused_ordering(987) 00:13:47.788 fused_ordering(988) 00:13:47.788 fused_ordering(989) 00:13:47.788 fused_ordering(990) 00:13:47.788 fused_ordering(991) 00:13:47.788 fused_ordering(992) 00:13:47.788 fused_ordering(993) 00:13:47.788 fused_ordering(994) 00:13:47.788 fused_ordering(995) 00:13:47.788 fused_ordering(996) 00:13:47.788 fused_ordering(997) 00:13:47.788 fused_ordering(998) 00:13:47.788 fused_ordering(999) 00:13:47.788 fused_ordering(1000) 00:13:47.788 fused_ordering(1001) 00:13:47.788 fused_ordering(1002) 00:13:47.788 fused_ordering(1003) 00:13:47.788 fused_ordering(1004) 00:13:47.788 fused_ordering(1005) 00:13:47.788 fused_ordering(1006) 00:13:47.788 fused_ordering(1007) 00:13:47.788 fused_ordering(1008) 00:13:47.788 fused_ordering(1009) 00:13:47.789 fused_ordering(1010) 00:13:47.789 fused_ordering(1011) 00:13:47.789 fused_ordering(1012) 00:13:47.789 fused_ordering(1013) 00:13:47.789 fused_ordering(1014) 00:13:47.789 fused_ordering(1015) 00:13:47.789 fused_ordering(1016) 00:13:47.789 fused_ordering(1017) 00:13:47.789 fused_ordering(1018) 00:13:47.789 fused_ordering(1019) 00:13:47.789 fused_ordering(1020) 00:13:47.789 fused_ordering(1021) 00:13:47.789 fused_ordering(1022) 00:13:47.789 fused_ordering(1023) 00:13:47.789 21:03:44 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:47.789 21:03:44 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:47.789 21:03:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:47.789 21:03:44 -- nvmf/common.sh@116 -- # sync 00:13:47.789 21:03:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:47.789 21:03:44 -- nvmf/common.sh@119 -- # set +e 00:13:47.789 21:03:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:47.789 21:03:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:47.789 rmmod nvme_tcp 00:13:47.789 rmmod nvme_fabrics 00:13:48.046 rmmod nvme_keyring 00:13:48.046 21:03:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:48.047 21:03:44 -- nvmf/common.sh@123 -- # set -e 00:13:48.047 21:03:44 -- nvmf/common.sh@124 -- # return 0 00:13:48.047 21:03:44 -- nvmf/common.sh@477 -- # '[' -n 3951590 ']' 00:13:48.047 21:03:44 -- nvmf/common.sh@478 -- # killprocess 3951590 00:13:48.047 21:03:44 -- common/autotest_common.sh@936 -- # '[' -z 3951590 ']' 00:13:48.047 21:03:44 -- common/autotest_common.sh@940 -- # kill -0 3951590 00:13:48.047 21:03:44 -- common/autotest_common.sh@941 -- # uname 00:13:48.047 21:03:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:48.047 21:03:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3951590 00:13:48.047 21:03:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:48.047 21:03:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:48.047 21:03:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3951590' 00:13:48.047 killing process with pid 3951590 00:13:48.047 21:03:44 -- common/autotest_common.sh@955 -- # kill 3951590 00:13:48.047 21:03:44 -- common/autotest_common.sh@960 -- # wait 3951590 00:13:48.305 21:03:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:48.305 21:03:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:48.305 21:03:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:48.305 21:03:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:48.305 21:03:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:48.305 21:03:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.305 21:03:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.305 21:03:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.207 21:03:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:50.207 00:13:50.207 real 0m8.321s 00:13:50.207 user 0m6.070s 00:13:50.207 sys 0m3.236s 00:13:50.207 21:03:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:50.207 21:03:46 -- common/autotest_common.sh@10 -- # set +x 00:13:50.207 ************************************ 00:13:50.207 END TEST nvmf_fused_ordering 00:13:50.207 ************************************ 00:13:50.207 21:03:46 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:50.207 21:03:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:50.207 21:03:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:50.207 21:03:46 -- common/autotest_common.sh@10 -- # set +x 00:13:50.207 ************************************ 00:13:50.207 START TEST nvmf_delete_subsystem 00:13:50.207 ************************************ 00:13:50.207 21:03:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:50.465 * Looking for test storage... 00:13:50.465 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:50.465 21:03:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:50.465 21:03:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:50.465 21:03:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:50.465 21:03:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:50.465 21:03:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:50.465 21:03:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:50.465 21:03:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:50.465 21:03:46 -- scripts/common.sh@335 -- # IFS=.-: 00:13:50.465 21:03:46 -- scripts/common.sh@335 -- # read -ra ver1 00:13:50.465 21:03:46 -- scripts/common.sh@336 -- # IFS=.-: 00:13:50.465 21:03:46 -- scripts/common.sh@336 -- # read -ra ver2 00:13:50.465 21:03:46 -- scripts/common.sh@337 -- # local 'op=<' 00:13:50.465 21:03:46 -- scripts/common.sh@339 -- # ver1_l=2 00:13:50.465 21:03:46 -- scripts/common.sh@340 -- # ver2_l=1 00:13:50.465 21:03:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:50.465 21:03:46 -- scripts/common.sh@343 -- # case "$op" in 00:13:50.465 21:03:46 -- scripts/common.sh@344 -- # : 1 00:13:50.465 21:03:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:50.465 21:03:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:50.465 21:03:46 -- scripts/common.sh@364 -- # decimal 1 00:13:50.465 21:03:46 -- scripts/common.sh@352 -- # local d=1 00:13:50.465 21:03:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:50.465 21:03:46 -- scripts/common.sh@354 -- # echo 1 00:13:50.465 21:03:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:50.465 21:03:46 -- scripts/common.sh@365 -- # decimal 2 00:13:50.465 21:03:46 -- scripts/common.sh@352 -- # local d=2 00:13:50.465 21:03:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:50.465 21:03:46 -- scripts/common.sh@354 -- # echo 2 00:13:50.465 21:03:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:50.465 21:03:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:50.465 21:03:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:50.465 21:03:46 -- scripts/common.sh@367 -- # return 0 00:13:50.465 21:03:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:50.465 21:03:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:50.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.465 --rc genhtml_branch_coverage=1 00:13:50.465 --rc genhtml_function_coverage=1 00:13:50.465 --rc genhtml_legend=1 00:13:50.465 --rc geninfo_all_blocks=1 00:13:50.465 --rc geninfo_unexecuted_blocks=1 00:13:50.465 00:13:50.465 ' 00:13:50.465 21:03:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:50.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.465 --rc genhtml_branch_coverage=1 00:13:50.465 --rc genhtml_function_coverage=1 00:13:50.465 --rc genhtml_legend=1 00:13:50.465 --rc geninfo_all_blocks=1 00:13:50.465 --rc geninfo_unexecuted_blocks=1 00:13:50.465 00:13:50.465 ' 00:13:50.465 21:03:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:50.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.465 --rc genhtml_branch_coverage=1 00:13:50.465 --rc genhtml_function_coverage=1 00:13:50.465 --rc genhtml_legend=1 00:13:50.465 --rc geninfo_all_blocks=1 00:13:50.465 --rc geninfo_unexecuted_blocks=1 00:13:50.465 00:13:50.465 ' 00:13:50.465 21:03:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:50.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.465 --rc genhtml_branch_coverage=1 00:13:50.465 --rc genhtml_function_coverage=1 00:13:50.465 --rc genhtml_legend=1 00:13:50.465 --rc geninfo_all_blocks=1 00:13:50.465 --rc geninfo_unexecuted_blocks=1 00:13:50.465 00:13:50.465 ' 00:13:50.465 21:03:46 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:50.465 21:03:46 -- nvmf/common.sh@7 -- # uname -s 00:13:50.465 21:03:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:50.465 21:03:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:50.465 21:03:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:50.465 21:03:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:50.465 21:03:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:50.465 21:03:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:50.465 21:03:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:50.465 21:03:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:50.465 21:03:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:50.465 21:03:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:50.465 21:03:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.465 21:03:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.465 21:03:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:50.465 21:03:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:50.465 21:03:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:50.465 21:03:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:50.465 21:03:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:50.465 21:03:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:50.465 21:03:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:50.465 21:03:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.465 21:03:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.465 21:03:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.465 21:03:46 -- paths/export.sh@5 -- # export PATH 00:13:50.465 21:03:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.465 21:03:46 -- nvmf/common.sh@46 -- # : 0 00:13:50.465 21:03:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:50.465 21:03:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:50.465 21:03:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:50.465 21:03:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:50.465 21:03:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:50.465 21:03:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:50.465 21:03:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:50.465 21:03:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:50.465 21:03:46 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:50.465 21:03:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:50.466 21:03:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:50.466 21:03:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:50.466 21:03:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:50.466 21:03:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:50.466 21:03:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.466 21:03:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.466 21:03:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.466 21:03:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:50.466 21:03:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:50.466 21:03:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:50.466 21:03:46 -- common/autotest_common.sh@10 -- # set +x 00:13:52.990 21:03:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:52.990 21:03:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:52.990 21:03:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:52.990 21:03:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:52.990 21:03:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:52.990 21:03:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:52.990 21:03:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:52.990 21:03:48 -- nvmf/common.sh@294 -- # net_devs=() 00:13:52.990 21:03:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:52.990 21:03:48 -- nvmf/common.sh@295 -- # e810=() 00:13:52.990 21:03:48 -- nvmf/common.sh@295 -- # local -ga e810 00:13:52.990 21:03:48 -- nvmf/common.sh@296 -- # x722=() 00:13:52.990 21:03:48 -- nvmf/common.sh@296 -- # local -ga x722 00:13:52.990 21:03:48 -- nvmf/common.sh@297 -- # mlx=() 00:13:52.990 21:03:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:52.990 21:03:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:52.990 21:03:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:52.990 21:03:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:52.990 21:03:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.990 21:03:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:52.990 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:52.990 21:03:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.990 21:03:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:52.990 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:52.990 21:03:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.990 21:03:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.990 21:03:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.990 21:03:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:52.990 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:52.990 21:03:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.990 21:03:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.990 21:03:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.990 21:03:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.990 21:03:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:52.990 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:52.990 21:03:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.990 21:03:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:52.990 21:03:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:52.990 21:03:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:52.990 21:03:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:52.990 21:03:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:52.990 21:03:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:52.990 21:03:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:52.990 21:03:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:52.990 21:03:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:52.990 21:03:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:52.990 21:03:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:52.990 21:03:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:52.990 21:03:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:52.990 21:03:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:52.990 21:03:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:52.990 21:03:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:52.990 21:03:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:52.990 21:03:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:52.990 21:03:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:52.990 21:03:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:52.991 21:03:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:52.991 21:03:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:52.991 21:03:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:52.991 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:52.991 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:13:52.991 00:13:52.991 --- 10.0.0.2 ping statistics --- 00:13:52.991 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.991 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:13:52.991 21:03:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:52.991 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:52.991 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:13:52.991 00:13:52.991 --- 10.0.0.1 ping statistics --- 00:13:52.991 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.991 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:13:52.991 21:03:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:52.991 21:03:48 -- nvmf/common.sh@410 -- # return 0 00:13:52.991 21:03:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:52.991 21:03:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:52.991 21:03:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:52.991 21:03:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:52.991 21:03:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:52.991 21:03:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:52.991 21:03:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:52.991 21:03:48 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:52.991 21:03:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:52.991 21:03:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:52.991 21:03:48 -- common/autotest_common.sh@10 -- # set +x 00:13:52.991 21:03:48 -- nvmf/common.sh@469 -- # nvmfpid=3953983 00:13:52.991 21:03:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:52.991 21:03:48 -- nvmf/common.sh@470 -- # waitforlisten 3953983 00:13:52.991 21:03:48 -- common/autotest_common.sh@829 -- # '[' -z 3953983 ']' 00:13:52.991 21:03:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:52.991 21:03:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:52.991 21:03:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:52.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:52.991 21:03:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:52.991 21:03:48 -- common/autotest_common.sh@10 -- # set +x 00:13:52.991 [2024-11-27 21:03:48.840763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:52.991 [2024-11-27 21:03:48.840832] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:52.991 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.991 [2024-11-27 21:03:48.908247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:52.991 [2024-11-27 21:03:49.027747] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:52.991 [2024-11-27 21:03:49.027913] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:52.991 [2024-11-27 21:03:49.027933] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:52.991 [2024-11-27 21:03:49.027947] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:52.991 [2024-11-27 21:03:49.028012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:52.991 [2024-11-27 21:03:49.028017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:53.921 21:03:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:53.921 21:03:49 -- common/autotest_common.sh@862 -- # return 0 00:13:53.921 21:03:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:53.921 21:03:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 21:03:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 [2024-11-27 21:03:49.886030] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 [2024-11-27 21:03:49.902418] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 NULL1 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 Delay0 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.921 21:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.921 21:03:49 -- common/autotest_common.sh@10 -- # set +x 00:13:53.921 21:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@28 -- # perf_pid=3954136 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:53.921 21:03:49 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:53.921 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.921 [2024-11-27 21:03:49.977000] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:55.817 21:03:51 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:55.817 21:03:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.817 21:03:51 -- common/autotest_common.sh@10 -- # set +x 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 [2024-11-27 21:03:52.068108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ef3d0 is same with the state(5) to be set 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.075 starting I/O failed: -6 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 Read completed with error (sct=0, sc=8) 00:13:56.075 [2024-11-27 21:03:52.068842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3e0000c00 is same with the state(5) to be set 00:13:56.075 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Write completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:56.076 Read completed with error (sct=0, sc=8) 00:13:57.009 [2024-11-27 21:03:53.037554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6e8960 is same with the state(5) to be set 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Read completed with error (sct=0, sc=8) 00:13:57.009 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 [2024-11-27 21:03:53.070283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf4c0 is same with the state(5) to be set 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 [2024-11-27 21:03:53.070768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cfa20 is same with the state(5) to be set 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 [2024-11-27 21:03:53.070990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3e000bf20 is same with the state(5) to be set 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 Read completed with error (sct=0, sc=8) 00:13:57.010 Write completed with error (sct=0, sc=8) 00:13:57.010 [2024-11-27 21:03:53.071358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff3e000c480 is same with the state(5) to be set 00:13:57.010 [2024-11-27 21:03:53.072372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6e8960 (9): Bad file descriptor 00:13:57.010 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:57.010 21:03:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.010 21:03:53 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:57.010 21:03:53 -- target/delete_subsystem.sh@35 -- # kill -0 3954136 00:13:57.010 21:03:53 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:57.010 Initializing NVMe Controllers 00:13:57.010 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:57.010 Controller IO queue size 128, less than required. 00:13:57.010 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:57.010 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:57.010 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:57.010 Initialization complete. Launching workers. 00:13:57.010 ======================================================== 00:13:57.010 Latency(us) 00:13:57.010 Device Information : IOPS MiB/s Average min max 00:13:57.010 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 168.71 0.08 932251.50 727.67 2002230.47 00:13:57.010 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 164.24 0.08 939689.00 383.74 2002333.72 00:13:57.010 ======================================================== 00:13:57.010 Total : 332.95 0.16 935920.37 383.74 2002333.72 00:13:57.010 00:13:57.575 21:03:53 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:57.575 21:03:53 -- target/delete_subsystem.sh@35 -- # kill -0 3954136 00:13:57.575 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3954136) - No such process 00:13:57.575 21:03:53 -- target/delete_subsystem.sh@45 -- # NOT wait 3954136 00:13:57.575 21:03:53 -- common/autotest_common.sh@650 -- # local es=0 00:13:57.575 21:03:53 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3954136 00:13:57.575 21:03:53 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:57.575 21:03:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:57.575 21:03:53 -- common/autotest_common.sh@642 -- # type -t wait 00:13:57.575 21:03:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:57.575 21:03:53 -- common/autotest_common.sh@653 -- # wait 3954136 00:13:57.575 21:03:53 -- common/autotest_common.sh@653 -- # es=1 00:13:57.575 21:03:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:57.575 21:03:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:57.575 21:03:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:57.575 21:03:53 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:57.575 21:03:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.575 21:03:53 -- common/autotest_common.sh@10 -- # set +x 00:13:57.575 21:03:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.575 21:03:53 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:57.575 21:03:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.575 21:03:53 -- common/autotest_common.sh@10 -- # set +x 00:13:57.576 [2024-11-27 21:03:53.594950] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:57.576 21:03:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.576 21:03:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.576 21:03:53 -- common/autotest_common.sh@10 -- # set +x 00:13:57.576 21:03:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@54 -- # perf_pid=3954555 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:13:57.576 21:03:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.576 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.576 [2024-11-27 21:03:53.661997] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:58.140 21:03:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:58.140 21:03:54 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:13:58.140 21:03:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:58.397 21:03:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:58.397 21:03:54 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:13:58.397 21:03:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:58.961 21:03:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:58.961 21:03:55 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:13:58.961 21:03:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:59.526 21:03:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:59.526 21:03:55 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:13:59.526 21:03:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.090 21:03:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.090 21:03:56 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:14:00.090 21:03:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.655 21:03:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.655 21:03:56 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:14:00.655 21:03:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.655 Initializing NVMe Controllers 00:14:00.655 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:00.655 Controller IO queue size 128, less than required. 00:14:00.655 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:00.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:00.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:00.655 Initialization complete. Launching workers. 00:14:00.655 ======================================================== 00:14:00.655 Latency(us) 00:14:00.655 Device Information : IOPS MiB/s Average min max 00:14:00.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004630.25 1000164.79 1013960.53 00:14:00.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004465.70 1000206.05 1014252.88 00:14:00.655 ======================================================== 00:14:00.655 Total : 256.00 0.12 1004547.98 1000164.79 1014252.88 00:14:00.655 00:14:00.913 21:03:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.913 21:03:57 -- target/delete_subsystem.sh@57 -- # kill -0 3954555 00:14:00.913 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3954555) - No such process 00:14:00.913 21:03:57 -- target/delete_subsystem.sh@67 -- # wait 3954555 00:14:00.913 21:03:57 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:00.913 21:03:57 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:00.913 21:03:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:00.913 21:03:57 -- nvmf/common.sh@116 -- # sync 00:14:00.913 21:03:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:00.913 21:03:57 -- nvmf/common.sh@119 -- # set +e 00:14:00.913 21:03:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:00.913 21:03:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:00.913 rmmod nvme_tcp 00:14:00.913 rmmod nvme_fabrics 00:14:01.171 rmmod nvme_keyring 00:14:01.171 21:03:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:01.171 21:03:57 -- nvmf/common.sh@123 -- # set -e 00:14:01.171 21:03:57 -- nvmf/common.sh@124 -- # return 0 00:14:01.171 21:03:57 -- nvmf/common.sh@477 -- # '[' -n 3953983 ']' 00:14:01.171 21:03:57 -- nvmf/common.sh@478 -- # killprocess 3953983 00:14:01.171 21:03:57 -- common/autotest_common.sh@936 -- # '[' -z 3953983 ']' 00:14:01.171 21:03:57 -- common/autotest_common.sh@940 -- # kill -0 3953983 00:14:01.171 21:03:57 -- common/autotest_common.sh@941 -- # uname 00:14:01.171 21:03:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:01.171 21:03:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3953983 00:14:01.171 21:03:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:01.171 21:03:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:01.171 21:03:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3953983' 00:14:01.171 killing process with pid 3953983 00:14:01.171 21:03:57 -- common/autotest_common.sh@955 -- # kill 3953983 00:14:01.171 21:03:57 -- common/autotest_common.sh@960 -- # wait 3953983 00:14:01.431 21:03:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:01.431 21:03:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:01.431 21:03:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:01.431 21:03:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:01.431 21:03:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:01.431 21:03:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.431 21:03:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.431 21:03:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.334 21:03:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:03.334 00:14:03.334 real 0m13.089s 00:14:03.334 user 0m29.468s 00:14:03.334 sys 0m2.967s 00:14:03.334 21:03:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:03.334 21:03:59 -- common/autotest_common.sh@10 -- # set +x 00:14:03.334 ************************************ 00:14:03.334 END TEST nvmf_delete_subsystem 00:14:03.334 ************************************ 00:14:03.334 21:03:59 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:03.334 21:03:59 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:03.334 21:03:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:03.334 21:03:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:03.334 21:03:59 -- common/autotest_common.sh@10 -- # set +x 00:14:03.334 ************************************ 00:14:03.334 START TEST nvmf_nvme_cli 00:14:03.334 ************************************ 00:14:03.334 21:03:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:03.593 * Looking for test storage... 00:14:03.593 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:03.593 21:03:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:03.593 21:03:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:03.593 21:03:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:03.593 21:03:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:03.593 21:03:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:03.593 21:03:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:03.593 21:03:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:03.593 21:03:59 -- scripts/common.sh@335 -- # IFS=.-: 00:14:03.593 21:03:59 -- scripts/common.sh@335 -- # read -ra ver1 00:14:03.593 21:03:59 -- scripts/common.sh@336 -- # IFS=.-: 00:14:03.593 21:03:59 -- scripts/common.sh@336 -- # read -ra ver2 00:14:03.593 21:03:59 -- scripts/common.sh@337 -- # local 'op=<' 00:14:03.593 21:03:59 -- scripts/common.sh@339 -- # ver1_l=2 00:14:03.593 21:03:59 -- scripts/common.sh@340 -- # ver2_l=1 00:14:03.593 21:03:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:03.593 21:03:59 -- scripts/common.sh@343 -- # case "$op" in 00:14:03.593 21:03:59 -- scripts/common.sh@344 -- # : 1 00:14:03.593 21:03:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:03.593 21:03:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:03.593 21:03:59 -- scripts/common.sh@364 -- # decimal 1 00:14:03.593 21:03:59 -- scripts/common.sh@352 -- # local d=1 00:14:03.593 21:03:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:03.593 21:03:59 -- scripts/common.sh@354 -- # echo 1 00:14:03.593 21:03:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:03.593 21:03:59 -- scripts/common.sh@365 -- # decimal 2 00:14:03.593 21:03:59 -- scripts/common.sh@352 -- # local d=2 00:14:03.593 21:03:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:03.593 21:03:59 -- scripts/common.sh@354 -- # echo 2 00:14:03.593 21:03:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:03.593 21:03:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:03.593 21:03:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:03.593 21:03:59 -- scripts/common.sh@367 -- # return 0 00:14:03.593 21:03:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:03.593 21:03:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:03.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.593 --rc genhtml_branch_coverage=1 00:14:03.593 --rc genhtml_function_coverage=1 00:14:03.593 --rc genhtml_legend=1 00:14:03.593 --rc geninfo_all_blocks=1 00:14:03.593 --rc geninfo_unexecuted_blocks=1 00:14:03.593 00:14:03.593 ' 00:14:03.593 21:03:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:03.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.593 --rc genhtml_branch_coverage=1 00:14:03.593 --rc genhtml_function_coverage=1 00:14:03.593 --rc genhtml_legend=1 00:14:03.593 --rc geninfo_all_blocks=1 00:14:03.593 --rc geninfo_unexecuted_blocks=1 00:14:03.593 00:14:03.593 ' 00:14:03.593 21:03:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:03.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.593 --rc genhtml_branch_coverage=1 00:14:03.593 --rc genhtml_function_coverage=1 00:14:03.593 --rc genhtml_legend=1 00:14:03.593 --rc geninfo_all_blocks=1 00:14:03.593 --rc geninfo_unexecuted_blocks=1 00:14:03.593 00:14:03.593 ' 00:14:03.593 21:03:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:03.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.593 --rc genhtml_branch_coverage=1 00:14:03.593 --rc genhtml_function_coverage=1 00:14:03.593 --rc genhtml_legend=1 00:14:03.593 --rc geninfo_all_blocks=1 00:14:03.593 --rc geninfo_unexecuted_blocks=1 00:14:03.593 00:14:03.593 ' 00:14:03.593 21:03:59 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:03.593 21:03:59 -- nvmf/common.sh@7 -- # uname -s 00:14:03.593 21:03:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:03.593 21:03:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:03.593 21:03:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:03.593 21:03:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:03.593 21:03:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:03.593 21:03:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:03.593 21:03:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:03.593 21:03:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:03.593 21:03:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:03.593 21:03:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:03.593 21:03:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:03.593 21:03:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:03.593 21:03:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:03.593 21:03:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:03.593 21:03:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:03.593 21:03:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:03.593 21:03:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:03.593 21:03:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:03.593 21:03:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:03.593 21:03:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.593 21:03:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.593 21:03:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.593 21:03:59 -- paths/export.sh@5 -- # export PATH 00:14:03.593 21:03:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.593 21:03:59 -- nvmf/common.sh@46 -- # : 0 00:14:03.593 21:03:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:03.593 21:03:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:03.593 21:03:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:03.593 21:03:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:03.593 21:03:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:03.593 21:03:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:03.593 21:03:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:03.593 21:03:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:03.593 21:03:59 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:03.593 21:03:59 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:03.593 21:03:59 -- target/nvme_cli.sh@14 -- # devs=() 00:14:03.593 21:03:59 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:03.593 21:03:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:03.593 21:03:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:03.593 21:03:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:03.593 21:03:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:03.593 21:03:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:03.593 21:03:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:03.593 21:03:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:03.593 21:03:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.593 21:03:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:03.593 21:03:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:03.593 21:03:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:03.593 21:03:59 -- common/autotest_common.sh@10 -- # set +x 00:14:06.123 21:04:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:06.123 21:04:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:06.123 21:04:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:06.123 21:04:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:06.123 21:04:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:06.123 21:04:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:06.123 21:04:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:06.123 21:04:01 -- nvmf/common.sh@294 -- # net_devs=() 00:14:06.123 21:04:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:06.123 21:04:01 -- nvmf/common.sh@295 -- # e810=() 00:14:06.123 21:04:01 -- nvmf/common.sh@295 -- # local -ga e810 00:14:06.123 21:04:01 -- nvmf/common.sh@296 -- # x722=() 00:14:06.123 21:04:01 -- nvmf/common.sh@296 -- # local -ga x722 00:14:06.123 21:04:01 -- nvmf/common.sh@297 -- # mlx=() 00:14:06.123 21:04:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:06.123 21:04:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:06.123 21:04:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:06.123 21:04:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:06.123 21:04:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:06.123 21:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.123 21:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:06.123 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:06.123 21:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:06.123 21:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:06.123 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:06.123 21:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:06.123 21:04:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:06.123 21:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.123 21:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.123 21:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.123 21:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.123 21:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:06.123 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:06.123 21:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.123 21:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:06.123 21:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:06.123 21:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:06.123 21:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:06.123 21:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:06.123 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:06.124 21:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:06.124 21:04:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:06.124 21:04:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:06.124 21:04:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:06.124 21:04:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:06.124 21:04:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:06.124 21:04:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:06.124 21:04:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:06.124 21:04:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:06.124 21:04:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:06.124 21:04:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:06.124 21:04:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:06.124 21:04:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:06.124 21:04:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:06.124 21:04:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:06.124 21:04:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:06.124 21:04:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:06.124 21:04:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:06.124 21:04:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:06.124 21:04:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:06.124 21:04:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:06.124 21:04:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:06.124 21:04:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:06.124 21:04:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:06.124 21:04:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:06.124 21:04:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:06.124 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:06.124 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:14:06.124 00:14:06.124 --- 10.0.0.2 ping statistics --- 00:14:06.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.124 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:14:06.124 21:04:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:06.124 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:06.124 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:14:06.124 00:14:06.124 --- 10.0.0.1 ping statistics --- 00:14:06.124 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.124 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:06.124 21:04:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:06.124 21:04:02 -- nvmf/common.sh@410 -- # return 0 00:14:06.124 21:04:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:06.124 21:04:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:06.124 21:04:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:06.124 21:04:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:06.124 21:04:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:06.124 21:04:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:06.124 21:04:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:06.124 21:04:02 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:06.124 21:04:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:06.124 21:04:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:06.124 21:04:02 -- common/autotest_common.sh@10 -- # set +x 00:14:06.124 21:04:02 -- nvmf/common.sh@469 -- # nvmfpid=3957042 00:14:06.124 21:04:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:06.124 21:04:02 -- nvmf/common.sh@470 -- # waitforlisten 3957042 00:14:06.124 21:04:02 -- common/autotest_common.sh@829 -- # '[' -z 3957042 ']' 00:14:06.124 21:04:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:06.124 21:04:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:06.124 21:04:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:06.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:06.124 21:04:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:06.124 21:04:02 -- common/autotest_common.sh@10 -- # set +x 00:14:06.124 [2024-11-27 21:04:02.078557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:06.124 [2024-11-27 21:04:02.078620] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:06.124 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.124 [2024-11-27 21:04:02.143112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:06.124 [2024-11-27 21:04:02.258798] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:06.124 [2024-11-27 21:04:02.258965] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:06.124 [2024-11-27 21:04:02.259002] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:06.124 [2024-11-27 21:04:02.259015] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:06.124 [2024-11-27 21:04:02.259101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:06.124 [2024-11-27 21:04:02.259165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:06.124 [2024-11-27 21:04:02.259167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:06.124 [2024-11-27 21:04:02.259137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:07.057 21:04:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:07.057 21:04:03 -- common/autotest_common.sh@862 -- # return 0 00:14:07.057 21:04:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:07.057 21:04:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 21:04:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:07.057 21:04:03 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 [2024-11-27 21:04:03.067033] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 Malloc0 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 Malloc1 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 [2024-11-27 21:04:03.148142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:07.057 21:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.057 21:04:03 -- common/autotest_common.sh@10 -- # set +x 00:14:07.057 21:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.057 21:04:03 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:07.315 00:14:07.315 Discovery Log Number of Records 2, Generation counter 2 00:14:07.315 =====Discovery Log Entry 0====== 00:14:07.315 trtype: tcp 00:14:07.315 adrfam: ipv4 00:14:07.315 subtype: current discovery subsystem 00:14:07.315 treq: not required 00:14:07.315 portid: 0 00:14:07.315 trsvcid: 4420 00:14:07.315 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:07.315 traddr: 10.0.0.2 00:14:07.315 eflags: explicit discovery connections, duplicate discovery information 00:14:07.315 sectype: none 00:14:07.315 =====Discovery Log Entry 1====== 00:14:07.315 trtype: tcp 00:14:07.315 adrfam: ipv4 00:14:07.315 subtype: nvme subsystem 00:14:07.315 treq: not required 00:14:07.315 portid: 0 00:14:07.315 trsvcid: 4420 00:14:07.315 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:07.315 traddr: 10.0.0.2 00:14:07.315 eflags: none 00:14:07.315 sectype: none 00:14:07.315 21:04:03 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:07.315 21:04:03 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:07.315 21:04:03 -- nvmf/common.sh@510 -- # local dev _ 00:14:07.315 21:04:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.315 21:04:03 -- nvmf/common.sh@509 -- # nvme list 00:14:07.315 21:04:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:07.315 21:04:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.315 21:04:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:07.315 21:04:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.315 21:04:03 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:07.315 21:04:03 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:07.880 21:04:04 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:07.880 21:04:04 -- common/autotest_common.sh@1187 -- # local i=0 00:14:07.880 21:04:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:07.880 21:04:04 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:07.880 21:04:04 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:07.880 21:04:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:10.410 21:04:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:10.410 21:04:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:10.410 21:04:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:10.410 21:04:06 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:10.410 21:04:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:10.410 21:04:06 -- common/autotest_common.sh@1197 -- # return 0 00:14:10.410 21:04:06 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:10.410 21:04:06 -- nvmf/common.sh@510 -- # local dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@509 -- # nvme list 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:10.410 /dev/nvme0n2 ]] 00:14:10.410 21:04:06 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:10.410 21:04:06 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:10.410 21:04:06 -- nvmf/common.sh@510 -- # local dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@509 -- # nvme list 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:10.410 21:04:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:10.410 21:04:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:10.410 21:04:06 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:10.410 21:04:06 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:10.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:10.410 21:04:06 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:10.410 21:04:06 -- common/autotest_common.sh@1208 -- # local i=0 00:14:10.410 21:04:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:10.410 21:04:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:10.410 21:04:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:10.411 21:04:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:10.411 21:04:06 -- common/autotest_common.sh@1220 -- # return 0 00:14:10.411 21:04:06 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:10.411 21:04:06 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:10.411 21:04:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.411 21:04:06 -- common/autotest_common.sh@10 -- # set +x 00:14:10.411 21:04:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.411 21:04:06 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:10.411 21:04:06 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:10.411 21:04:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:10.411 21:04:06 -- nvmf/common.sh@116 -- # sync 00:14:10.411 21:04:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:10.411 21:04:06 -- nvmf/common.sh@119 -- # set +e 00:14:10.411 21:04:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:10.411 21:04:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:10.411 rmmod nvme_tcp 00:14:10.411 rmmod nvme_fabrics 00:14:10.411 rmmod nvme_keyring 00:14:10.411 21:04:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:10.411 21:04:06 -- nvmf/common.sh@123 -- # set -e 00:14:10.411 21:04:06 -- nvmf/common.sh@124 -- # return 0 00:14:10.411 21:04:06 -- nvmf/common.sh@477 -- # '[' -n 3957042 ']' 00:14:10.411 21:04:06 -- nvmf/common.sh@478 -- # killprocess 3957042 00:14:10.411 21:04:06 -- common/autotest_common.sh@936 -- # '[' -z 3957042 ']' 00:14:10.411 21:04:06 -- common/autotest_common.sh@940 -- # kill -0 3957042 00:14:10.411 21:04:06 -- common/autotest_common.sh@941 -- # uname 00:14:10.411 21:04:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:10.411 21:04:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3957042 00:14:10.411 21:04:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:10.411 21:04:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:10.411 21:04:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3957042' 00:14:10.411 killing process with pid 3957042 00:14:10.411 21:04:06 -- common/autotest_common.sh@955 -- # kill 3957042 00:14:10.411 21:04:06 -- common/autotest_common.sh@960 -- # wait 3957042 00:14:10.411 21:04:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:10.411 21:04:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:10.411 21:04:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:10.411 21:04:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:10.411 21:04:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:10.411 21:04:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.411 21:04:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.411 21:04:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.995 21:04:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:12.995 00:14:12.995 real 0m9.082s 00:14:12.995 user 0m17.949s 00:14:12.995 sys 0m2.337s 00:14:12.995 21:04:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:12.995 21:04:08 -- common/autotest_common.sh@10 -- # set +x 00:14:12.995 ************************************ 00:14:12.995 END TEST nvmf_nvme_cli 00:14:12.995 ************************************ 00:14:12.995 21:04:08 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:12.995 21:04:08 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:12.995 21:04:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:12.995 21:04:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.995 21:04:08 -- common/autotest_common.sh@10 -- # set +x 00:14:12.995 ************************************ 00:14:12.995 START TEST nvmf_host_management 00:14:12.995 ************************************ 00:14:12.995 21:04:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:12.995 * Looking for test storage... 00:14:12.995 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:12.995 21:04:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:12.995 21:04:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:12.995 21:04:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:12.995 21:04:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:12.995 21:04:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:12.995 21:04:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:12.995 21:04:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:12.995 21:04:08 -- scripts/common.sh@335 -- # IFS=.-: 00:14:12.995 21:04:08 -- scripts/common.sh@335 -- # read -ra ver1 00:14:12.995 21:04:08 -- scripts/common.sh@336 -- # IFS=.-: 00:14:12.995 21:04:08 -- scripts/common.sh@336 -- # read -ra ver2 00:14:12.995 21:04:08 -- scripts/common.sh@337 -- # local 'op=<' 00:14:12.995 21:04:08 -- scripts/common.sh@339 -- # ver1_l=2 00:14:12.995 21:04:08 -- scripts/common.sh@340 -- # ver2_l=1 00:14:12.995 21:04:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:12.995 21:04:08 -- scripts/common.sh@343 -- # case "$op" in 00:14:12.995 21:04:08 -- scripts/common.sh@344 -- # : 1 00:14:12.995 21:04:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:12.995 21:04:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:12.995 21:04:08 -- scripts/common.sh@364 -- # decimal 1 00:14:12.995 21:04:08 -- scripts/common.sh@352 -- # local d=1 00:14:12.996 21:04:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:12.996 21:04:08 -- scripts/common.sh@354 -- # echo 1 00:14:12.996 21:04:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:12.996 21:04:08 -- scripts/common.sh@365 -- # decimal 2 00:14:12.996 21:04:08 -- scripts/common.sh@352 -- # local d=2 00:14:12.996 21:04:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:12.996 21:04:08 -- scripts/common.sh@354 -- # echo 2 00:14:12.996 21:04:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:12.996 21:04:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:12.996 21:04:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:12.996 21:04:08 -- scripts/common.sh@367 -- # return 0 00:14:12.996 21:04:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:12.996 21:04:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.996 --rc genhtml_branch_coverage=1 00:14:12.996 --rc genhtml_function_coverage=1 00:14:12.996 --rc genhtml_legend=1 00:14:12.996 --rc geninfo_all_blocks=1 00:14:12.996 --rc geninfo_unexecuted_blocks=1 00:14:12.996 00:14:12.996 ' 00:14:12.996 21:04:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.996 --rc genhtml_branch_coverage=1 00:14:12.996 --rc genhtml_function_coverage=1 00:14:12.996 --rc genhtml_legend=1 00:14:12.996 --rc geninfo_all_blocks=1 00:14:12.996 --rc geninfo_unexecuted_blocks=1 00:14:12.996 00:14:12.996 ' 00:14:12.996 21:04:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.996 --rc genhtml_branch_coverage=1 00:14:12.996 --rc genhtml_function_coverage=1 00:14:12.996 --rc genhtml_legend=1 00:14:12.996 --rc geninfo_all_blocks=1 00:14:12.996 --rc geninfo_unexecuted_blocks=1 00:14:12.996 00:14:12.996 ' 00:14:12.996 21:04:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:12.996 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.996 --rc genhtml_branch_coverage=1 00:14:12.996 --rc genhtml_function_coverage=1 00:14:12.996 --rc genhtml_legend=1 00:14:12.996 --rc geninfo_all_blocks=1 00:14:12.996 --rc geninfo_unexecuted_blocks=1 00:14:12.996 00:14:12.996 ' 00:14:12.996 21:04:08 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:12.996 21:04:08 -- nvmf/common.sh@7 -- # uname -s 00:14:12.996 21:04:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:12.996 21:04:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:12.996 21:04:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:12.996 21:04:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:12.996 21:04:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:12.996 21:04:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:12.996 21:04:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:12.996 21:04:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:12.996 21:04:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:12.996 21:04:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:12.996 21:04:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.996 21:04:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.996 21:04:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:12.996 21:04:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:12.996 21:04:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:12.996 21:04:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:12.996 21:04:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:12.996 21:04:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:12.996 21:04:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:12.996 21:04:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.996 21:04:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.996 21:04:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.996 21:04:08 -- paths/export.sh@5 -- # export PATH 00:14:12.996 21:04:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.996 21:04:08 -- nvmf/common.sh@46 -- # : 0 00:14:12.996 21:04:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:12.996 21:04:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:12.996 21:04:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:12.996 21:04:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:12.996 21:04:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:12.996 21:04:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:12.996 21:04:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:12.996 21:04:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:12.996 21:04:08 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:12.996 21:04:08 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:12.996 21:04:08 -- target/host_management.sh@104 -- # nvmftestinit 00:14:12.996 21:04:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:12.996 21:04:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:12.996 21:04:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:12.996 21:04:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:12.996 21:04:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:12.996 21:04:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.996 21:04:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.996 21:04:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.996 21:04:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:12.996 21:04:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:12.996 21:04:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:12.996 21:04:08 -- common/autotest_common.sh@10 -- # set +x 00:14:14.895 21:04:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:14.895 21:04:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:14.895 21:04:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:14.895 21:04:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:14.895 21:04:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:14.895 21:04:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:14.895 21:04:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:14.895 21:04:10 -- nvmf/common.sh@294 -- # net_devs=() 00:14:14.895 21:04:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:14.895 21:04:10 -- nvmf/common.sh@295 -- # e810=() 00:14:14.895 21:04:10 -- nvmf/common.sh@295 -- # local -ga e810 00:14:14.895 21:04:10 -- nvmf/common.sh@296 -- # x722=() 00:14:14.895 21:04:10 -- nvmf/common.sh@296 -- # local -ga x722 00:14:14.895 21:04:10 -- nvmf/common.sh@297 -- # mlx=() 00:14:14.895 21:04:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:14.895 21:04:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:14.895 21:04:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:14.895 21:04:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:14.895 21:04:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:14.895 21:04:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.895 21:04:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:14.895 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:14.895 21:04:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.895 21:04:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.895 21:04:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:14.896 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:14.896 21:04:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:14.896 21:04:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.896 21:04:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.896 21:04:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.896 21:04:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.896 21:04:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:14.896 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:14.896 21:04:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.896 21:04:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.896 21:04:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.896 21:04:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.896 21:04:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.896 21:04:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:14.896 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:14.896 21:04:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.896 21:04:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:14.896 21:04:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:14.896 21:04:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:14.896 21:04:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:14.896 21:04:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:14.896 21:04:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:14.896 21:04:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:14.896 21:04:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:14.896 21:04:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:14.896 21:04:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:14.896 21:04:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:14.896 21:04:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:14.896 21:04:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.896 21:04:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.896 21:04:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.896 21:04:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.896 21:04:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.896 21:04:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.896 21:04:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.896 21:04:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.896 21:04:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.896 21:04:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.896 21:04:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.896 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.896 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:14:14.896 00:14:14.896 --- 10.0.0.2 ping statistics --- 00:14:14.896 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.896 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:14:14.896 21:04:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.896 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.896 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:14:14.896 00:14:14.896 --- 10.0.0.1 ping statistics --- 00:14:14.896 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.896 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:14:14.896 21:04:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.896 21:04:10 -- nvmf/common.sh@410 -- # return 0 00:14:14.896 21:04:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.896 21:04:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.896 21:04:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.896 21:04:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.896 21:04:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.896 21:04:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.896 21:04:10 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:14.896 21:04:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:14.896 21:04:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:14.896 21:04:10 -- common/autotest_common.sh@10 -- # set +x 00:14:14.896 ************************************ 00:14:14.896 START TEST nvmf_host_management 00:14:14.896 ************************************ 00:14:14.896 21:04:10 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:14.896 21:04:10 -- target/host_management.sh@69 -- # starttarget 00:14:14.896 21:04:10 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:14.896 21:04:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.896 21:04:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:14.896 21:04:10 -- common/autotest_common.sh@10 -- # set +x 00:14:14.896 21:04:10 -- nvmf/common.sh@469 -- # nvmfpid=3959590 00:14:14.896 21:04:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:14.896 21:04:10 -- nvmf/common.sh@470 -- # waitforlisten 3959590 00:14:14.896 21:04:10 -- common/autotest_common.sh@829 -- # '[' -z 3959590 ']' 00:14:14.896 21:04:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.896 21:04:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:14.896 21:04:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.896 21:04:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:14.896 21:04:10 -- common/autotest_common.sh@10 -- # set +x 00:14:14.896 [2024-11-27 21:04:11.022310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.896 [2024-11-27 21:04:11.022410] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.896 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.896 [2024-11-27 21:04:11.091450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:15.154 [2024-11-27 21:04:11.210782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:15.154 [2024-11-27 21:04:11.210956] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:15.154 [2024-11-27 21:04:11.210975] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:15.154 [2024-11-27 21:04:11.210990] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:15.154 [2024-11-27 21:04:11.211092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:15.154 [2024-11-27 21:04:11.211149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:15.154 [2024-11-27 21:04:11.211203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:15.154 [2024-11-27 21:04:11.211205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:16.087 21:04:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:16.087 21:04:11 -- common/autotest_common.sh@862 -- # return 0 00:14:16.087 21:04:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:16.087 21:04:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:16.087 21:04:11 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 21:04:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:16.087 21:04:12 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:16.087 21:04:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.087 21:04:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 [2024-11-27 21:04:12.013048] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:16.087 21:04:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.087 21:04:12 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:16.087 21:04:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:16.087 21:04:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 21:04:12 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:16.087 21:04:12 -- target/host_management.sh@23 -- # cat 00:14:16.087 21:04:12 -- target/host_management.sh@30 -- # rpc_cmd 00:14:16.087 21:04:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.087 21:04:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 Malloc0 00:14:16.087 [2024-11-27 21:04:12.074089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:16.087 21:04:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.087 21:04:12 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:16.087 21:04:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:16.087 21:04:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 21:04:12 -- target/host_management.sh@73 -- # perfpid=3959769 00:14:16.087 21:04:12 -- target/host_management.sh@74 -- # waitforlisten 3959769 /var/tmp/bdevperf.sock 00:14:16.087 21:04:12 -- common/autotest_common.sh@829 -- # '[' -z 3959769 ']' 00:14:16.087 21:04:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:16.087 21:04:12 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:16.087 21:04:12 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:16.087 21:04:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:16.087 21:04:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:16.087 21:04:12 -- nvmf/common.sh@520 -- # config=() 00:14:16.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:16.087 21:04:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:16.087 21:04:12 -- nvmf/common.sh@520 -- # local subsystem config 00:14:16.087 21:04:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.087 21:04:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:16.087 21:04:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:16.087 { 00:14:16.087 "params": { 00:14:16.087 "name": "Nvme$subsystem", 00:14:16.087 "trtype": "$TEST_TRANSPORT", 00:14:16.087 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:16.087 "adrfam": "ipv4", 00:14:16.087 "trsvcid": "$NVMF_PORT", 00:14:16.087 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:16.087 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:16.087 "hdgst": ${hdgst:-false}, 00:14:16.087 "ddgst": ${ddgst:-false} 00:14:16.087 }, 00:14:16.087 "method": "bdev_nvme_attach_controller" 00:14:16.087 } 00:14:16.087 EOF 00:14:16.087 )") 00:14:16.087 21:04:12 -- nvmf/common.sh@542 -- # cat 00:14:16.087 21:04:12 -- nvmf/common.sh@544 -- # jq . 00:14:16.087 21:04:12 -- nvmf/common.sh@545 -- # IFS=, 00:14:16.087 21:04:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:16.087 "params": { 00:14:16.087 "name": "Nvme0", 00:14:16.087 "trtype": "tcp", 00:14:16.087 "traddr": "10.0.0.2", 00:14:16.087 "adrfam": "ipv4", 00:14:16.087 "trsvcid": "4420", 00:14:16.087 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:16.087 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:16.087 "hdgst": false, 00:14:16.087 "ddgst": false 00:14:16.087 }, 00:14:16.087 "method": "bdev_nvme_attach_controller" 00:14:16.087 }' 00:14:16.087 [2024-11-27 21:04:12.149880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:16.088 [2024-11-27 21:04:12.149964] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3959769 ] 00:14:16.088 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.088 [2024-11-27 21:04:12.209443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:16.088 [2024-11-27 21:04:12.318017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:16.653 Running I/O for 10 seconds... 00:14:16.911 21:04:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:16.911 21:04:13 -- common/autotest_common.sh@862 -- # return 0 00:14:16.911 21:04:13 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:16.911 21:04:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.911 21:04:13 -- common/autotest_common.sh@10 -- # set +x 00:14:16.911 21:04:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.911 21:04:13 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:16.911 21:04:13 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:16.911 21:04:13 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:16.911 21:04:13 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:16.911 21:04:13 -- target/host_management.sh@52 -- # local ret=1 00:14:16.911 21:04:13 -- target/host_management.sh@53 -- # local i 00:14:16.911 21:04:13 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:16.911 21:04:13 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:16.911 21:04:13 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:16.911 21:04:13 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:16.911 21:04:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.911 21:04:13 -- common/autotest_common.sh@10 -- # set +x 00:14:16.911 21:04:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.170 21:04:13 -- target/host_management.sh@55 -- # read_io_count=1691 00:14:17.170 21:04:13 -- target/host_management.sh@58 -- # '[' 1691 -ge 100 ']' 00:14:17.170 21:04:13 -- target/host_management.sh@59 -- # ret=0 00:14:17.170 21:04:13 -- target/host_management.sh@60 -- # break 00:14:17.170 21:04:13 -- target/host_management.sh@64 -- # return 0 00:14:17.170 21:04:13 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:17.170 21:04:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.170 21:04:13 -- common/autotest_common.sh@10 -- # set +x 00:14:17.170 [2024-11-27 21:04:13.173919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.170 [2024-11-27 21:04:13.174113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a4ae60 is same with the state(5) to be set 00:14:17.171 [2024-11-27 21:04:13.174728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:103296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:103424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:103680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:103808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:103936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:97408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.174978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:104064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.174991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:97664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:97792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:97920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:98304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:104192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:98432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:104320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:104448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:104576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:104704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:104832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:104960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:98816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.171 [2024-11-27 21:04:13.175348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.171 [2024-11-27 21:04:13.175363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:105088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:105216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:98944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:99200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:99456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:105344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:105472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:105600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:99712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:105728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:105856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:105984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:106112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:106240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:99968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:106368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:100096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:100224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:100480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:100608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.175975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.175990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:100736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:106496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:106624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:106752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:100864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:100992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:101120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:101248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:101376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:101504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:101632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:101760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:106880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:107008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:107136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:107264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:101888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:102400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:102528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.172 [2024-11-27 21:04:13.176539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:102784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.172 [2024-11-27 21:04:13.176555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.173 [2024-11-27 21:04:13.176570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:102912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.173 [2024-11-27 21:04:13.176583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.173 [2024-11-27 21:04:13.176598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:107392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.173 [2024-11-27 21:04:13.176612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.173 [2024-11-27 21:04:13.176626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:107520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.173 [2024-11-27 21:04:13.176639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.173 [2024-11-27 21:04:13.176654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:107648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:17.173 [2024-11-27 21:04:13.176667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:17.173 [2024-11-27 21:04:13.176757] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x703030 was disconnected and freed. reset controller. 00:14:17.173 [2024-11-27 21:04:13.177953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:17.173 21:04:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.173 21:04:13 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:17.173 21:04:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.173 21:04:13 -- common/autotest_common.sh@10 -- # set +x 00:14:17.173 task offset: 103296 on job bdev=Nvme0n1 fails 00:14:17.173 00:14:17.173 Latency(us) 00:14:17.173 [2024-11-27T20:04:13.414Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:17.173 [2024-11-27T20:04:13.414Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:17.173 [2024-11-27T20:04:13.414Z] Job: Nvme0n1 ended in about 0.48 seconds with error 00:14:17.173 Verification LBA range: start 0x0 length 0x400 00:14:17.173 Nvme0n1 : 0.48 3776.26 236.02 134.12 0.00 16086.33 2487.94 21554.06 00:14:17.173 [2024-11-27T20:04:13.414Z] =================================================================================================================== 00:14:17.173 [2024-11-27T20:04:13.414Z] Total : 3776.26 236.02 134.12 0.00 16086.33 2487.94 21554.06 00:14:17.173 [2024-11-27 21:04:13.179881] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:17.173 [2024-11-27 21:04:13.179923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x705160 (9): Bad file descriptor 00:14:17.173 21:04:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.173 21:04:13 -- target/host_management.sh@87 -- # sleep 1 00:14:17.173 [2024-11-27 21:04:13.230678] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:18.105 21:04:14 -- target/host_management.sh@91 -- # kill -9 3959769 00:14:18.105 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3959769) - No such process 00:14:18.105 21:04:14 -- target/host_management.sh@91 -- # true 00:14:18.105 21:04:14 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:18.105 21:04:14 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:18.105 21:04:14 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:18.105 21:04:14 -- nvmf/common.sh@520 -- # config=() 00:14:18.105 21:04:14 -- nvmf/common.sh@520 -- # local subsystem config 00:14:18.105 21:04:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:18.105 21:04:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:18.105 { 00:14:18.105 "params": { 00:14:18.105 "name": "Nvme$subsystem", 00:14:18.105 "trtype": "$TEST_TRANSPORT", 00:14:18.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:18.105 "adrfam": "ipv4", 00:14:18.105 "trsvcid": "$NVMF_PORT", 00:14:18.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:18.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:18.105 "hdgst": ${hdgst:-false}, 00:14:18.105 "ddgst": ${ddgst:-false} 00:14:18.105 }, 00:14:18.105 "method": "bdev_nvme_attach_controller" 00:14:18.105 } 00:14:18.105 EOF 00:14:18.105 )") 00:14:18.105 21:04:14 -- nvmf/common.sh@542 -- # cat 00:14:18.105 21:04:14 -- nvmf/common.sh@544 -- # jq . 00:14:18.105 21:04:14 -- nvmf/common.sh@545 -- # IFS=, 00:14:18.105 21:04:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:18.105 "params": { 00:14:18.105 "name": "Nvme0", 00:14:18.105 "trtype": "tcp", 00:14:18.105 "traddr": "10.0.0.2", 00:14:18.105 "adrfam": "ipv4", 00:14:18.105 "trsvcid": "4420", 00:14:18.105 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:18.105 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:18.105 "hdgst": false, 00:14:18.105 "ddgst": false 00:14:18.105 }, 00:14:18.105 "method": "bdev_nvme_attach_controller" 00:14:18.105 }' 00:14:18.105 [2024-11-27 21:04:14.231010] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:18.105 [2024-11-27 21:04:14.231102] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3960053 ] 00:14:18.105 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.105 [2024-11-27 21:04:14.290769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:18.363 [2024-11-27 21:04:14.397174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:18.621 Running I/O for 1 seconds... 00:14:19.556 00:14:19.556 Latency(us) 00:14:19.556 [2024-11-27T20:04:15.797Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:19.556 [2024-11-27T20:04:15.797Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:19.556 Verification LBA range: start 0x0 length 0x400 00:14:19.556 Nvme0n1 : 1.05 3838.86 239.93 0.00 0.00 15773.20 4150.61 44467.39 00:14:19.556 [2024-11-27T20:04:15.797Z] =================================================================================================================== 00:14:19.556 [2024-11-27T20:04:15.797Z] Total : 3838.86 239.93 0.00 0.00 15773.20 4150.61 44467.39 00:14:19.813 21:04:15 -- target/host_management.sh@101 -- # stoptarget 00:14:19.813 21:04:15 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:19.813 21:04:15 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:19.813 21:04:15 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:19.813 21:04:15 -- target/host_management.sh@40 -- # nvmftestfini 00:14:19.813 21:04:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:19.813 21:04:15 -- nvmf/common.sh@116 -- # sync 00:14:19.813 21:04:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:19.814 21:04:15 -- nvmf/common.sh@119 -- # set +e 00:14:19.814 21:04:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:19.814 21:04:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:19.814 rmmod nvme_tcp 00:14:19.814 rmmod nvme_fabrics 00:14:19.814 rmmod nvme_keyring 00:14:19.814 21:04:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:19.814 21:04:15 -- nvmf/common.sh@123 -- # set -e 00:14:19.814 21:04:15 -- nvmf/common.sh@124 -- # return 0 00:14:19.814 21:04:15 -- nvmf/common.sh@477 -- # '[' -n 3959590 ']' 00:14:19.814 21:04:15 -- nvmf/common.sh@478 -- # killprocess 3959590 00:14:19.814 21:04:15 -- common/autotest_common.sh@936 -- # '[' -z 3959590 ']' 00:14:19.814 21:04:15 -- common/autotest_common.sh@940 -- # kill -0 3959590 00:14:19.814 21:04:15 -- common/autotest_common.sh@941 -- # uname 00:14:19.814 21:04:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:19.814 21:04:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3959590 00:14:19.814 21:04:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:19.814 21:04:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:19.814 21:04:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3959590' 00:14:19.814 killing process with pid 3959590 00:14:19.814 21:04:16 -- common/autotest_common.sh@955 -- # kill 3959590 00:14:19.814 21:04:16 -- common/autotest_common.sh@960 -- # wait 3959590 00:14:20.072 [2024-11-27 21:04:16.289247] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:20.330 21:04:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:20.330 21:04:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:20.330 21:04:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:20.330 21:04:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:20.330 21:04:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:20.330 21:04:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.330 21:04:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:20.330 21:04:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:22.230 21:04:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:22.230 00:14:22.230 real 0m7.382s 00:14:22.230 user 0m22.580s 00:14:22.230 sys 0m1.513s 00:14:22.230 21:04:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:22.230 21:04:18 -- common/autotest_common.sh@10 -- # set +x 00:14:22.230 ************************************ 00:14:22.230 END TEST nvmf_host_management 00:14:22.230 ************************************ 00:14:22.230 21:04:18 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:22.230 00:14:22.230 real 0m9.713s 00:14:22.230 user 0m23.478s 00:14:22.230 sys 0m2.981s 00:14:22.230 21:04:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:22.230 21:04:18 -- common/autotest_common.sh@10 -- # set +x 00:14:22.230 ************************************ 00:14:22.230 END TEST nvmf_host_management 00:14:22.230 ************************************ 00:14:22.230 21:04:18 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:22.230 21:04:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:22.230 21:04:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:22.230 21:04:18 -- common/autotest_common.sh@10 -- # set +x 00:14:22.230 ************************************ 00:14:22.230 START TEST nvmf_lvol 00:14:22.230 ************************************ 00:14:22.230 21:04:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:22.230 * Looking for test storage... 00:14:22.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:22.230 21:04:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:22.230 21:04:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:22.230 21:04:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:22.488 21:04:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:22.489 21:04:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:22.489 21:04:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:22.489 21:04:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:22.489 21:04:18 -- scripts/common.sh@335 -- # IFS=.-: 00:14:22.489 21:04:18 -- scripts/common.sh@335 -- # read -ra ver1 00:14:22.489 21:04:18 -- scripts/common.sh@336 -- # IFS=.-: 00:14:22.489 21:04:18 -- scripts/common.sh@336 -- # read -ra ver2 00:14:22.489 21:04:18 -- scripts/common.sh@337 -- # local 'op=<' 00:14:22.489 21:04:18 -- scripts/common.sh@339 -- # ver1_l=2 00:14:22.489 21:04:18 -- scripts/common.sh@340 -- # ver2_l=1 00:14:22.489 21:04:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:22.489 21:04:18 -- scripts/common.sh@343 -- # case "$op" in 00:14:22.489 21:04:18 -- scripts/common.sh@344 -- # : 1 00:14:22.489 21:04:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:22.489 21:04:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:22.489 21:04:18 -- scripts/common.sh@364 -- # decimal 1 00:14:22.489 21:04:18 -- scripts/common.sh@352 -- # local d=1 00:14:22.489 21:04:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:22.489 21:04:18 -- scripts/common.sh@354 -- # echo 1 00:14:22.489 21:04:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:22.489 21:04:18 -- scripts/common.sh@365 -- # decimal 2 00:14:22.489 21:04:18 -- scripts/common.sh@352 -- # local d=2 00:14:22.489 21:04:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:22.489 21:04:18 -- scripts/common.sh@354 -- # echo 2 00:14:22.489 21:04:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:22.489 21:04:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:22.489 21:04:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:22.489 21:04:18 -- scripts/common.sh@367 -- # return 0 00:14:22.489 21:04:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:22.489 21:04:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:22.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:22.489 --rc genhtml_branch_coverage=1 00:14:22.489 --rc genhtml_function_coverage=1 00:14:22.489 --rc genhtml_legend=1 00:14:22.489 --rc geninfo_all_blocks=1 00:14:22.489 --rc geninfo_unexecuted_blocks=1 00:14:22.489 00:14:22.489 ' 00:14:22.489 21:04:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:22.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:22.489 --rc genhtml_branch_coverage=1 00:14:22.489 --rc genhtml_function_coverage=1 00:14:22.489 --rc genhtml_legend=1 00:14:22.489 --rc geninfo_all_blocks=1 00:14:22.489 --rc geninfo_unexecuted_blocks=1 00:14:22.489 00:14:22.489 ' 00:14:22.489 21:04:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:22.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:22.489 --rc genhtml_branch_coverage=1 00:14:22.489 --rc genhtml_function_coverage=1 00:14:22.489 --rc genhtml_legend=1 00:14:22.489 --rc geninfo_all_blocks=1 00:14:22.489 --rc geninfo_unexecuted_blocks=1 00:14:22.489 00:14:22.489 ' 00:14:22.489 21:04:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:22.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:22.489 --rc genhtml_branch_coverage=1 00:14:22.489 --rc genhtml_function_coverage=1 00:14:22.489 --rc genhtml_legend=1 00:14:22.489 --rc geninfo_all_blocks=1 00:14:22.489 --rc geninfo_unexecuted_blocks=1 00:14:22.489 00:14:22.489 ' 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:22.489 21:04:18 -- nvmf/common.sh@7 -- # uname -s 00:14:22.489 21:04:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:22.489 21:04:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:22.489 21:04:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:22.489 21:04:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:22.489 21:04:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:22.489 21:04:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:22.489 21:04:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:22.489 21:04:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:22.489 21:04:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:22.489 21:04:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:22.489 21:04:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:22.489 21:04:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:22.489 21:04:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:22.489 21:04:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:22.489 21:04:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:22.489 21:04:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:22.489 21:04:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:22.489 21:04:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:22.489 21:04:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:22.489 21:04:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.489 21:04:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.489 21:04:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.489 21:04:18 -- paths/export.sh@5 -- # export PATH 00:14:22.489 21:04:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.489 21:04:18 -- nvmf/common.sh@46 -- # : 0 00:14:22.489 21:04:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:22.489 21:04:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:22.489 21:04:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:22.489 21:04:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:22.489 21:04:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:22.489 21:04:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:22.489 21:04:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:22.489 21:04:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:22.489 21:04:18 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:22.489 21:04:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:22.489 21:04:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:22.489 21:04:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:22.489 21:04:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:22.489 21:04:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:22.489 21:04:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:22.489 21:04:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:22.489 21:04:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:22.489 21:04:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:22.489 21:04:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:22.489 21:04:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:22.489 21:04:18 -- common/autotest_common.sh@10 -- # set +x 00:14:24.386 21:04:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:24.386 21:04:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:24.386 21:04:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:24.386 21:04:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:24.386 21:04:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:24.386 21:04:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:24.386 21:04:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:24.386 21:04:20 -- nvmf/common.sh@294 -- # net_devs=() 00:14:24.386 21:04:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:24.386 21:04:20 -- nvmf/common.sh@295 -- # e810=() 00:14:24.386 21:04:20 -- nvmf/common.sh@295 -- # local -ga e810 00:14:24.386 21:04:20 -- nvmf/common.sh@296 -- # x722=() 00:14:24.386 21:04:20 -- nvmf/common.sh@296 -- # local -ga x722 00:14:24.386 21:04:20 -- nvmf/common.sh@297 -- # mlx=() 00:14:24.386 21:04:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:24.386 21:04:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:24.386 21:04:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:24.386 21:04:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:24.386 21:04:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:24.386 21:04:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:24.386 21:04:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:24.386 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:24.386 21:04:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:24.386 21:04:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:24.386 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:24.386 21:04:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:24.386 21:04:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:24.386 21:04:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:24.386 21:04:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:24.386 21:04:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:24.386 21:04:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:24.386 21:04:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:24.386 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:24.386 21:04:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:24.386 21:04:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:24.386 21:04:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:24.386 21:04:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:24.386 21:04:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:24.386 21:04:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:24.386 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:24.387 21:04:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:24.387 21:04:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:24.387 21:04:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:24.387 21:04:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:24.387 21:04:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:24.387 21:04:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:24.387 21:04:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:24.387 21:04:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:24.387 21:04:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:24.387 21:04:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:24.387 21:04:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:24.387 21:04:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:24.387 21:04:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:24.387 21:04:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:24.387 21:04:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:24.387 21:04:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:24.387 21:04:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:24.387 21:04:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:24.387 21:04:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:24.645 21:04:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:24.645 21:04:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:24.645 21:04:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:24.645 21:04:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:24.645 21:04:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:24.645 21:04:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:24.645 21:04:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:24.645 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:24.645 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.169 ms 00:14:24.645 00:14:24.645 --- 10.0.0.2 ping statistics --- 00:14:24.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:24.645 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:14:24.645 21:04:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:24.645 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:24.645 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:14:24.645 00:14:24.645 --- 10.0.0.1 ping statistics --- 00:14:24.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:24.645 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:14:24.645 21:04:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:24.645 21:04:20 -- nvmf/common.sh@410 -- # return 0 00:14:24.645 21:04:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:24.645 21:04:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:24.645 21:04:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:24.645 21:04:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:24.645 21:04:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:24.645 21:04:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:24.645 21:04:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:24.645 21:04:20 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:24.645 21:04:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:24.645 21:04:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:24.645 21:04:20 -- common/autotest_common.sh@10 -- # set +x 00:14:24.645 21:04:20 -- nvmf/common.sh@469 -- # nvmfpid=3962165 00:14:24.645 21:04:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:24.646 21:04:20 -- nvmf/common.sh@470 -- # waitforlisten 3962165 00:14:24.646 21:04:20 -- common/autotest_common.sh@829 -- # '[' -z 3962165 ']' 00:14:24.646 21:04:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:24.646 21:04:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:24.646 21:04:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:24.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:24.646 21:04:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:24.646 21:04:20 -- common/autotest_common.sh@10 -- # set +x 00:14:24.646 [2024-11-27 21:04:20.770241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:24.646 [2024-11-27 21:04:20.770329] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:24.646 EAL: No free 2048 kB hugepages reported on node 1 00:14:24.646 [2024-11-27 21:04:20.843415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:24.904 [2024-11-27 21:04:20.962121] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:24.904 [2024-11-27 21:04:20.962303] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:24.904 [2024-11-27 21:04:20.962323] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:24.904 [2024-11-27 21:04:20.962338] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:24.904 [2024-11-27 21:04:20.962424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:24.904 [2024-11-27 21:04:20.962478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:24.904 [2024-11-27 21:04:20.962481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:25.837 21:04:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:25.837 21:04:21 -- common/autotest_common.sh@862 -- # return 0 00:14:25.837 21:04:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:25.837 21:04:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:25.837 21:04:21 -- common/autotest_common.sh@10 -- # set +x 00:14:25.837 21:04:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:25.837 21:04:21 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:25.837 [2024-11-27 21:04:22.001339] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:25.837 21:04:22 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:26.095 21:04:22 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:26.095 21:04:22 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:26.353 21:04:22 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:26.353 21:04:22 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:26.611 21:04:22 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:26.869 21:04:23 -- target/nvmf_lvol.sh@29 -- # lvs=3f9c89f5-b262-4176-955b-055e3e9050bb 00:14:26.869 21:04:23 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3f9c89f5-b262-4176-955b-055e3e9050bb lvol 20 00:14:27.126 21:04:23 -- target/nvmf_lvol.sh@32 -- # lvol=7e2dabaa-7672-47f4-aa49-faaea1c78da8 00:14:27.126 21:04:23 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:27.384 21:04:23 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7e2dabaa-7672-47f4-aa49-faaea1c78da8 00:14:27.641 21:04:23 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:27.899 [2024-11-27 21:04:24.075322] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:27.899 21:04:24 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:28.157 21:04:24 -- target/nvmf_lvol.sh@42 -- # perf_pid=3962738 00:14:28.157 21:04:24 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:28.157 21:04:24 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:28.157 EAL: No free 2048 kB hugepages reported on node 1 00:14:29.530 21:04:25 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 7e2dabaa-7672-47f4-aa49-faaea1c78da8 MY_SNAPSHOT 00:14:29.530 21:04:25 -- target/nvmf_lvol.sh@47 -- # snapshot=fd49019f-0b89-4392-8999-8daaafcab6a9 00:14:29.530 21:04:25 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 7e2dabaa-7672-47f4-aa49-faaea1c78da8 30 00:14:29.788 21:04:25 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone fd49019f-0b89-4392-8999-8daaafcab6a9 MY_CLONE 00:14:30.046 21:04:26 -- target/nvmf_lvol.sh@49 -- # clone=f68bae34-b877-49e1-8d02-a9f73b8e6334 00:14:30.046 21:04:26 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate f68bae34-b877-49e1-8d02-a9f73b8e6334 00:14:30.979 21:04:26 -- target/nvmf_lvol.sh@53 -- # wait 3962738 00:14:39.086 Initializing NVMe Controllers 00:14:39.086 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:39.086 Controller IO queue size 128, less than required. 00:14:39.086 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:39.086 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:39.086 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:39.086 Initialization complete. Launching workers. 00:14:39.086 ======================================================== 00:14:39.086 Latency(us) 00:14:39.086 Device Information : IOPS MiB/s Average min max 00:14:39.086 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10903.36 42.59 11745.49 1509.32 78071.71 00:14:39.086 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10793.36 42.16 11859.93 1976.41 54489.30 00:14:39.086 ======================================================== 00:14:39.086 Total : 21696.73 84.75 11802.42 1509.32 78071.71 00:14:39.086 00:14:39.086 21:04:34 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:39.086 21:04:35 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7e2dabaa-7672-47f4-aa49-faaea1c78da8 00:14:39.344 21:04:35 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3f9c89f5-b262-4176-955b-055e3e9050bb 00:14:39.601 21:04:35 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:39.601 21:04:35 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:39.601 21:04:35 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:39.601 21:04:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:39.601 21:04:35 -- nvmf/common.sh@116 -- # sync 00:14:39.601 21:04:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:39.601 21:04:35 -- nvmf/common.sh@119 -- # set +e 00:14:39.601 21:04:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:39.602 21:04:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:39.602 rmmod nvme_tcp 00:14:39.602 rmmod nvme_fabrics 00:14:39.602 rmmod nvme_keyring 00:14:39.602 21:04:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:39.602 21:04:35 -- nvmf/common.sh@123 -- # set -e 00:14:39.602 21:04:35 -- nvmf/common.sh@124 -- # return 0 00:14:39.602 21:04:35 -- nvmf/common.sh@477 -- # '[' -n 3962165 ']' 00:14:39.602 21:04:35 -- nvmf/common.sh@478 -- # killprocess 3962165 00:14:39.602 21:04:35 -- common/autotest_common.sh@936 -- # '[' -z 3962165 ']' 00:14:39.602 21:04:35 -- common/autotest_common.sh@940 -- # kill -0 3962165 00:14:39.602 21:04:35 -- common/autotest_common.sh@941 -- # uname 00:14:39.859 21:04:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:39.859 21:04:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3962165 00:14:39.859 21:04:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:39.859 21:04:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:39.860 21:04:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3962165' 00:14:39.860 killing process with pid 3962165 00:14:39.860 21:04:35 -- common/autotest_common.sh@955 -- # kill 3962165 00:14:39.860 21:04:35 -- common/autotest_common.sh@960 -- # wait 3962165 00:14:40.119 21:04:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:40.119 21:04:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:40.119 21:04:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:40.119 21:04:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:40.119 21:04:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:40.119 21:04:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:40.119 21:04:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:40.119 21:04:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.023 21:04:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:42.023 00:14:42.023 real 0m19.846s 00:14:42.023 user 1m7.462s 00:14:42.023 sys 0m5.413s 00:14:42.023 21:04:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:42.023 21:04:38 -- common/autotest_common.sh@10 -- # set +x 00:14:42.023 ************************************ 00:14:42.023 END TEST nvmf_lvol 00:14:42.023 ************************************ 00:14:42.281 21:04:38 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:42.281 21:04:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:42.281 21:04:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:42.281 21:04:38 -- common/autotest_common.sh@10 -- # set +x 00:14:42.281 ************************************ 00:14:42.281 START TEST nvmf_lvs_grow 00:14:42.281 ************************************ 00:14:42.282 21:04:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:42.282 * Looking for test storage... 00:14:42.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:42.282 21:04:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:42.282 21:04:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:42.282 21:04:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:42.282 21:04:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:42.282 21:04:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:42.282 21:04:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:42.282 21:04:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:42.282 21:04:38 -- scripts/common.sh@335 -- # IFS=.-: 00:14:42.282 21:04:38 -- scripts/common.sh@335 -- # read -ra ver1 00:14:42.282 21:04:38 -- scripts/common.sh@336 -- # IFS=.-: 00:14:42.282 21:04:38 -- scripts/common.sh@336 -- # read -ra ver2 00:14:42.282 21:04:38 -- scripts/common.sh@337 -- # local 'op=<' 00:14:42.282 21:04:38 -- scripts/common.sh@339 -- # ver1_l=2 00:14:42.282 21:04:38 -- scripts/common.sh@340 -- # ver2_l=1 00:14:42.282 21:04:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:42.282 21:04:38 -- scripts/common.sh@343 -- # case "$op" in 00:14:42.282 21:04:38 -- scripts/common.sh@344 -- # : 1 00:14:42.282 21:04:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:42.282 21:04:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:42.282 21:04:38 -- scripts/common.sh@364 -- # decimal 1 00:14:42.282 21:04:38 -- scripts/common.sh@352 -- # local d=1 00:14:42.282 21:04:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:42.282 21:04:38 -- scripts/common.sh@354 -- # echo 1 00:14:42.282 21:04:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:42.282 21:04:38 -- scripts/common.sh@365 -- # decimal 2 00:14:42.282 21:04:38 -- scripts/common.sh@352 -- # local d=2 00:14:42.282 21:04:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:42.282 21:04:38 -- scripts/common.sh@354 -- # echo 2 00:14:42.282 21:04:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:42.282 21:04:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:42.282 21:04:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:42.282 21:04:38 -- scripts/common.sh@367 -- # return 0 00:14:42.282 21:04:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:42.282 21:04:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:42.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.282 --rc genhtml_branch_coverage=1 00:14:42.282 --rc genhtml_function_coverage=1 00:14:42.282 --rc genhtml_legend=1 00:14:42.282 --rc geninfo_all_blocks=1 00:14:42.282 --rc geninfo_unexecuted_blocks=1 00:14:42.282 00:14:42.282 ' 00:14:42.282 21:04:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:42.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.282 --rc genhtml_branch_coverage=1 00:14:42.282 --rc genhtml_function_coverage=1 00:14:42.282 --rc genhtml_legend=1 00:14:42.282 --rc geninfo_all_blocks=1 00:14:42.282 --rc geninfo_unexecuted_blocks=1 00:14:42.282 00:14:42.282 ' 00:14:42.282 21:04:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:42.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.282 --rc genhtml_branch_coverage=1 00:14:42.282 --rc genhtml_function_coverage=1 00:14:42.282 --rc genhtml_legend=1 00:14:42.282 --rc geninfo_all_blocks=1 00:14:42.282 --rc geninfo_unexecuted_blocks=1 00:14:42.282 00:14:42.282 ' 00:14:42.282 21:04:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:42.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.282 --rc genhtml_branch_coverage=1 00:14:42.282 --rc genhtml_function_coverage=1 00:14:42.282 --rc genhtml_legend=1 00:14:42.282 --rc geninfo_all_blocks=1 00:14:42.282 --rc geninfo_unexecuted_blocks=1 00:14:42.282 00:14:42.282 ' 00:14:42.282 21:04:38 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:42.282 21:04:38 -- nvmf/common.sh@7 -- # uname -s 00:14:42.282 21:04:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:42.282 21:04:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:42.282 21:04:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:42.282 21:04:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:42.282 21:04:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:42.282 21:04:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:42.282 21:04:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:42.282 21:04:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:42.282 21:04:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:42.282 21:04:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:42.282 21:04:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.282 21:04:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.282 21:04:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:42.282 21:04:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:42.282 21:04:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:42.282 21:04:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:42.282 21:04:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:42.282 21:04:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:42.282 21:04:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:42.282 21:04:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.282 21:04:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.282 21:04:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.282 21:04:38 -- paths/export.sh@5 -- # export PATH 00:14:42.282 21:04:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.282 21:04:38 -- nvmf/common.sh@46 -- # : 0 00:14:42.282 21:04:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:42.282 21:04:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:42.282 21:04:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:42.282 21:04:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:42.282 21:04:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:42.282 21:04:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:42.282 21:04:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:42.282 21:04:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:42.282 21:04:38 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:42.282 21:04:38 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:42.282 21:04:38 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:42.282 21:04:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:42.282 21:04:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:42.282 21:04:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:42.282 21:04:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:42.282 21:04:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:42.282 21:04:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.282 21:04:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:42.282 21:04:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.282 21:04:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:42.282 21:04:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:42.282 21:04:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:42.282 21:04:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.811 21:04:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:44.811 21:04:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:44.811 21:04:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:44.811 21:04:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:44.811 21:04:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:44.811 21:04:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:44.811 21:04:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:44.811 21:04:40 -- nvmf/common.sh@294 -- # net_devs=() 00:14:44.811 21:04:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:44.811 21:04:40 -- nvmf/common.sh@295 -- # e810=() 00:14:44.811 21:04:40 -- nvmf/common.sh@295 -- # local -ga e810 00:14:44.811 21:04:40 -- nvmf/common.sh@296 -- # x722=() 00:14:44.811 21:04:40 -- nvmf/common.sh@296 -- # local -ga x722 00:14:44.811 21:04:40 -- nvmf/common.sh@297 -- # mlx=() 00:14:44.811 21:04:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:44.811 21:04:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:44.811 21:04:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:44.811 21:04:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:44.811 21:04:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:44.811 21:04:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.811 21:04:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:44.811 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:44.811 21:04:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.811 21:04:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:44.811 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:44.811 21:04:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:44.811 21:04:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:44.811 21:04:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.811 21:04:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.812 21:04:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.812 21:04:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.812 21:04:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:44.812 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:44.812 21:04:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.812 21:04:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.812 21:04:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.812 21:04:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.812 21:04:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.812 21:04:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:44.812 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:44.812 21:04:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.812 21:04:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:44.812 21:04:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:44.812 21:04:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:44.812 21:04:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:44.812 21:04:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:44.812 21:04:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:44.812 21:04:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:44.812 21:04:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:44.812 21:04:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:44.812 21:04:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:44.812 21:04:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:44.812 21:04:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:44.812 21:04:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:44.812 21:04:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:44.812 21:04:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:44.812 21:04:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:44.812 21:04:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:44.812 21:04:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:44.812 21:04:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:44.812 21:04:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:44.812 21:04:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:44.812 21:04:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:44.812 21:04:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:44.812 21:04:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:44.812 21:04:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:44.812 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:44.812 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:14:44.812 00:14:44.812 --- 10.0.0.2 ping statistics --- 00:14:44.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.812 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:14:44.812 21:04:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:44.812 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:44.812 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:14:44.812 00:14:44.812 --- 10.0.0.1 ping statistics --- 00:14:44.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.812 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:14:44.812 21:04:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:44.812 21:04:40 -- nvmf/common.sh@410 -- # return 0 00:14:44.812 21:04:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:44.812 21:04:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:44.812 21:04:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:44.812 21:04:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:44.812 21:04:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:44.812 21:04:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:44.812 21:04:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:44.812 21:04:40 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:44.812 21:04:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:44.812 21:04:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:44.812 21:04:40 -- common/autotest_common.sh@10 -- # set +x 00:14:44.812 21:04:40 -- nvmf/common.sh@469 -- # nvmfpid=3966060 00:14:44.812 21:04:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:44.812 21:04:40 -- nvmf/common.sh@470 -- # waitforlisten 3966060 00:14:44.812 21:04:40 -- common/autotest_common.sh@829 -- # '[' -z 3966060 ']' 00:14:44.812 21:04:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:44.812 21:04:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:44.812 21:04:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:44.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:44.812 21:04:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:44.812 21:04:40 -- common/autotest_common.sh@10 -- # set +x 00:14:44.812 [2024-11-27 21:04:40.715027] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:44.812 [2024-11-27 21:04:40.715117] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:44.812 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.812 [2024-11-27 21:04:40.778980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:44.812 [2024-11-27 21:04:40.889303] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:44.812 [2024-11-27 21:04:40.889463] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:44.812 [2024-11-27 21:04:40.889494] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:44.812 [2024-11-27 21:04:40.889506] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:44.812 [2024-11-27 21:04:40.889557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:45.747 21:04:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:45.747 21:04:41 -- common/autotest_common.sh@862 -- # return 0 00:14:45.747 21:04:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:45.747 21:04:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:45.747 21:04:41 -- common/autotest_common.sh@10 -- # set +x 00:14:45.747 21:04:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:45.747 [2024-11-27 21:04:41.941558] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:45.747 21:04:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:45.747 21:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:45.747 21:04:41 -- common/autotest_common.sh@10 -- # set +x 00:14:45.747 ************************************ 00:14:45.747 START TEST lvs_grow_clean 00:14:45.747 ************************************ 00:14:45.747 21:04:41 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:45.747 21:04:41 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:46.005 21:04:42 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:46.005 21:04:42 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:46.263 21:04:42 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e81aa92e-f7ad-45d5-8628-d48e05020d39 00:14:46.263 21:04:42 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:14:46.263 21:04:42 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:46.520 21:04:42 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:46.520 21:04:42 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:46.520 21:04:42 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e81aa92e-f7ad-45d5-8628-d48e05020d39 lvol 150 00:14:46.778 21:04:42 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a34e10c2-4945-4fd5-aa7a-85366a71a430 00:14:46.778 21:04:42 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:46.778 21:04:42 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:47.037 [2024-11-27 21:04:43.231773] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:47.037 [2024-11-27 21:04:43.231868] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:47.037 true 00:14:47.037 21:04:43 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:14:47.037 21:04:43 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:47.296 21:04:43 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:47.296 21:04:43 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:47.554 21:04:43 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a34e10c2-4945-4fd5-aa7a-85366a71a430 00:14:47.812 21:04:44 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:48.070 [2024-11-27 21:04:44.263029] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:48.070 21:04:44 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:48.328 21:04:44 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3966516 00:14:48.328 21:04:44 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:48.328 21:04:44 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:48.328 21:04:44 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3966516 /var/tmp/bdevperf.sock 00:14:48.328 21:04:44 -- common/autotest_common.sh@829 -- # '[' -z 3966516 ']' 00:14:48.328 21:04:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:48.328 21:04:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.328 21:04:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:48.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:48.328 21:04:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.328 21:04:44 -- common/autotest_common.sh@10 -- # set +x 00:14:48.328 [2024-11-27 21:04:44.564033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:48.328 [2024-11-27 21:04:44.564100] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3966516 ] 00:14:48.586 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.586 [2024-11-27 21:04:44.626640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:48.586 [2024-11-27 21:04:44.753283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:49.573 21:04:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:49.573 21:04:45 -- common/autotest_common.sh@862 -- # return 0 00:14:49.573 21:04:45 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:49.830 Nvme0n1 00:14:49.831 21:04:46 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:50.089 [ 00:14:50.089 { 00:14:50.089 "name": "Nvme0n1", 00:14:50.089 "aliases": [ 00:14:50.089 "a34e10c2-4945-4fd5-aa7a-85366a71a430" 00:14:50.089 ], 00:14:50.089 "product_name": "NVMe disk", 00:14:50.089 "block_size": 4096, 00:14:50.089 "num_blocks": 38912, 00:14:50.089 "uuid": "a34e10c2-4945-4fd5-aa7a-85366a71a430", 00:14:50.089 "assigned_rate_limits": { 00:14:50.089 "rw_ios_per_sec": 0, 00:14:50.089 "rw_mbytes_per_sec": 0, 00:14:50.089 "r_mbytes_per_sec": 0, 00:14:50.089 "w_mbytes_per_sec": 0 00:14:50.089 }, 00:14:50.089 "claimed": false, 00:14:50.089 "zoned": false, 00:14:50.089 "supported_io_types": { 00:14:50.089 "read": true, 00:14:50.089 "write": true, 00:14:50.089 "unmap": true, 00:14:50.089 "write_zeroes": true, 00:14:50.089 "flush": true, 00:14:50.089 "reset": true, 00:14:50.089 "compare": true, 00:14:50.089 "compare_and_write": true, 00:14:50.089 "abort": true, 00:14:50.089 "nvme_admin": true, 00:14:50.089 "nvme_io": true 00:14:50.089 }, 00:14:50.089 "driver_specific": { 00:14:50.089 "nvme": [ 00:14:50.089 { 00:14:50.089 "trid": { 00:14:50.089 "trtype": "TCP", 00:14:50.089 "adrfam": "IPv4", 00:14:50.089 "traddr": "10.0.0.2", 00:14:50.089 "trsvcid": "4420", 00:14:50.089 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:50.089 }, 00:14:50.089 "ctrlr_data": { 00:14:50.089 "cntlid": 1, 00:14:50.089 "vendor_id": "0x8086", 00:14:50.089 "model_number": "SPDK bdev Controller", 00:14:50.089 "serial_number": "SPDK0", 00:14:50.089 "firmware_revision": "24.01.1", 00:14:50.089 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:50.089 "oacs": { 00:14:50.089 "security": 0, 00:14:50.089 "format": 0, 00:14:50.089 "firmware": 0, 00:14:50.089 "ns_manage": 0 00:14:50.089 }, 00:14:50.089 "multi_ctrlr": true, 00:14:50.089 "ana_reporting": false 00:14:50.089 }, 00:14:50.089 "vs": { 00:14:50.089 "nvme_version": "1.3" 00:14:50.089 }, 00:14:50.089 "ns_data": { 00:14:50.089 "id": 1, 00:14:50.089 "can_share": true 00:14:50.089 } 00:14:50.089 } 00:14:50.089 ], 00:14:50.089 "mp_policy": "active_passive" 00:14:50.089 } 00:14:50.089 } 00:14:50.089 ] 00:14:50.089 21:04:46 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3966788 00:14:50.089 21:04:46 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:50.089 21:04:46 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:50.347 Running I/O for 10 seconds... 00:14:51.281 Latency(us) 00:14:51.281 [2024-11-27T20:04:47.522Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:51.281 [2024-11-27T20:04:47.522Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.281 Nvme0n1 : 1.00 14519.00 56.71 0.00 0.00 0.00 0.00 0.00 00:14:51.281 [2024-11-27T20:04:47.522Z] =================================================================================================================== 00:14:51.281 [2024-11-27T20:04:47.523Z] Total : 14519.00 56.71 0.00 0.00 0.00 0.00 0.00 00:14:51.282 00:14:52.216 21:04:48 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:14:52.216 [2024-11-27T20:04:48.457Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:52.216 Nvme0n1 : 2.00 14708.00 57.45 0.00 0.00 0.00 0.00 0.00 00:14:52.216 [2024-11-27T20:04:48.457Z] =================================================================================================================== 00:14:52.216 [2024-11-27T20:04:48.457Z] Total : 14708.00 57.45 0.00 0.00 0.00 0.00 0.00 00:14:52.216 00:14:52.475 true 00:14:52.475 21:04:48 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:14:52.475 21:04:48 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:52.734 21:04:48 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:52.734 21:04:48 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:52.734 21:04:48 -- target/nvmf_lvs_grow.sh@65 -- # wait 3966788 00:14:53.299 [2024-11-27T20:04:49.540Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.299 Nvme0n1 : 3.00 14938.33 58.35 0.00 0.00 0.00 0.00 0.00 00:14:53.299 [2024-11-27T20:04:49.540Z] =================================================================================================================== 00:14:53.299 [2024-11-27T20:04:49.540Z] Total : 14938.33 58.35 0.00 0.00 0.00 0.00 0.00 00:14:53.299 00:14:54.233 [2024-11-27T20:04:50.474Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.233 Nvme0n1 : 4.00 14987.75 58.55 0.00 0.00 0.00 0.00 0.00 00:14:54.233 [2024-11-27T20:04:50.474Z] =================================================================================================================== 00:14:54.233 [2024-11-27T20:04:50.474Z] Total : 14987.75 58.55 0.00 0.00 0.00 0.00 0.00 00:14:54.233 00:14:55.168 [2024-11-27T20:04:51.409Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.168 Nvme0n1 : 5.00 15142.40 59.15 0.00 0.00 0.00 0.00 0.00 00:14:55.168 [2024-11-27T20:04:51.409Z] =================================================================================================================== 00:14:55.168 [2024-11-27T20:04:51.409Z] Total : 15142.40 59.15 0.00 0.00 0.00 0.00 0.00 00:14:55.168 00:14:56.543 [2024-11-27T20:04:52.784Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.543 Nvme0n1 : 6.00 15167.83 59.25 0.00 0.00 0.00 0.00 0.00 00:14:56.543 [2024-11-27T20:04:52.784Z] =================================================================================================================== 00:14:56.543 [2024-11-27T20:04:52.784Z] Total : 15167.83 59.25 0.00 0.00 0.00 0.00 0.00 00:14:56.543 00:14:57.477 [2024-11-27T20:04:53.718Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.477 Nvme0n1 : 7.00 15186.43 59.32 0.00 0.00 0.00 0.00 0.00 00:14:57.477 [2024-11-27T20:04:53.718Z] =================================================================================================================== 00:14:57.477 [2024-11-27T20:04:53.718Z] Total : 15186.43 59.32 0.00 0.00 0.00 0.00 0.00 00:14:57.477 00:14:58.409 [2024-11-27T20:04:54.650Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.409 Nvme0n1 : 8.00 15211.50 59.42 0.00 0.00 0.00 0.00 0.00 00:14:58.409 [2024-11-27T20:04:54.650Z] =================================================================================================================== 00:14:58.409 [2024-11-27T20:04:54.650Z] Total : 15211.50 59.42 0.00 0.00 0.00 0.00 0.00 00:14:58.409 00:14:59.344 [2024-11-27T20:04:55.585Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.344 Nvme0n1 : 9.00 15233.33 59.51 0.00 0.00 0.00 0.00 0.00 00:14:59.344 [2024-11-27T20:04:55.585Z] =================================================================================================================== 00:14:59.344 [2024-11-27T20:04:55.585Z] Total : 15233.33 59.51 0.00 0.00 0.00 0.00 0.00 00:14:59.344 00:15:00.279 [2024-11-27T20:04:56.520Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.279 Nvme0n1 : 10.00 15261.40 59.61 0.00 0.00 0.00 0.00 0.00 00:15:00.279 [2024-11-27T20:04:56.520Z] =================================================================================================================== 00:15:00.279 [2024-11-27T20:04:56.520Z] Total : 15261.40 59.61 0.00 0.00 0.00 0.00 0.00 00:15:00.279 00:15:00.279 00:15:00.279 Latency(us) 00:15:00.279 [2024-11-27T20:04:56.520Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:00.279 [2024-11-27T20:04:56.520Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.279 Nvme0n1 : 10.00 15260.50 59.61 0.00 0.00 8382.50 4223.43 16505.36 00:15:00.279 [2024-11-27T20:04:56.520Z] =================================================================================================================== 00:15:00.279 [2024-11-27T20:04:56.520Z] Total : 15260.50 59.61 0.00 0.00 8382.50 4223.43 16505.36 00:15:00.279 0 00:15:00.279 21:04:56 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3966516 00:15:00.279 21:04:56 -- common/autotest_common.sh@936 -- # '[' -z 3966516 ']' 00:15:00.279 21:04:56 -- common/autotest_common.sh@940 -- # kill -0 3966516 00:15:00.279 21:04:56 -- common/autotest_common.sh@941 -- # uname 00:15:00.279 21:04:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:00.279 21:04:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3966516 00:15:00.279 21:04:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:00.279 21:04:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:00.279 21:04:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3966516' 00:15:00.279 killing process with pid 3966516 00:15:00.279 21:04:56 -- common/autotest_common.sh@955 -- # kill 3966516 00:15:00.279 Received shutdown signal, test time was about 10.000000 seconds 00:15:00.279 00:15:00.279 Latency(us) 00:15:00.279 [2024-11-27T20:04:56.520Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:00.279 [2024-11-27T20:04:56.520Z] =================================================================================================================== 00:15:00.279 [2024-11-27T20:04:56.520Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:00.279 21:04:56 -- common/autotest_common.sh@960 -- # wait 3966516 00:15:00.537 21:04:56 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:00.795 21:04:56 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:00.795 21:04:56 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:01.054 21:04:57 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:01.054 21:04:57 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:01.054 21:04:57 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:01.313 [2024-11-27 21:04:57.465401] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:01.313 21:04:57 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:01.313 21:04:57 -- common/autotest_common.sh@650 -- # local es=0 00:15:01.313 21:04:57 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:01.313 21:04:57 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:01.313 21:04:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.313 21:04:57 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:01.313 21:04:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.313 21:04:57 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:01.313 21:04:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.313 21:04:57 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:01.313 21:04:57 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:01.313 21:04:57 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:01.571 request: 00:15:01.571 { 00:15:01.571 "uuid": "e81aa92e-f7ad-45d5-8628-d48e05020d39", 00:15:01.571 "method": "bdev_lvol_get_lvstores", 00:15:01.571 "req_id": 1 00:15:01.571 } 00:15:01.571 Got JSON-RPC error response 00:15:01.571 response: 00:15:01.571 { 00:15:01.571 "code": -19, 00:15:01.571 "message": "No such device" 00:15:01.571 } 00:15:01.571 21:04:57 -- common/autotest_common.sh@653 -- # es=1 00:15:01.571 21:04:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:01.571 21:04:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:01.571 21:04:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:01.572 21:04:57 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:01.829 aio_bdev 00:15:01.829 21:04:58 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a34e10c2-4945-4fd5-aa7a-85366a71a430 00:15:01.830 21:04:58 -- common/autotest_common.sh@897 -- # local bdev_name=a34e10c2-4945-4fd5-aa7a-85366a71a430 00:15:01.830 21:04:58 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:01.830 21:04:58 -- common/autotest_common.sh@899 -- # local i 00:15:01.830 21:04:58 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:01.830 21:04:58 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:01.830 21:04:58 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:02.087 21:04:58 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a34e10c2-4945-4fd5-aa7a-85366a71a430 -t 2000 00:15:02.345 [ 00:15:02.345 { 00:15:02.345 "name": "a34e10c2-4945-4fd5-aa7a-85366a71a430", 00:15:02.345 "aliases": [ 00:15:02.345 "lvs/lvol" 00:15:02.345 ], 00:15:02.345 "product_name": "Logical Volume", 00:15:02.345 "block_size": 4096, 00:15:02.345 "num_blocks": 38912, 00:15:02.345 "uuid": "a34e10c2-4945-4fd5-aa7a-85366a71a430", 00:15:02.345 "assigned_rate_limits": { 00:15:02.345 "rw_ios_per_sec": 0, 00:15:02.345 "rw_mbytes_per_sec": 0, 00:15:02.345 "r_mbytes_per_sec": 0, 00:15:02.345 "w_mbytes_per_sec": 0 00:15:02.345 }, 00:15:02.345 "claimed": false, 00:15:02.345 "zoned": false, 00:15:02.345 "supported_io_types": { 00:15:02.345 "read": true, 00:15:02.345 "write": true, 00:15:02.345 "unmap": true, 00:15:02.345 "write_zeroes": true, 00:15:02.345 "flush": false, 00:15:02.345 "reset": true, 00:15:02.345 "compare": false, 00:15:02.345 "compare_and_write": false, 00:15:02.345 "abort": false, 00:15:02.345 "nvme_admin": false, 00:15:02.345 "nvme_io": false 00:15:02.345 }, 00:15:02.345 "driver_specific": { 00:15:02.345 "lvol": { 00:15:02.345 "lvol_store_uuid": "e81aa92e-f7ad-45d5-8628-d48e05020d39", 00:15:02.345 "base_bdev": "aio_bdev", 00:15:02.345 "thin_provision": false, 00:15:02.345 "snapshot": false, 00:15:02.345 "clone": false, 00:15:02.345 "esnap_clone": false 00:15:02.345 } 00:15:02.345 } 00:15:02.345 } 00:15:02.345 ] 00:15:02.345 21:04:58 -- common/autotest_common.sh@905 -- # return 0 00:15:02.345 21:04:58 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:02.345 21:04:58 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:02.603 21:04:58 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:02.603 21:04:58 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:02.603 21:04:58 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:02.860 21:04:59 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:02.860 21:04:59 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a34e10c2-4945-4fd5-aa7a-85366a71a430 00:15:03.126 21:04:59 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e81aa92e-f7ad-45d5-8628-d48e05020d39 00:15:03.386 21:04:59 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:03.644 21:04:59 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:03.644 00:15:03.644 real 0m17.896s 00:15:03.644 user 0m17.819s 00:15:03.644 sys 0m1.721s 00:15:03.644 21:04:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:03.644 21:04:59 -- common/autotest_common.sh@10 -- # set +x 00:15:03.644 ************************************ 00:15:03.644 END TEST lvs_grow_clean 00:15:03.644 ************************************ 00:15:03.644 21:04:59 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:03.644 21:04:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:03.644 21:04:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:03.644 21:04:59 -- common/autotest_common.sh@10 -- # set +x 00:15:03.903 ************************************ 00:15:03.903 START TEST lvs_grow_dirty 00:15:03.903 ************************************ 00:15:03.903 21:04:59 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:03.903 21:04:59 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:04.161 21:05:00 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:04.161 21:05:00 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:04.419 21:05:00 -- target/nvmf_lvs_grow.sh@28 -- # lvs=2a038007-8447-4a53-981f-72843a8b3ee7 00:15:04.419 21:05:00 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:04.419 21:05:00 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:04.676 21:05:00 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:04.676 21:05:00 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:04.676 21:05:00 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2a038007-8447-4a53-981f-72843a8b3ee7 lvol 150 00:15:04.933 21:05:00 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:04.933 21:05:00 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:04.933 21:05:00 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:05.189 [2024-11-27 21:05:01.236054] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:05.189 [2024-11-27 21:05:01.236152] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:05.189 true 00:15:05.189 21:05:01 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:05.189 21:05:01 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:05.445 21:05:01 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:05.445 21:05:01 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:05.703 21:05:01 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:05.961 21:05:02 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:06.239 21:05:02 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:06.497 21:05:02 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3968754 00:15:06.497 21:05:02 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:06.497 21:05:02 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:06.497 21:05:02 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3968754 /var/tmp/bdevperf.sock 00:15:06.497 21:05:02 -- common/autotest_common.sh@829 -- # '[' -z 3968754 ']' 00:15:06.497 21:05:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:06.497 21:05:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:06.497 21:05:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:06.497 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:06.497 21:05:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:06.497 21:05:02 -- common/autotest_common.sh@10 -- # set +x 00:15:06.497 [2024-11-27 21:05:02.543257] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:06.497 [2024-11-27 21:05:02.543325] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3968754 ] 00:15:06.497 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.497 [2024-11-27 21:05:02.603820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:06.497 [2024-11-27 21:05:02.718659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:07.428 21:05:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:07.428 21:05:03 -- common/autotest_common.sh@862 -- # return 0 00:15:07.428 21:05:03 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:07.994 Nvme0n1 00:15:07.994 21:05:03 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:08.252 [ 00:15:08.252 { 00:15:08.252 "name": "Nvme0n1", 00:15:08.252 "aliases": [ 00:15:08.252 "a165b5e9-ef8c-4c23-8eee-a119a692edc2" 00:15:08.252 ], 00:15:08.252 "product_name": "NVMe disk", 00:15:08.252 "block_size": 4096, 00:15:08.252 "num_blocks": 38912, 00:15:08.252 "uuid": "a165b5e9-ef8c-4c23-8eee-a119a692edc2", 00:15:08.252 "assigned_rate_limits": { 00:15:08.252 "rw_ios_per_sec": 0, 00:15:08.252 "rw_mbytes_per_sec": 0, 00:15:08.252 "r_mbytes_per_sec": 0, 00:15:08.252 "w_mbytes_per_sec": 0 00:15:08.252 }, 00:15:08.252 "claimed": false, 00:15:08.252 "zoned": false, 00:15:08.252 "supported_io_types": { 00:15:08.252 "read": true, 00:15:08.252 "write": true, 00:15:08.252 "unmap": true, 00:15:08.252 "write_zeroes": true, 00:15:08.252 "flush": true, 00:15:08.252 "reset": true, 00:15:08.252 "compare": true, 00:15:08.252 "compare_and_write": true, 00:15:08.252 "abort": true, 00:15:08.252 "nvme_admin": true, 00:15:08.252 "nvme_io": true 00:15:08.252 }, 00:15:08.252 "driver_specific": { 00:15:08.252 "nvme": [ 00:15:08.252 { 00:15:08.252 "trid": { 00:15:08.252 "trtype": "TCP", 00:15:08.252 "adrfam": "IPv4", 00:15:08.252 "traddr": "10.0.0.2", 00:15:08.252 "trsvcid": "4420", 00:15:08.253 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:08.253 }, 00:15:08.253 "ctrlr_data": { 00:15:08.253 "cntlid": 1, 00:15:08.253 "vendor_id": "0x8086", 00:15:08.253 "model_number": "SPDK bdev Controller", 00:15:08.253 "serial_number": "SPDK0", 00:15:08.253 "firmware_revision": "24.01.1", 00:15:08.253 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:08.253 "oacs": { 00:15:08.253 "security": 0, 00:15:08.253 "format": 0, 00:15:08.253 "firmware": 0, 00:15:08.253 "ns_manage": 0 00:15:08.253 }, 00:15:08.253 "multi_ctrlr": true, 00:15:08.253 "ana_reporting": false 00:15:08.253 }, 00:15:08.253 "vs": { 00:15:08.253 "nvme_version": "1.3" 00:15:08.253 }, 00:15:08.253 "ns_data": { 00:15:08.253 "id": 1, 00:15:08.253 "can_share": true 00:15:08.253 } 00:15:08.253 } 00:15:08.253 ], 00:15:08.253 "mp_policy": "active_passive" 00:15:08.253 } 00:15:08.253 } 00:15:08.253 ] 00:15:08.253 21:05:04 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3969024 00:15:08.253 21:05:04 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:08.253 21:05:04 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:08.253 Running I/O for 10 seconds... 00:15:09.187 Latency(us) 00:15:09.187 [2024-11-27T20:05:05.428Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:09.187 [2024-11-27T20:05:05.428Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.187 Nvme0n1 : 1.00 14606.00 57.05 0.00 0.00 0.00 0.00 0.00 00:15:09.187 [2024-11-27T20:05:05.428Z] =================================================================================================================== 00:15:09.187 [2024-11-27T20:05:05.428Z] Total : 14606.00 57.05 0.00 0.00 0.00 0.00 0.00 00:15:09.187 00:15:10.121 21:05:06 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:10.380 [2024-11-27T20:05:06.621Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.380 Nvme0n1 : 2.00 14777.00 57.72 0.00 0.00 0.00 0.00 0.00 00:15:10.380 [2024-11-27T20:05:06.621Z] =================================================================================================================== 00:15:10.380 [2024-11-27T20:05:06.621Z] Total : 14777.00 57.72 0.00 0.00 0.00 0.00 0.00 00:15:10.380 00:15:10.380 true 00:15:10.380 21:05:06 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:10.380 21:05:06 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:10.945 21:05:06 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:10.945 21:05:06 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:10.945 21:05:06 -- target/nvmf_lvs_grow.sh@65 -- # wait 3969024 00:15:11.202 [2024-11-27T20:05:07.443Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.202 Nvme0n1 : 3.00 14870.00 58.09 0.00 0.00 0.00 0.00 0.00 00:15:11.202 [2024-11-27T20:05:07.443Z] =================================================================================================================== 00:15:11.202 [2024-11-27T20:05:07.443Z] Total : 14870.00 58.09 0.00 0.00 0.00 0.00 0.00 00:15:11.202 00:15:12.576 [2024-11-27T20:05:08.817Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:12.576 Nvme0n1 : 4.00 14937.00 58.35 0.00 0.00 0.00 0.00 0.00 00:15:12.576 [2024-11-27T20:05:08.817Z] =================================================================================================================== 00:15:12.576 [2024-11-27T20:05:08.817Z] Total : 14937.00 58.35 0.00 0.00 0.00 0.00 0.00 00:15:12.576 00:15:13.508 [2024-11-27T20:05:09.749Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.508 Nvme0n1 : 5.00 14994.00 58.57 0.00 0.00 0.00 0.00 0.00 00:15:13.508 [2024-11-27T20:05:09.749Z] =================================================================================================================== 00:15:13.508 [2024-11-27T20:05:09.749Z] Total : 14994.00 58.57 0.00 0.00 0.00 0.00 0.00 00:15:13.508 00:15:14.443 [2024-11-27T20:05:10.684Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.443 Nvme0n1 : 6.00 15097.83 58.98 0.00 0.00 0.00 0.00 0.00 00:15:14.443 [2024-11-27T20:05:10.684Z] =================================================================================================================== 00:15:14.443 [2024-11-27T20:05:10.684Z] Total : 15097.83 58.98 0.00 0.00 0.00 0.00 0.00 00:15:14.443 00:15:15.376 [2024-11-27T20:05:11.617Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.376 Nvme0n1 : 7.00 15138.86 59.14 0.00 0.00 0.00 0.00 0.00 00:15:15.376 [2024-11-27T20:05:11.617Z] =================================================================================================================== 00:15:15.376 [2024-11-27T20:05:11.617Z] Total : 15138.86 59.14 0.00 0.00 0.00 0.00 0.00 00:15:15.376 00:15:16.307 [2024-11-27T20:05:12.548Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.307 Nvme0n1 : 8.00 15176.25 59.28 0.00 0.00 0.00 0.00 0.00 00:15:16.307 [2024-11-27T20:05:12.548Z] =================================================================================================================== 00:15:16.307 [2024-11-27T20:05:12.548Z] Total : 15176.25 59.28 0.00 0.00 0.00 0.00 0.00 00:15:16.307 00:15:17.241 [2024-11-27T20:05:13.482Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.241 Nvme0n1 : 9.00 15198.67 59.37 0.00 0.00 0.00 0.00 0.00 00:15:17.241 [2024-11-27T20:05:13.482Z] =================================================================================================================== 00:15:17.241 [2024-11-27T20:05:13.482Z] Total : 15198.67 59.37 0.00 0.00 0.00 0.00 0.00 00:15:17.241 00:15:18.616 [2024-11-27T20:05:14.857Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.616 Nvme0n1 : 10.00 15224.60 59.47 0.00 0.00 0.00 0.00 0.00 00:15:18.616 [2024-11-27T20:05:14.857Z] =================================================================================================================== 00:15:18.616 [2024-11-27T20:05:14.857Z] Total : 15224.60 59.47 0.00 0.00 0.00 0.00 0.00 00:15:18.616 00:15:18.616 00:15:18.616 Latency(us) 00:15:18.616 [2024-11-27T20:05:14.857Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:18.616 [2024-11-27T20:05:14.857Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.616 Nvme0n1 : 10.01 15226.91 59.48 0.00 0.00 8401.78 2888.44 16408.27 00:15:18.616 [2024-11-27T20:05:14.857Z] =================================================================================================================== 00:15:18.616 [2024-11-27T20:05:14.857Z] Total : 15226.91 59.48 0.00 0.00 8401.78 2888.44 16408.27 00:15:18.616 0 00:15:18.616 21:05:14 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3968754 00:15:18.616 21:05:14 -- common/autotest_common.sh@936 -- # '[' -z 3968754 ']' 00:15:18.616 21:05:14 -- common/autotest_common.sh@940 -- # kill -0 3968754 00:15:18.616 21:05:14 -- common/autotest_common.sh@941 -- # uname 00:15:18.616 21:05:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:18.616 21:05:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3968754 00:15:18.616 21:05:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:18.616 21:05:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:18.616 21:05:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3968754' 00:15:18.616 killing process with pid 3968754 00:15:18.616 21:05:14 -- common/autotest_common.sh@955 -- # kill 3968754 00:15:18.616 Received shutdown signal, test time was about 10.000000 seconds 00:15:18.616 00:15:18.616 Latency(us) 00:15:18.616 [2024-11-27T20:05:14.857Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:18.616 [2024-11-27T20:05:14.857Z] =================================================================================================================== 00:15:18.616 [2024-11-27T20:05:14.857Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:18.616 21:05:14 -- common/autotest_common.sh@960 -- # wait 3968754 00:15:18.616 21:05:14 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:18.874 21:05:15 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:18.874 21:05:15 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3966060 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@74 -- # wait 3966060 00:15:19.133 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3966060 Killed "${NVMF_APP[@]}" "$@" 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:19.133 21:05:15 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:19.133 21:05:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:19.133 21:05:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:19.133 21:05:15 -- common/autotest_common.sh@10 -- # set +x 00:15:19.133 21:05:15 -- nvmf/common.sh@469 -- # nvmfpid=3970268 00:15:19.133 21:05:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:19.133 21:05:15 -- nvmf/common.sh@470 -- # waitforlisten 3970268 00:15:19.133 21:05:15 -- common/autotest_common.sh@829 -- # '[' -z 3970268 ']' 00:15:19.133 21:05:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:19.133 21:05:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:19.133 21:05:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:19.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:19.133 21:05:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:19.133 21:05:15 -- common/autotest_common.sh@10 -- # set +x 00:15:19.133 [2024-11-27 21:05:15.328251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.133 [2024-11-27 21:05:15.328338] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:19.133 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.391 [2024-11-27 21:05:15.395999] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.391 [2024-11-27 21:05:15.504271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:19.391 [2024-11-27 21:05:15.504438] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:19.391 [2024-11-27 21:05:15.504455] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:19.391 [2024-11-27 21:05:15.504466] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:19.391 [2024-11-27 21:05:15.504495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:20.322 21:05:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:20.322 21:05:16 -- common/autotest_common.sh@862 -- # return 0 00:15:20.322 21:05:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:20.322 21:05:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:20.322 21:05:16 -- common/autotest_common.sh@10 -- # set +x 00:15:20.322 21:05:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:20.322 21:05:16 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:20.583 [2024-11-27 21:05:16.594198] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:20.583 [2024-11-27 21:05:16.594350] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:20.583 [2024-11-27 21:05:16.594407] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:20.583 21:05:16 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:20.583 21:05:16 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:20.583 21:05:16 -- common/autotest_common.sh@897 -- # local bdev_name=a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:20.583 21:05:16 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:20.583 21:05:16 -- common/autotest_common.sh@899 -- # local i 00:15:20.583 21:05:16 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:20.583 21:05:16 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:20.583 21:05:16 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:20.885 21:05:16 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a165b5e9-ef8c-4c23-8eee-a119a692edc2 -t 2000 00:15:21.167 [ 00:15:21.167 { 00:15:21.167 "name": "a165b5e9-ef8c-4c23-8eee-a119a692edc2", 00:15:21.167 "aliases": [ 00:15:21.167 "lvs/lvol" 00:15:21.167 ], 00:15:21.167 "product_name": "Logical Volume", 00:15:21.167 "block_size": 4096, 00:15:21.167 "num_blocks": 38912, 00:15:21.167 "uuid": "a165b5e9-ef8c-4c23-8eee-a119a692edc2", 00:15:21.167 "assigned_rate_limits": { 00:15:21.167 "rw_ios_per_sec": 0, 00:15:21.167 "rw_mbytes_per_sec": 0, 00:15:21.167 "r_mbytes_per_sec": 0, 00:15:21.167 "w_mbytes_per_sec": 0 00:15:21.167 }, 00:15:21.167 "claimed": false, 00:15:21.167 "zoned": false, 00:15:21.167 "supported_io_types": { 00:15:21.167 "read": true, 00:15:21.167 "write": true, 00:15:21.167 "unmap": true, 00:15:21.167 "write_zeroes": true, 00:15:21.167 "flush": false, 00:15:21.167 "reset": true, 00:15:21.167 "compare": false, 00:15:21.167 "compare_and_write": false, 00:15:21.167 "abort": false, 00:15:21.167 "nvme_admin": false, 00:15:21.167 "nvme_io": false 00:15:21.167 }, 00:15:21.167 "driver_specific": { 00:15:21.167 "lvol": { 00:15:21.167 "lvol_store_uuid": "2a038007-8447-4a53-981f-72843a8b3ee7", 00:15:21.167 "base_bdev": "aio_bdev", 00:15:21.167 "thin_provision": false, 00:15:21.167 "snapshot": false, 00:15:21.167 "clone": false, 00:15:21.167 "esnap_clone": false 00:15:21.167 } 00:15:21.167 } 00:15:21.167 } 00:15:21.167 ] 00:15:21.167 21:05:17 -- common/autotest_common.sh@905 -- # return 0 00:15:21.167 21:05:17 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:21.167 21:05:17 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:21.167 21:05:17 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:21.167 21:05:17 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:21.167 21:05:17 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:21.432 21:05:17 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:21.432 21:05:17 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:21.690 [2024-11-27 21:05:17.875194] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:21.690 21:05:17 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:21.690 21:05:17 -- common/autotest_common.sh@650 -- # local es=0 00:15:21.690 21:05:17 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:21.690 21:05:17 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:21.690 21:05:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:21.690 21:05:17 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:21.690 21:05:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:21.690 21:05:17 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:21.690 21:05:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:21.690 21:05:17 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:21.690 21:05:17 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:21.690 21:05:17 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:22.256 request: 00:15:22.256 { 00:15:22.256 "uuid": "2a038007-8447-4a53-981f-72843a8b3ee7", 00:15:22.256 "method": "bdev_lvol_get_lvstores", 00:15:22.256 "req_id": 1 00:15:22.256 } 00:15:22.256 Got JSON-RPC error response 00:15:22.256 response: 00:15:22.256 { 00:15:22.256 "code": -19, 00:15:22.256 "message": "No such device" 00:15:22.256 } 00:15:22.256 21:05:18 -- common/autotest_common.sh@653 -- # es=1 00:15:22.256 21:05:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:22.256 21:05:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:22.256 21:05:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:22.256 21:05:18 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:22.256 aio_bdev 00:15:22.256 21:05:18 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:22.256 21:05:18 -- common/autotest_common.sh@897 -- # local bdev_name=a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:22.256 21:05:18 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:22.256 21:05:18 -- common/autotest_common.sh@899 -- # local i 00:15:22.256 21:05:18 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:22.256 21:05:18 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:22.256 21:05:18 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:22.514 21:05:18 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a165b5e9-ef8c-4c23-8eee-a119a692edc2 -t 2000 00:15:22.772 [ 00:15:22.772 { 00:15:22.772 "name": "a165b5e9-ef8c-4c23-8eee-a119a692edc2", 00:15:22.772 "aliases": [ 00:15:22.772 "lvs/lvol" 00:15:22.772 ], 00:15:22.772 "product_name": "Logical Volume", 00:15:22.772 "block_size": 4096, 00:15:22.772 "num_blocks": 38912, 00:15:22.772 "uuid": "a165b5e9-ef8c-4c23-8eee-a119a692edc2", 00:15:22.772 "assigned_rate_limits": { 00:15:22.772 "rw_ios_per_sec": 0, 00:15:22.772 "rw_mbytes_per_sec": 0, 00:15:22.772 "r_mbytes_per_sec": 0, 00:15:22.772 "w_mbytes_per_sec": 0 00:15:22.772 }, 00:15:22.772 "claimed": false, 00:15:22.772 "zoned": false, 00:15:22.772 "supported_io_types": { 00:15:22.772 "read": true, 00:15:22.772 "write": true, 00:15:22.772 "unmap": true, 00:15:22.772 "write_zeroes": true, 00:15:22.772 "flush": false, 00:15:22.772 "reset": true, 00:15:22.772 "compare": false, 00:15:22.772 "compare_and_write": false, 00:15:22.772 "abort": false, 00:15:22.772 "nvme_admin": false, 00:15:22.772 "nvme_io": false 00:15:22.772 }, 00:15:22.772 "driver_specific": { 00:15:22.772 "lvol": { 00:15:22.772 "lvol_store_uuid": "2a038007-8447-4a53-981f-72843a8b3ee7", 00:15:22.772 "base_bdev": "aio_bdev", 00:15:22.772 "thin_provision": false, 00:15:22.772 "snapshot": false, 00:15:22.772 "clone": false, 00:15:22.772 "esnap_clone": false 00:15:22.772 } 00:15:22.772 } 00:15:22.772 } 00:15:22.772 ] 00:15:22.772 21:05:18 -- common/autotest_common.sh@905 -- # return 0 00:15:22.772 21:05:19 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:22.772 21:05:19 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:23.031 21:05:19 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:23.031 21:05:19 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:23.031 21:05:19 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:23.290 21:05:19 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:23.290 21:05:19 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a165b5e9-ef8c-4c23-8eee-a119a692edc2 00:15:23.548 21:05:19 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 2a038007-8447-4a53-981f-72843a8b3ee7 00:15:23.807 21:05:20 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:24.065 21:05:20 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:24.324 00:15:24.324 real 0m20.436s 00:15:24.324 user 0m51.193s 00:15:24.324 sys 0m4.639s 00:15:24.324 21:05:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:24.324 21:05:20 -- common/autotest_common.sh@10 -- # set +x 00:15:24.324 ************************************ 00:15:24.324 END TEST lvs_grow_dirty 00:15:24.324 ************************************ 00:15:24.324 21:05:20 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:24.324 21:05:20 -- common/autotest_common.sh@806 -- # type=--id 00:15:24.324 21:05:20 -- common/autotest_common.sh@807 -- # id=0 00:15:24.324 21:05:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:24.324 21:05:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:24.324 21:05:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:24.324 21:05:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:24.324 21:05:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:24.324 21:05:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:24.324 nvmf_trace.0 00:15:24.324 21:05:20 -- common/autotest_common.sh@821 -- # return 0 00:15:24.324 21:05:20 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:24.324 21:05:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.324 21:05:20 -- nvmf/common.sh@116 -- # sync 00:15:24.324 21:05:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.324 21:05:20 -- nvmf/common.sh@119 -- # set +e 00:15:24.324 21:05:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.324 21:05:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.324 rmmod nvme_tcp 00:15:24.324 rmmod nvme_fabrics 00:15:24.324 rmmod nvme_keyring 00:15:24.324 21:05:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.324 21:05:20 -- nvmf/common.sh@123 -- # set -e 00:15:24.324 21:05:20 -- nvmf/common.sh@124 -- # return 0 00:15:24.324 21:05:20 -- nvmf/common.sh@477 -- # '[' -n 3970268 ']' 00:15:24.324 21:05:20 -- nvmf/common.sh@478 -- # killprocess 3970268 00:15:24.324 21:05:20 -- common/autotest_common.sh@936 -- # '[' -z 3970268 ']' 00:15:24.324 21:05:20 -- common/autotest_common.sh@940 -- # kill -0 3970268 00:15:24.324 21:05:20 -- common/autotest_common.sh@941 -- # uname 00:15:24.324 21:05:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:24.324 21:05:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3970268 00:15:24.324 21:05:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:24.324 21:05:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:24.324 21:05:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3970268' 00:15:24.324 killing process with pid 3970268 00:15:24.324 21:05:20 -- common/autotest_common.sh@955 -- # kill 3970268 00:15:24.324 21:05:20 -- common/autotest_common.sh@960 -- # wait 3970268 00:15:24.584 21:05:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:24.584 21:05:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:24.584 21:05:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:24.584 21:05:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:24.584 21:05:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:24.584 21:05:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.584 21:05:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.584 21:05:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.120 21:05:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:27.120 00:15:27.120 real 0m44.496s 00:15:27.120 user 1m15.805s 00:15:27.120 sys 0m8.314s 00:15:27.120 21:05:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:27.120 21:05:22 -- common/autotest_common.sh@10 -- # set +x 00:15:27.120 ************************************ 00:15:27.120 END TEST nvmf_lvs_grow 00:15:27.120 ************************************ 00:15:27.120 21:05:22 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:27.120 21:05:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:27.120 21:05:22 -- common/autotest_common.sh@10 -- # set +x 00:15:27.120 ************************************ 00:15:27.120 START TEST nvmf_bdev_io_wait 00:15:27.120 ************************************ 00:15:27.120 21:05:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:27.120 * Looking for test storage... 00:15:27.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:27.120 21:05:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:27.120 21:05:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:27.120 21:05:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:27.120 21:05:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:27.120 21:05:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:27.120 21:05:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:27.120 21:05:22 -- scripts/common.sh@335 -- # IFS=.-: 00:15:27.120 21:05:22 -- scripts/common.sh@335 -- # read -ra ver1 00:15:27.120 21:05:22 -- scripts/common.sh@336 -- # IFS=.-: 00:15:27.120 21:05:22 -- scripts/common.sh@336 -- # read -ra ver2 00:15:27.120 21:05:22 -- scripts/common.sh@337 -- # local 'op=<' 00:15:27.120 21:05:22 -- scripts/common.sh@339 -- # ver1_l=2 00:15:27.120 21:05:22 -- scripts/common.sh@340 -- # ver2_l=1 00:15:27.120 21:05:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:27.120 21:05:22 -- scripts/common.sh@343 -- # case "$op" in 00:15:27.120 21:05:22 -- scripts/common.sh@344 -- # : 1 00:15:27.120 21:05:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:27.120 21:05:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:27.120 21:05:22 -- scripts/common.sh@364 -- # decimal 1 00:15:27.120 21:05:22 -- scripts/common.sh@352 -- # local d=1 00:15:27.120 21:05:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:27.120 21:05:22 -- scripts/common.sh@354 -- # echo 1 00:15:27.120 21:05:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:27.120 21:05:22 -- scripts/common.sh@365 -- # decimal 2 00:15:27.120 21:05:22 -- scripts/common.sh@352 -- # local d=2 00:15:27.120 21:05:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:27.120 21:05:22 -- scripts/common.sh@354 -- # echo 2 00:15:27.120 21:05:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:27.120 21:05:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:27.120 21:05:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:27.120 21:05:22 -- scripts/common.sh@367 -- # return 0 00:15:27.120 21:05:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:27.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.120 --rc genhtml_branch_coverage=1 00:15:27.120 --rc genhtml_function_coverage=1 00:15:27.120 --rc genhtml_legend=1 00:15:27.120 --rc geninfo_all_blocks=1 00:15:27.120 --rc geninfo_unexecuted_blocks=1 00:15:27.120 00:15:27.120 ' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:27.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.120 --rc genhtml_branch_coverage=1 00:15:27.120 --rc genhtml_function_coverage=1 00:15:27.120 --rc genhtml_legend=1 00:15:27.120 --rc geninfo_all_blocks=1 00:15:27.120 --rc geninfo_unexecuted_blocks=1 00:15:27.120 00:15:27.120 ' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:27.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.120 --rc genhtml_branch_coverage=1 00:15:27.120 --rc genhtml_function_coverage=1 00:15:27.120 --rc genhtml_legend=1 00:15:27.120 --rc geninfo_all_blocks=1 00:15:27.120 --rc geninfo_unexecuted_blocks=1 00:15:27.120 00:15:27.120 ' 00:15:27.120 21:05:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:27.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.120 --rc genhtml_branch_coverage=1 00:15:27.120 --rc genhtml_function_coverage=1 00:15:27.120 --rc genhtml_legend=1 00:15:27.120 --rc geninfo_all_blocks=1 00:15:27.120 --rc geninfo_unexecuted_blocks=1 00:15:27.120 00:15:27.120 ' 00:15:27.120 21:05:22 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:27.120 21:05:22 -- nvmf/common.sh@7 -- # uname -s 00:15:27.120 21:05:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:27.120 21:05:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:27.120 21:05:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:27.120 21:05:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:27.120 21:05:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:27.120 21:05:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:27.120 21:05:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:27.120 21:05:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:27.120 21:05:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:27.120 21:05:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:27.120 21:05:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.120 21:05:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.120 21:05:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:27.120 21:05:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:27.120 21:05:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:27.120 21:05:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:27.120 21:05:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:27.120 21:05:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:27.120 21:05:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:27.120 21:05:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.120 21:05:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.120 21:05:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.120 21:05:22 -- paths/export.sh@5 -- # export PATH 00:15:27.120 21:05:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.120 21:05:22 -- nvmf/common.sh@46 -- # : 0 00:15:27.120 21:05:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:27.120 21:05:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:27.120 21:05:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:27.120 21:05:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:27.120 21:05:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:27.120 21:05:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:27.120 21:05:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:27.120 21:05:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:27.120 21:05:22 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:27.120 21:05:22 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:27.120 21:05:22 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:27.120 21:05:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:27.120 21:05:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:27.120 21:05:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:27.120 21:05:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:27.120 21:05:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:27.120 21:05:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:27.120 21:05:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:27.120 21:05:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.120 21:05:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:27.120 21:05:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:27.120 21:05:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:27.120 21:05:22 -- common/autotest_common.sh@10 -- # set +x 00:15:29.024 21:05:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:29.024 21:05:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:29.024 21:05:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:29.024 21:05:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:29.024 21:05:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:29.024 21:05:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:29.024 21:05:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:29.024 21:05:25 -- nvmf/common.sh@294 -- # net_devs=() 00:15:29.024 21:05:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:29.024 21:05:25 -- nvmf/common.sh@295 -- # e810=() 00:15:29.024 21:05:25 -- nvmf/common.sh@295 -- # local -ga e810 00:15:29.024 21:05:25 -- nvmf/common.sh@296 -- # x722=() 00:15:29.024 21:05:25 -- nvmf/common.sh@296 -- # local -ga x722 00:15:29.024 21:05:25 -- nvmf/common.sh@297 -- # mlx=() 00:15:29.024 21:05:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:29.024 21:05:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:29.024 21:05:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:29.024 21:05:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:29.024 21:05:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:29.024 21:05:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:29.024 21:05:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:29.025 21:05:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.025 21:05:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:29.025 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:29.025 21:05:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.025 21:05:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:29.025 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:29.025 21:05:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.025 21:05:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.025 21:05:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.025 21:05:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:29.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:29.025 21:05:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.025 21:05:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.025 21:05:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.025 21:05:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:29.025 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:29.025 21:05:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:29.025 21:05:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:29.025 21:05:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:29.025 21:05:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:29.025 21:05:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:29.025 21:05:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:29.025 21:05:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:29.025 21:05:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:29.025 21:05:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:29.025 21:05:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:29.025 21:05:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:29.025 21:05:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:29.025 21:05:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:29.025 21:05:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:29.025 21:05:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:29.025 21:05:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:29.025 21:05:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:29.025 21:05:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:29.025 21:05:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:29.025 21:05:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:29.025 21:05:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:29.025 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:29.025 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:15:29.025 00:15:29.025 --- 10.0.0.2 ping statistics --- 00:15:29.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.025 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:15:29.025 21:05:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:29.025 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:29.025 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:15:29.025 00:15:29.025 --- 10.0.0.1 ping statistics --- 00:15:29.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.025 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:29.025 21:05:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:29.025 21:05:25 -- nvmf/common.sh@410 -- # return 0 00:15:29.025 21:05:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:29.025 21:05:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:29.025 21:05:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:29.025 21:05:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:29.025 21:05:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:29.025 21:05:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:29.284 21:05:25 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:29.284 21:05:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:29.284 21:05:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:29.284 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.284 21:05:25 -- nvmf/common.sh@469 -- # nvmfpid=3972965 00:15:29.284 21:05:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:29.284 21:05:25 -- nvmf/common.sh@470 -- # waitforlisten 3972965 00:15:29.284 21:05:25 -- common/autotest_common.sh@829 -- # '[' -z 3972965 ']' 00:15:29.284 21:05:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.284 21:05:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:29.284 21:05:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.284 21:05:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:29.284 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.284 [2024-11-27 21:05:25.333360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.284 [2024-11-27 21:05:25.333452] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:29.284 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.284 [2024-11-27 21:05:25.397830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:29.284 [2024-11-27 21:05:25.509274] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:29.284 [2024-11-27 21:05:25.509453] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:29.284 [2024-11-27 21:05:25.509472] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:29.284 [2024-11-27 21:05:25.509485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:29.284 [2024-11-27 21:05:25.509647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:29.284 [2024-11-27 21:05:25.509714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:29.284 [2024-11-27 21:05:25.509770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:29.284 [2024-11-27 21:05:25.509774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.542 21:05:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.543 21:05:25 -- common/autotest_common.sh@862 -- # return 0 00:15:29.543 21:05:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:29.543 21:05:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 21:05:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 [2024-11-27 21:05:25.654734] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 Malloc0 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:29.543 21:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.543 21:05:25 -- common/autotest_common.sh@10 -- # set +x 00:15:29.543 [2024-11-27 21:05:25.717148] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:29.543 21:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3973107 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@30 -- # READ_PID=3973109 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3973111 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # config=() 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # config=() 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:29.543 21:05:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:29.543 21:05:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:29.543 { 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme$subsystem", 00:15:29.543 "trtype": "$TEST_TRANSPORT", 00:15:29.543 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "$NVMF_PORT", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:29.543 "hdgst": ${hdgst:-false}, 00:15:29.543 "ddgst": ${ddgst:-false} 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 } 00:15:29.543 EOF 00:15:29.543 )") 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3973113 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:29.543 { 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme$subsystem", 00:15:29.543 "trtype": "$TEST_TRANSPORT", 00:15:29.543 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "$NVMF_PORT", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:29.543 "hdgst": ${hdgst:-false}, 00:15:29.543 "ddgst": ${ddgst:-false} 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 } 00:15:29.543 EOF 00:15:29.543 )") 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@35 -- # sync 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # config=() 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:29.543 21:05:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:29.543 { 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme$subsystem", 00:15:29.543 "trtype": "$TEST_TRANSPORT", 00:15:29.543 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "$NVMF_PORT", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:29.543 "hdgst": ${hdgst:-false}, 00:15:29.543 "ddgst": ${ddgst:-false} 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 } 00:15:29.543 EOF 00:15:29.543 )") 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # config=() 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # cat 00:15:29.543 21:05:25 -- nvmf/common.sh@520 -- # local subsystem config 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # cat 00:15:29.543 21:05:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:29.543 { 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme$subsystem", 00:15:29.543 "trtype": "$TEST_TRANSPORT", 00:15:29.543 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "$NVMF_PORT", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:29.543 "hdgst": ${hdgst:-false}, 00:15:29.543 "ddgst": ${ddgst:-false} 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 } 00:15:29.543 EOF 00:15:29.543 )") 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # cat 00:15:29.543 21:05:25 -- target/bdev_io_wait.sh@37 -- # wait 3973107 00:15:29.543 21:05:25 -- nvmf/common.sh@542 -- # cat 00:15:29.543 21:05:25 -- nvmf/common.sh@544 -- # jq . 00:15:29.543 21:05:25 -- nvmf/common.sh@544 -- # jq . 00:15:29.543 21:05:25 -- nvmf/common.sh@544 -- # jq . 00:15:29.543 21:05:25 -- nvmf/common.sh@544 -- # jq . 00:15:29.543 21:05:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:29.543 21:05:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:29.543 21:05:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme1", 00:15:29.543 "trtype": "tcp", 00:15:29.543 "traddr": "10.0.0.2", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "4420", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:29.543 "hdgst": false, 00:15:29.543 "ddgst": false 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 }' 00:15:29.543 21:05:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme1", 00:15:29.543 "trtype": "tcp", 00:15:29.543 "traddr": "10.0.0.2", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "4420", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:29.543 "hdgst": false, 00:15:29.543 "ddgst": false 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 }' 00:15:29.543 21:05:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:29.543 21:05:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme1", 00:15:29.543 "trtype": "tcp", 00:15:29.543 "traddr": "10.0.0.2", 00:15:29.543 "adrfam": "ipv4", 00:15:29.543 "trsvcid": "4420", 00:15:29.543 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:29.543 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:29.543 "hdgst": false, 00:15:29.543 "ddgst": false 00:15:29.543 }, 00:15:29.543 "method": "bdev_nvme_attach_controller" 00:15:29.543 }' 00:15:29.543 21:05:25 -- nvmf/common.sh@545 -- # IFS=, 00:15:29.543 21:05:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:29.543 "params": { 00:15:29.543 "name": "Nvme1", 00:15:29.543 "trtype": "tcp", 00:15:29.543 "traddr": "10.0.0.2", 00:15:29.544 "adrfam": "ipv4", 00:15:29.544 "trsvcid": "4420", 00:15:29.544 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:29.544 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:29.544 "hdgst": false, 00:15:29.544 "ddgst": false 00:15:29.544 }, 00:15:29.544 "method": "bdev_nvme_attach_controller" 00:15:29.544 }' 00:15:29.544 [2024-11-27 21:05:25.760312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.544 [2024-11-27 21:05:25.760314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.544 [2024-11-27 21:05:25.760312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.544 [2024-11-27 21:05:25.760321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.544 [2024-11-27 21:05:25.760401] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:29.544 [2024-11-27 21:05:25.760403] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 21:05:25.760404] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 21:05:25.760404] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:29.544 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:29.544 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:29.802 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.802 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.802 [2024-11-27 21:05:25.933030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.802 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.802 [2024-11-27 21:05:26.028768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:29.802 [2024-11-27 21:05:26.033769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:30.061 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.061 [2024-11-27 21:05:26.127685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:30.061 [2024-11-27 21:05:26.132416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:30.061 [2024-11-27 21:05:26.199181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:30.061 [2024-11-27 21:05:26.224841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:30.061 [2024-11-27 21:05:26.289189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:30.319 Running I/O for 1 seconds... 00:15:30.319 Running I/O for 1 seconds... 00:15:30.319 Running I/O for 1 seconds... 00:15:30.577 Running I/O for 1 seconds... 00:15:31.142 00:15:31.142 Latency(us) 00:15:31.142 [2024-11-27T20:05:27.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:31.142 [2024-11-27T20:05:27.383Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:31.142 Nvme1n1 : 1.02 6568.23 25.66 0.00 0.00 19312.95 8155.59 30874.74 00:15:31.142 [2024-11-27T20:05:27.383Z] =================================================================================================================== 00:15:31.142 [2024-11-27T20:05:27.383Z] Total : 6568.23 25.66 0.00 0.00 19312.95 8155.59 30874.74 00:15:31.142 00:15:31.142 Latency(us) 00:15:31.142 [2024-11-27T20:05:27.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:31.142 [2024-11-27T20:05:27.383Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:31.142 Nvme1n1 : 1.00 184288.97 719.88 0.00 0.00 691.92 271.55 946.63 00:15:31.142 [2024-11-27T20:05:27.383Z] =================================================================================================================== 00:15:31.142 [2024-11-27T20:05:27.383Z] Total : 184288.97 719.88 0.00 0.00 691.92 271.55 946.63 00:15:31.400 00:15:31.400 Latency(us) 00:15:31.400 [2024-11-27T20:05:27.641Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:31.400 [2024-11-27T20:05:27.641Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:31.400 Nvme1n1 : 1.01 9610.88 37.54 0.00 0.00 13262.53 7136.14 25437.68 00:15:31.400 [2024-11-27T20:05:27.641Z] =================================================================================================================== 00:15:31.400 [2024-11-27T20:05:27.641Z] Total : 9610.88 37.54 0.00 0.00 13262.53 7136.14 25437.68 00:15:31.400 00:15:31.400 Latency(us) 00:15:31.400 [2024-11-27T20:05:27.641Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:31.400 [2024-11-27T20:05:27.641Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:31.400 Nvme1n1 : 1.01 10286.82 40.18 0.00 0.00 12398.90 6068.15 24078.41 00:15:31.400 [2024-11-27T20:05:27.641Z] =================================================================================================================== 00:15:31.400 [2024-11-27T20:05:27.641Z] Total : 10286.82 40.18 0.00 0.00 12398.90 6068.15 24078.41 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@38 -- # wait 3973109 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@39 -- # wait 3973111 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@40 -- # wait 3973113 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:31.658 21:05:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.658 21:05:27 -- common/autotest_common.sh@10 -- # set +x 00:15:31.658 21:05:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:31.658 21:05:27 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:31.658 21:05:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:31.658 21:05:27 -- nvmf/common.sh@116 -- # sync 00:15:31.658 21:05:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:31.658 21:05:27 -- nvmf/common.sh@119 -- # set +e 00:15:31.658 21:05:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:31.658 21:05:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:31.658 rmmod nvme_tcp 00:15:31.916 rmmod nvme_fabrics 00:15:31.916 rmmod nvme_keyring 00:15:31.916 21:05:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:31.916 21:05:27 -- nvmf/common.sh@123 -- # set -e 00:15:31.916 21:05:27 -- nvmf/common.sh@124 -- # return 0 00:15:31.916 21:05:27 -- nvmf/common.sh@477 -- # '[' -n 3972965 ']' 00:15:31.916 21:05:27 -- nvmf/common.sh@478 -- # killprocess 3972965 00:15:31.916 21:05:27 -- common/autotest_common.sh@936 -- # '[' -z 3972965 ']' 00:15:31.916 21:05:27 -- common/autotest_common.sh@940 -- # kill -0 3972965 00:15:31.916 21:05:27 -- common/autotest_common.sh@941 -- # uname 00:15:31.916 21:05:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:31.916 21:05:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3972965 00:15:31.916 21:05:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:31.916 21:05:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:31.916 21:05:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3972965' 00:15:31.916 killing process with pid 3972965 00:15:31.916 21:05:27 -- common/autotest_common.sh@955 -- # kill 3972965 00:15:31.916 21:05:27 -- common/autotest_common.sh@960 -- # wait 3972965 00:15:32.175 21:05:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:32.175 21:05:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:32.175 21:05:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:32.175 21:05:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:32.175 21:05:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:32.175 21:05:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:32.175 21:05:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:32.175 21:05:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:34.080 21:05:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:34.080 00:15:34.080 real 0m7.473s 00:15:34.080 user 0m16.142s 00:15:34.080 sys 0m3.910s 00:15:34.080 21:05:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:34.080 21:05:30 -- common/autotest_common.sh@10 -- # set +x 00:15:34.080 ************************************ 00:15:34.080 END TEST nvmf_bdev_io_wait 00:15:34.080 ************************************ 00:15:34.080 21:05:30 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:34.080 21:05:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:34.080 21:05:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:34.080 21:05:30 -- common/autotest_common.sh@10 -- # set +x 00:15:34.080 ************************************ 00:15:34.080 START TEST nvmf_queue_depth 00:15:34.080 ************************************ 00:15:34.080 21:05:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:34.338 * Looking for test storage... 00:15:34.338 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:34.338 21:05:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:34.338 21:05:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:34.338 21:05:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:34.338 21:05:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:34.338 21:05:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:34.338 21:05:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:34.338 21:05:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:34.338 21:05:30 -- scripts/common.sh@335 -- # IFS=.-: 00:15:34.338 21:05:30 -- scripts/common.sh@335 -- # read -ra ver1 00:15:34.338 21:05:30 -- scripts/common.sh@336 -- # IFS=.-: 00:15:34.338 21:05:30 -- scripts/common.sh@336 -- # read -ra ver2 00:15:34.338 21:05:30 -- scripts/common.sh@337 -- # local 'op=<' 00:15:34.338 21:05:30 -- scripts/common.sh@339 -- # ver1_l=2 00:15:34.338 21:05:30 -- scripts/common.sh@340 -- # ver2_l=1 00:15:34.338 21:05:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:34.338 21:05:30 -- scripts/common.sh@343 -- # case "$op" in 00:15:34.338 21:05:30 -- scripts/common.sh@344 -- # : 1 00:15:34.338 21:05:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:34.338 21:05:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:34.338 21:05:30 -- scripts/common.sh@364 -- # decimal 1 00:15:34.338 21:05:30 -- scripts/common.sh@352 -- # local d=1 00:15:34.338 21:05:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:34.338 21:05:30 -- scripts/common.sh@354 -- # echo 1 00:15:34.338 21:05:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:34.338 21:05:30 -- scripts/common.sh@365 -- # decimal 2 00:15:34.338 21:05:30 -- scripts/common.sh@352 -- # local d=2 00:15:34.338 21:05:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:34.338 21:05:30 -- scripts/common.sh@354 -- # echo 2 00:15:34.338 21:05:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:34.338 21:05:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:34.338 21:05:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:34.338 21:05:30 -- scripts/common.sh@367 -- # return 0 00:15:34.338 21:05:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:34.339 21:05:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:34.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:34.339 --rc genhtml_branch_coverage=1 00:15:34.339 --rc genhtml_function_coverage=1 00:15:34.339 --rc genhtml_legend=1 00:15:34.339 --rc geninfo_all_blocks=1 00:15:34.339 --rc geninfo_unexecuted_blocks=1 00:15:34.339 00:15:34.339 ' 00:15:34.339 21:05:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:34.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:34.339 --rc genhtml_branch_coverage=1 00:15:34.339 --rc genhtml_function_coverage=1 00:15:34.339 --rc genhtml_legend=1 00:15:34.339 --rc geninfo_all_blocks=1 00:15:34.339 --rc geninfo_unexecuted_blocks=1 00:15:34.339 00:15:34.339 ' 00:15:34.339 21:05:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:34.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:34.339 --rc genhtml_branch_coverage=1 00:15:34.339 --rc genhtml_function_coverage=1 00:15:34.339 --rc genhtml_legend=1 00:15:34.339 --rc geninfo_all_blocks=1 00:15:34.339 --rc geninfo_unexecuted_blocks=1 00:15:34.339 00:15:34.339 ' 00:15:34.339 21:05:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:34.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:34.339 --rc genhtml_branch_coverage=1 00:15:34.339 --rc genhtml_function_coverage=1 00:15:34.339 --rc genhtml_legend=1 00:15:34.339 --rc geninfo_all_blocks=1 00:15:34.339 --rc geninfo_unexecuted_blocks=1 00:15:34.339 00:15:34.339 ' 00:15:34.339 21:05:30 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:34.339 21:05:30 -- nvmf/common.sh@7 -- # uname -s 00:15:34.339 21:05:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:34.339 21:05:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:34.339 21:05:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:34.339 21:05:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:34.339 21:05:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:34.339 21:05:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:34.339 21:05:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:34.339 21:05:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:34.339 21:05:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:34.339 21:05:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:34.339 21:05:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:34.339 21:05:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:34.339 21:05:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:34.339 21:05:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:34.339 21:05:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:34.339 21:05:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:34.339 21:05:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:34.339 21:05:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:34.339 21:05:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:34.339 21:05:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:34.339 21:05:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:34.339 21:05:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:34.339 21:05:30 -- paths/export.sh@5 -- # export PATH 00:15:34.339 21:05:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:34.339 21:05:30 -- nvmf/common.sh@46 -- # : 0 00:15:34.339 21:05:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:34.339 21:05:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:34.339 21:05:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:34.339 21:05:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:34.339 21:05:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:34.339 21:05:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:34.339 21:05:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:34.339 21:05:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:34.339 21:05:30 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:34.339 21:05:30 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:34.339 21:05:30 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:34.339 21:05:30 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:34.339 21:05:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:34.339 21:05:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:34.339 21:05:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:34.339 21:05:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:34.339 21:05:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:34.339 21:05:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:34.339 21:05:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:34.339 21:05:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:34.339 21:05:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:34.339 21:05:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:34.339 21:05:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:34.339 21:05:30 -- common/autotest_common.sh@10 -- # set +x 00:15:36.241 21:05:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:36.241 21:05:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:36.241 21:05:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:36.241 21:05:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:36.241 21:05:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:36.241 21:05:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:36.241 21:05:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:36.241 21:05:32 -- nvmf/common.sh@294 -- # net_devs=() 00:15:36.241 21:05:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:36.241 21:05:32 -- nvmf/common.sh@295 -- # e810=() 00:15:36.241 21:05:32 -- nvmf/common.sh@295 -- # local -ga e810 00:15:36.241 21:05:32 -- nvmf/common.sh@296 -- # x722=() 00:15:36.241 21:05:32 -- nvmf/common.sh@296 -- # local -ga x722 00:15:36.241 21:05:32 -- nvmf/common.sh@297 -- # mlx=() 00:15:36.241 21:05:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:36.241 21:05:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:36.241 21:05:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:36.241 21:05:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:36.241 21:05:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:36.241 21:05:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:36.241 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:36.241 21:05:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:36.241 21:05:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:36.241 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:36.241 21:05:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:36.241 21:05:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:36.241 21:05:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:36.241 21:05:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:36.241 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:36.241 21:05:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:36.241 21:05:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:36.241 21:05:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:36.241 21:05:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:36.241 21:05:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:36.241 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:36.241 21:05:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:36.241 21:05:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:36.241 21:05:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:36.241 21:05:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:36.241 21:05:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:36.241 21:05:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:36.241 21:05:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:36.241 21:05:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:36.241 21:05:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:36.241 21:05:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:36.241 21:05:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:36.241 21:05:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:36.241 21:05:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:36.241 21:05:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:36.241 21:05:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:36.241 21:05:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:36.241 21:05:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:36.241 21:05:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:36.241 21:05:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:36.500 21:05:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:36.500 21:05:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:36.500 21:05:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:36.500 21:05:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:36.500 21:05:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:36.500 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:36.500 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.123 ms 00:15:36.500 00:15:36.500 --- 10.0.0.2 ping statistics --- 00:15:36.500 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:36.500 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:15:36.500 21:05:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:36.500 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:36.500 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:15:36.500 00:15:36.500 --- 10.0.0.1 ping statistics --- 00:15:36.500 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:36.500 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:15:36.500 21:05:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:36.500 21:05:32 -- nvmf/common.sh@410 -- # return 0 00:15:36.500 21:05:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:36.500 21:05:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:36.500 21:05:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:36.500 21:05:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:36.500 21:05:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:36.500 21:05:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:36.500 21:05:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:36.500 21:05:32 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:36.500 21:05:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:36.500 21:05:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:36.500 21:05:32 -- common/autotest_common.sh@10 -- # set +x 00:15:36.500 21:05:32 -- nvmf/common.sh@469 -- # nvmfpid=3975359 00:15:36.500 21:05:32 -- nvmf/common.sh@470 -- # waitforlisten 3975359 00:15:36.500 21:05:32 -- common/autotest_common.sh@829 -- # '[' -z 3975359 ']' 00:15:36.500 21:05:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:36.500 21:05:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:36.500 21:05:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:36.500 21:05:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:36.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:36.500 21:05:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:36.500 21:05:32 -- common/autotest_common.sh@10 -- # set +x 00:15:36.500 [2024-11-27 21:05:32.606551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:36.500 [2024-11-27 21:05:32.606635] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:36.500 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.500 [2024-11-27 21:05:32.674632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:36.758 [2024-11-27 21:05:32.788307] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:36.758 [2024-11-27 21:05:32.788464] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:36.758 [2024-11-27 21:05:32.788484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:36.758 [2024-11-27 21:05:32.788498] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:36.758 [2024-11-27 21:05:32.788555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:37.323 21:05:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:37.323 21:05:33 -- common/autotest_common.sh@862 -- # return 0 00:15:37.323 21:05:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:37.323 21:05:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:37.323 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.581 21:05:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:37.582 21:05:33 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:37.582 21:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 [2024-11-27 21:05:33.586708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:37.582 21:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.582 21:05:33 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:37.582 21:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 Malloc0 00:15:37.582 21:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.582 21:05:33 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:37.582 21:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 21:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.582 21:05:33 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:37.582 21:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 21:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.582 21:05:33 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:37.582 21:05:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 [2024-11-27 21:05:33.644560] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:37.582 21:05:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.582 21:05:33 -- target/queue_depth.sh@30 -- # bdevperf_pid=3975515 00:15:37.582 21:05:33 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:37.582 21:05:33 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:37.582 21:05:33 -- target/queue_depth.sh@33 -- # waitforlisten 3975515 /var/tmp/bdevperf.sock 00:15:37.582 21:05:33 -- common/autotest_common.sh@829 -- # '[' -z 3975515 ']' 00:15:37.582 21:05:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:37.582 21:05:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:37.582 21:05:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:37.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:37.582 21:05:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:37.582 21:05:33 -- common/autotest_common.sh@10 -- # set +x 00:15:37.582 [2024-11-27 21:05:33.682958] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:37.582 [2024-11-27 21:05:33.683017] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3975515 ] 00:15:37.582 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.582 [2024-11-27 21:05:33.743707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:37.839 [2024-11-27 21:05:33.858763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.773 21:05:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:38.773 21:05:34 -- common/autotest_common.sh@862 -- # return 0 00:15:38.773 21:05:34 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:38.773 21:05:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.773 21:05:34 -- common/autotest_common.sh@10 -- # set +x 00:15:38.773 NVMe0n1 00:15:38.773 21:05:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.773 21:05:34 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:38.774 Running I/O for 10 seconds... 00:15:48.747 00:15:48.747 Latency(us) 00:15:48.747 [2024-11-27T20:05:44.988Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:48.747 [2024-11-27T20:05:44.988Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:48.747 Verification LBA range: start 0x0 length 0x4000 00:15:48.747 NVMe0n1 : 10.07 12239.11 47.81 0.00 0.00 83337.91 13495.56 60196.03 00:15:48.747 [2024-11-27T20:05:44.988Z] =================================================================================================================== 00:15:48.747 [2024-11-27T20:05:44.988Z] Total : 12239.11 47.81 0.00 0.00 83337.91 13495.56 60196.03 00:15:48.747 0 00:15:48.747 21:05:44 -- target/queue_depth.sh@39 -- # killprocess 3975515 00:15:48.747 21:05:44 -- common/autotest_common.sh@936 -- # '[' -z 3975515 ']' 00:15:48.747 21:05:44 -- common/autotest_common.sh@940 -- # kill -0 3975515 00:15:48.747 21:05:44 -- common/autotest_common.sh@941 -- # uname 00:15:48.747 21:05:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.747 21:05:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3975515 00:15:49.005 21:05:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:49.005 21:05:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:49.005 21:05:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3975515' 00:15:49.005 killing process with pid 3975515 00:15:49.005 21:05:45 -- common/autotest_common.sh@955 -- # kill 3975515 00:15:49.005 Received shutdown signal, test time was about 10.000000 seconds 00:15:49.005 00:15:49.005 Latency(us) 00:15:49.005 [2024-11-27T20:05:45.246Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:49.005 [2024-11-27T20:05:45.246Z] =================================================================================================================== 00:15:49.005 [2024-11-27T20:05:45.246Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:49.005 21:05:45 -- common/autotest_common.sh@960 -- # wait 3975515 00:15:49.263 21:05:45 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:49.263 21:05:45 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:49.263 21:05:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:49.263 21:05:45 -- nvmf/common.sh@116 -- # sync 00:15:49.263 21:05:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:49.263 21:05:45 -- nvmf/common.sh@119 -- # set +e 00:15:49.263 21:05:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:49.263 21:05:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:49.263 rmmod nvme_tcp 00:15:49.263 rmmod nvme_fabrics 00:15:49.263 rmmod nvme_keyring 00:15:49.263 21:05:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:49.263 21:05:45 -- nvmf/common.sh@123 -- # set -e 00:15:49.263 21:05:45 -- nvmf/common.sh@124 -- # return 0 00:15:49.263 21:05:45 -- nvmf/common.sh@477 -- # '[' -n 3975359 ']' 00:15:49.263 21:05:45 -- nvmf/common.sh@478 -- # killprocess 3975359 00:15:49.263 21:05:45 -- common/autotest_common.sh@936 -- # '[' -z 3975359 ']' 00:15:49.263 21:05:45 -- common/autotest_common.sh@940 -- # kill -0 3975359 00:15:49.263 21:05:45 -- common/autotest_common.sh@941 -- # uname 00:15:49.263 21:05:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:49.263 21:05:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3975359 00:15:49.263 21:05:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:49.263 21:05:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:49.263 21:05:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3975359' 00:15:49.263 killing process with pid 3975359 00:15:49.263 21:05:45 -- common/autotest_common.sh@955 -- # kill 3975359 00:15:49.263 21:05:45 -- common/autotest_common.sh@960 -- # wait 3975359 00:15:49.521 21:05:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.521 21:05:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.521 21:05:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.521 21:05:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.521 21:05:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.521 21:05:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.521 21:05:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.521 21:05:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.055 21:05:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:52.055 00:15:52.055 real 0m17.385s 00:15:52.055 user 0m24.964s 00:15:52.055 sys 0m3.114s 00:15:52.055 21:05:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:52.055 21:05:47 -- common/autotest_common.sh@10 -- # set +x 00:15:52.055 ************************************ 00:15:52.055 END TEST nvmf_queue_depth 00:15:52.055 ************************************ 00:15:52.055 21:05:47 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:52.055 21:05:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.055 21:05:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.055 21:05:47 -- common/autotest_common.sh@10 -- # set +x 00:15:52.055 ************************************ 00:15:52.055 START TEST nvmf_multipath 00:15:52.055 ************************************ 00:15:52.055 21:05:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:52.055 * Looking for test storage... 00:15:52.055 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:52.055 21:05:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:52.055 21:05:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:52.055 21:05:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:52.055 21:05:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:52.055 21:05:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:52.055 21:05:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:52.055 21:05:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:52.055 21:05:47 -- scripts/common.sh@335 -- # IFS=.-: 00:15:52.055 21:05:47 -- scripts/common.sh@335 -- # read -ra ver1 00:15:52.055 21:05:47 -- scripts/common.sh@336 -- # IFS=.-: 00:15:52.055 21:05:47 -- scripts/common.sh@336 -- # read -ra ver2 00:15:52.055 21:05:47 -- scripts/common.sh@337 -- # local 'op=<' 00:15:52.055 21:05:47 -- scripts/common.sh@339 -- # ver1_l=2 00:15:52.055 21:05:47 -- scripts/common.sh@340 -- # ver2_l=1 00:15:52.055 21:05:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:52.055 21:05:47 -- scripts/common.sh@343 -- # case "$op" in 00:15:52.055 21:05:47 -- scripts/common.sh@344 -- # : 1 00:15:52.056 21:05:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:52.056 21:05:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.056 21:05:47 -- scripts/common.sh@364 -- # decimal 1 00:15:52.056 21:05:47 -- scripts/common.sh@352 -- # local d=1 00:15:52.056 21:05:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:52.056 21:05:47 -- scripts/common.sh@354 -- # echo 1 00:15:52.056 21:05:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:52.056 21:05:47 -- scripts/common.sh@365 -- # decimal 2 00:15:52.056 21:05:47 -- scripts/common.sh@352 -- # local d=2 00:15:52.056 21:05:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:52.056 21:05:47 -- scripts/common.sh@354 -- # echo 2 00:15:52.056 21:05:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:52.056 21:05:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:52.056 21:05:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:52.056 21:05:47 -- scripts/common.sh@367 -- # return 0 00:15:52.056 21:05:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:52.056 21:05:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:52.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.056 --rc genhtml_branch_coverage=1 00:15:52.056 --rc genhtml_function_coverage=1 00:15:52.056 --rc genhtml_legend=1 00:15:52.056 --rc geninfo_all_blocks=1 00:15:52.056 --rc geninfo_unexecuted_blocks=1 00:15:52.056 00:15:52.056 ' 00:15:52.056 21:05:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:52.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.056 --rc genhtml_branch_coverage=1 00:15:52.056 --rc genhtml_function_coverage=1 00:15:52.056 --rc genhtml_legend=1 00:15:52.056 --rc geninfo_all_blocks=1 00:15:52.056 --rc geninfo_unexecuted_blocks=1 00:15:52.056 00:15:52.056 ' 00:15:52.056 21:05:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:52.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.056 --rc genhtml_branch_coverage=1 00:15:52.056 --rc genhtml_function_coverage=1 00:15:52.056 --rc genhtml_legend=1 00:15:52.056 --rc geninfo_all_blocks=1 00:15:52.056 --rc geninfo_unexecuted_blocks=1 00:15:52.056 00:15:52.056 ' 00:15:52.056 21:05:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:52.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.056 --rc genhtml_branch_coverage=1 00:15:52.056 --rc genhtml_function_coverage=1 00:15:52.056 --rc genhtml_legend=1 00:15:52.056 --rc geninfo_all_blocks=1 00:15:52.056 --rc geninfo_unexecuted_blocks=1 00:15:52.056 00:15:52.056 ' 00:15:52.056 21:05:47 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:52.056 21:05:47 -- nvmf/common.sh@7 -- # uname -s 00:15:52.056 21:05:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:52.056 21:05:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:52.056 21:05:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:52.056 21:05:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:52.056 21:05:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:52.056 21:05:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:52.056 21:05:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:52.056 21:05:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:52.056 21:05:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:52.056 21:05:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:52.056 21:05:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.056 21:05:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.056 21:05:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:52.056 21:05:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:52.056 21:05:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:52.056 21:05:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:52.056 21:05:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:52.056 21:05:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:52.056 21:05:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:52.056 21:05:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.056 21:05:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.056 21:05:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.056 21:05:47 -- paths/export.sh@5 -- # export PATH 00:15:52.056 21:05:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.056 21:05:47 -- nvmf/common.sh@46 -- # : 0 00:15:52.056 21:05:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:52.056 21:05:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:52.056 21:05:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:52.056 21:05:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:52.056 21:05:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:52.056 21:05:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:52.056 21:05:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:52.056 21:05:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:52.056 21:05:47 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:52.056 21:05:47 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:52.056 21:05:47 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:52.056 21:05:47 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:52.056 21:05:47 -- target/multipath.sh@43 -- # nvmftestinit 00:15:52.056 21:05:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:52.056 21:05:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:52.056 21:05:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:52.056 21:05:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:52.056 21:05:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:52.056 21:05:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.056 21:05:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.056 21:05:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.056 21:05:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:52.056 21:05:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:52.056 21:05:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:52.056 21:05:47 -- common/autotest_common.sh@10 -- # set +x 00:15:53.957 21:05:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:53.957 21:05:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:53.957 21:05:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:53.957 21:05:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:53.957 21:05:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:53.957 21:05:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:53.957 21:05:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:53.957 21:05:49 -- nvmf/common.sh@294 -- # net_devs=() 00:15:53.957 21:05:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:53.957 21:05:49 -- nvmf/common.sh@295 -- # e810=() 00:15:53.957 21:05:49 -- nvmf/common.sh@295 -- # local -ga e810 00:15:53.957 21:05:49 -- nvmf/common.sh@296 -- # x722=() 00:15:53.957 21:05:49 -- nvmf/common.sh@296 -- # local -ga x722 00:15:53.957 21:05:49 -- nvmf/common.sh@297 -- # mlx=() 00:15:53.957 21:05:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:53.957 21:05:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:53.957 21:05:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:53.957 21:05:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:53.957 21:05:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.957 21:05:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:53.957 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:53.957 21:05:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.957 21:05:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:53.957 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:53.957 21:05:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.957 21:05:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.957 21:05:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.957 21:05:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:53.957 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:53.957 21:05:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.957 21:05:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.957 21:05:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.957 21:05:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.957 21:05:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:53.957 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:53.957 21:05:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.957 21:05:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:53.957 21:05:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:53.957 21:05:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:53.957 21:05:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:53.957 21:05:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:53.957 21:05:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:53.957 21:05:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:53.957 21:05:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:53.957 21:05:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:53.957 21:05:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:53.957 21:05:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:53.957 21:05:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:53.957 21:05:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:53.957 21:05:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:53.957 21:05:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:53.957 21:05:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:53.957 21:05:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:53.957 21:05:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:53.957 21:05:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:53.957 21:05:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:53.957 21:05:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:53.957 21:05:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:53.957 21:05:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:53.957 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:53.957 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:15:53.957 00:15:53.957 --- 10.0.0.2 ping statistics --- 00:15:53.957 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.957 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:15:53.958 21:05:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:53.958 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:53.958 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:15:53.958 00:15:53.958 --- 10.0.0.1 ping statistics --- 00:15:53.958 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.958 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:15:53.958 21:05:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:53.958 21:05:49 -- nvmf/common.sh@410 -- # return 0 00:15:53.958 21:05:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:53.958 21:05:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:53.958 21:05:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:53.958 21:05:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:53.958 21:05:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:53.958 21:05:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:53.958 21:05:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:53.958 21:05:50 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:53.958 21:05:50 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:53.958 only one NIC for nvmf test 00:15:53.958 21:05:50 -- target/multipath.sh@47 -- # nvmftestfini 00:15:53.958 21:05:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:53.958 21:05:50 -- nvmf/common.sh@116 -- # sync 00:15:53.958 21:05:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:53.958 21:05:50 -- nvmf/common.sh@119 -- # set +e 00:15:53.958 21:05:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:53.958 21:05:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:53.958 rmmod nvme_tcp 00:15:53.958 rmmod nvme_fabrics 00:15:53.958 rmmod nvme_keyring 00:15:53.958 21:05:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:53.958 21:05:50 -- nvmf/common.sh@123 -- # set -e 00:15:53.958 21:05:50 -- nvmf/common.sh@124 -- # return 0 00:15:53.958 21:05:50 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:53.958 21:05:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:53.958 21:05:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:53.958 21:05:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:53.958 21:05:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:53.958 21:05:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:53.958 21:05:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:53.958 21:05:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:53.958 21:05:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.490 21:05:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.490 21:05:52 -- target/multipath.sh@48 -- # exit 0 00:15:56.490 21:05:52 -- target/multipath.sh@1 -- # nvmftestfini 00:15:56.490 21:05:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:56.490 21:05:52 -- nvmf/common.sh@116 -- # sync 00:15:56.490 21:05:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:56.490 21:05:52 -- nvmf/common.sh@119 -- # set +e 00:15:56.490 21:05:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:56.490 21:05:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:56.490 21:05:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:56.490 21:05:52 -- nvmf/common.sh@123 -- # set -e 00:15:56.490 21:05:52 -- nvmf/common.sh@124 -- # return 0 00:15:56.490 21:05:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:56.490 21:05:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:56.490 21:05:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:56.490 21:05:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:56.490 21:05:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:56.490 21:05:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:56.490 21:05:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.490 21:05:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.490 21:05:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.490 21:05:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.490 00:15:56.490 real 0m4.397s 00:15:56.490 user 0m0.864s 00:15:56.490 sys 0m1.506s 00:15:56.490 21:05:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:56.490 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.490 ************************************ 00:15:56.490 END TEST nvmf_multipath 00:15:56.490 ************************************ 00:15:56.491 21:05:52 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:56.491 21:05:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.491 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.491 ************************************ 00:15:56.491 START TEST nvmf_zcopy 00:15:56.491 ************************************ 00:15:56.491 21:05:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:56.491 * Looking for test storage... 00:15:56.491 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.491 21:05:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.491 21:05:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.491 21:05:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.491 21:05:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.491 21:05:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.491 21:05:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.491 21:05:52 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.491 21:05:52 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.491 21:05:52 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.491 21:05:52 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.491 21:05:52 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.491 21:05:52 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.491 21:05:52 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.491 21:05:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.491 21:05:52 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.491 21:05:52 -- scripts/common.sh@344 -- # : 1 00:15:56.491 21:05:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.491 21:05:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.491 21:05:52 -- scripts/common.sh@364 -- # decimal 1 00:15:56.491 21:05:52 -- scripts/common.sh@352 -- # local d=1 00:15:56.491 21:05:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.491 21:05:52 -- scripts/common.sh@354 -- # echo 1 00:15:56.491 21:05:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.491 21:05:52 -- scripts/common.sh@365 -- # decimal 2 00:15:56.491 21:05:52 -- scripts/common.sh@352 -- # local d=2 00:15:56.491 21:05:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.491 21:05:52 -- scripts/common.sh@354 -- # echo 2 00:15:56.491 21:05:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.491 21:05:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.491 21:05:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.491 21:05:52 -- scripts/common.sh@367 -- # return 0 00:15:56.491 21:05:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.491 --rc genhtml_branch_coverage=1 00:15:56.491 --rc genhtml_function_coverage=1 00:15:56.491 --rc genhtml_legend=1 00:15:56.491 --rc geninfo_all_blocks=1 00:15:56.491 --rc geninfo_unexecuted_blocks=1 00:15:56.491 00:15:56.491 ' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.491 --rc genhtml_branch_coverage=1 00:15:56.491 --rc genhtml_function_coverage=1 00:15:56.491 --rc genhtml_legend=1 00:15:56.491 --rc geninfo_all_blocks=1 00:15:56.491 --rc geninfo_unexecuted_blocks=1 00:15:56.491 00:15:56.491 ' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.491 --rc genhtml_branch_coverage=1 00:15:56.491 --rc genhtml_function_coverage=1 00:15:56.491 --rc genhtml_legend=1 00:15:56.491 --rc geninfo_all_blocks=1 00:15:56.491 --rc geninfo_unexecuted_blocks=1 00:15:56.491 00:15:56.491 ' 00:15:56.491 21:05:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.491 --rc genhtml_branch_coverage=1 00:15:56.491 --rc genhtml_function_coverage=1 00:15:56.491 --rc genhtml_legend=1 00:15:56.491 --rc geninfo_all_blocks=1 00:15:56.491 --rc geninfo_unexecuted_blocks=1 00:15:56.491 00:15:56.491 ' 00:15:56.491 21:05:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.491 21:05:52 -- nvmf/common.sh@7 -- # uname -s 00:15:56.491 21:05:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.491 21:05:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.491 21:05:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.491 21:05:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.491 21:05:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.491 21:05:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.491 21:05:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.491 21:05:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.491 21:05:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.491 21:05:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.491 21:05:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.491 21:05:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.491 21:05:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.491 21:05:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.491 21:05:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.491 21:05:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.491 21:05:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.491 21:05:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.491 21:05:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.491 21:05:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.491 21:05:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.491 21:05:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.491 21:05:52 -- paths/export.sh@5 -- # export PATH 00:15:56.491 21:05:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.491 21:05:52 -- nvmf/common.sh@46 -- # : 0 00:15:56.491 21:05:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.491 21:05:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.491 21:05:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.491 21:05:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.491 21:05:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.491 21:05:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.491 21:05:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.491 21:05:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.491 21:05:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:56.491 21:05:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.491 21:05:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.491 21:05:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.491 21:05:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.491 21:05:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.491 21:05:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.491 21:05:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.491 21:05:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.491 21:05:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.491 21:05:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.491 21:05:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.491 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:15:58.395 21:05:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.395 21:05:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.395 21:05:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.395 21:05:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.395 21:05:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.395 21:05:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.395 21:05:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.395 21:05:54 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.395 21:05:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.395 21:05:54 -- nvmf/common.sh@295 -- # e810=() 00:15:58.395 21:05:54 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.395 21:05:54 -- nvmf/common.sh@296 -- # x722=() 00:15:58.395 21:05:54 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.395 21:05:54 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.395 21:05:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.395 21:05:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.395 21:05:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.396 21:05:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.396 21:05:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.396 21:05:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.396 21:05:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.396 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.396 21:05:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.396 21:05:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.396 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.396 21:05:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.396 21:05:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.396 21:05:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.396 21:05:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.396 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.396 21:05:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.396 21:05:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.396 21:05:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.396 21:05:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.396 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.396 21:05:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.396 21:05:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.396 21:05:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.396 21:05:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.396 21:05:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.396 21:05:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.396 21:05:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.396 21:05:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.396 21:05:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.396 21:05:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.396 21:05:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.396 21:05:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.396 21:05:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.396 21:05:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.396 21:05:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.396 21:05:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.396 21:05:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.396 21:05:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.396 21:05:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.396 21:05:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.396 21:05:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.396 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.396 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:15:58.396 00:15:58.396 --- 10.0.0.2 ping statistics --- 00:15:58.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.396 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:15:58.396 21:05:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.396 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.396 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:15:58.396 00:15:58.396 --- 10.0.0.1 ping statistics --- 00:15:58.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.396 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:15:58.396 21:05:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.396 21:05:54 -- nvmf/common.sh@410 -- # return 0 00:15:58.396 21:05:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.396 21:05:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.396 21:05:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.396 21:05:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.396 21:05:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.396 21:05:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.396 21:05:54 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:58.396 21:05:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:58.396 21:05:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:58.396 21:05:54 -- common/autotest_common.sh@10 -- # set +x 00:15:58.396 21:05:54 -- nvmf/common.sh@469 -- # nvmfpid=3980776 00:15:58.396 21:05:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:58.396 21:05:54 -- nvmf/common.sh@470 -- # waitforlisten 3980776 00:15:58.396 21:05:54 -- common/autotest_common.sh@829 -- # '[' -z 3980776 ']' 00:15:58.396 21:05:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:58.396 21:05:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:58.396 21:05:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:58.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:58.396 21:05:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:58.396 21:05:54 -- common/autotest_common.sh@10 -- # set +x 00:15:58.396 [2024-11-27 21:05:54.613461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:58.396 [2024-11-27 21:05:54.613560] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:58.654 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.654 [2024-11-27 21:05:54.686611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:58.654 [2024-11-27 21:05:54.804859] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:58.654 [2024-11-27 21:05:54.805044] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:58.654 [2024-11-27 21:05:54.805065] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:58.654 [2024-11-27 21:05:54.805079] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:58.654 [2024-11-27 21:05:54.805112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:59.587 21:05:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:59.587 21:05:55 -- common/autotest_common.sh@862 -- # return 0 00:15:59.587 21:05:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:59.587 21:05:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 21:05:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:59.587 21:05:55 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:59.587 21:05:55 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 [2024-11-27 21:05:55.642751] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 [2024-11-27 21:05:55.658962] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 malloc0 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:59.587 21:05:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:59.587 21:05:55 -- common/autotest_common.sh@10 -- # set +x 00:15:59.587 21:05:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:59.587 21:05:55 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:59.587 21:05:55 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:59.587 21:05:55 -- nvmf/common.sh@520 -- # config=() 00:15:59.587 21:05:55 -- nvmf/common.sh@520 -- # local subsystem config 00:15:59.587 21:05:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:59.587 21:05:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:59.587 { 00:15:59.587 "params": { 00:15:59.587 "name": "Nvme$subsystem", 00:15:59.587 "trtype": "$TEST_TRANSPORT", 00:15:59.587 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:59.587 "adrfam": "ipv4", 00:15:59.587 "trsvcid": "$NVMF_PORT", 00:15:59.587 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:59.587 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:59.587 "hdgst": ${hdgst:-false}, 00:15:59.587 "ddgst": ${ddgst:-false} 00:15:59.587 }, 00:15:59.587 "method": "bdev_nvme_attach_controller" 00:15:59.587 } 00:15:59.587 EOF 00:15:59.587 )") 00:15:59.587 21:05:55 -- nvmf/common.sh@542 -- # cat 00:15:59.587 21:05:55 -- nvmf/common.sh@544 -- # jq . 00:15:59.587 21:05:55 -- nvmf/common.sh@545 -- # IFS=, 00:15:59.587 21:05:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:59.587 "params": { 00:15:59.587 "name": "Nvme1", 00:15:59.587 "trtype": "tcp", 00:15:59.587 "traddr": "10.0.0.2", 00:15:59.587 "adrfam": "ipv4", 00:15:59.587 "trsvcid": "4420", 00:15:59.587 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:59.588 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:59.588 "hdgst": false, 00:15:59.588 "ddgst": false 00:15:59.588 }, 00:15:59.588 "method": "bdev_nvme_attach_controller" 00:15:59.588 }' 00:15:59.588 [2024-11-27 21:05:55.737650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:59.588 [2024-11-27 21:05:55.737733] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3980931 ] 00:15:59.588 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.588 [2024-11-27 21:05:55.803742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:59.846 [2024-11-27 21:05:55.928357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:00.104 Running I/O for 10 seconds... 00:16:10.133 00:16:10.133 Latency(us) 00:16:10.133 [2024-11-27T20:06:06.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:10.133 [2024-11-27T20:06:06.374Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:10.133 Verification LBA range: start 0x0 length 0x1000 00:16:10.133 Nvme1n1 : 10.01 8649.65 67.58 0.00 0.00 14763.61 1007.31 23981.32 00:16:10.133 [2024-11-27T20:06:06.374Z] =================================================================================================================== 00:16:10.133 [2024-11-27T20:06:06.374Z] Total : 8649.65 67.58 0.00 0.00 14763.61 1007.31 23981.32 00:16:10.392 21:06:06 -- target/zcopy.sh@39 -- # perfpid=3982400 00:16:10.392 21:06:06 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:10.392 21:06:06 -- common/autotest_common.sh@10 -- # set +x 00:16:10.392 21:06:06 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:10.392 21:06:06 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:10.392 21:06:06 -- nvmf/common.sh@520 -- # config=() 00:16:10.392 21:06:06 -- nvmf/common.sh@520 -- # local subsystem config 00:16:10.392 21:06:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:10.392 21:06:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:10.392 { 00:16:10.392 "params": { 00:16:10.392 "name": "Nvme$subsystem", 00:16:10.392 "trtype": "$TEST_TRANSPORT", 00:16:10.392 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:10.392 "adrfam": "ipv4", 00:16:10.392 "trsvcid": "$NVMF_PORT", 00:16:10.392 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:10.392 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:10.392 "hdgst": ${hdgst:-false}, 00:16:10.392 "ddgst": ${ddgst:-false} 00:16:10.392 }, 00:16:10.392 "method": "bdev_nvme_attach_controller" 00:16:10.392 } 00:16:10.392 EOF 00:16:10.392 )") 00:16:10.392 21:06:06 -- nvmf/common.sh@542 -- # cat 00:16:10.392 [2024-11-27 21:06:06.589267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.589306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.392 21:06:06 -- nvmf/common.sh@544 -- # jq . 00:16:10.392 21:06:06 -- nvmf/common.sh@545 -- # IFS=, 00:16:10.392 21:06:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:10.392 "params": { 00:16:10.392 "name": "Nvme1", 00:16:10.392 "trtype": "tcp", 00:16:10.392 "traddr": "10.0.0.2", 00:16:10.392 "adrfam": "ipv4", 00:16:10.392 "trsvcid": "4420", 00:16:10.392 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:10.392 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:10.392 "hdgst": false, 00:16:10.392 "ddgst": false 00:16:10.392 }, 00:16:10.392 "method": "bdev_nvme_attach_controller" 00:16:10.392 }' 00:16:10.392 [2024-11-27 21:06:06.597235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.597257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.392 [2024-11-27 21:06:06.605258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.605279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.392 [2024-11-27 21:06:06.613280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.613301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.392 [2024-11-27 21:06:06.621299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.621319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.392 [2024-11-27 21:06:06.625205] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:10.392 [2024-11-27 21:06:06.625273] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3982400 ] 00:16:10.392 [2024-11-27 21:06:06.629338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.392 [2024-11-27 21:06:06.629361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.637342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.637362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.645364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.645384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.651 [2024-11-27 21:06:06.653384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.653403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.661410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.661431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.669430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.669456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.677454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.677475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.685478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.685500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.686480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:10.651 [2024-11-27 21:06:06.693545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.693593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.701585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.701623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.709563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.709601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.717597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.717619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.725616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.725639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.733637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.733660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.741655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.741678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.749683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.749708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.757725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.757760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.765720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.765744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.773740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.773763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.781762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.781784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.789786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.789823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.797822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.797844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.804046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:10.651 [2024-11-27 21:06:06.805853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.805890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.813889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.813919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.821922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.821960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.829948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.829985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.837966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.651 [2024-11-27 21:06:06.838000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.651 [2024-11-27 21:06:06.845989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.846028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.652 [2024-11-27 21:06:06.853994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.854030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.652 [2024-11-27 21:06:06.862014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.862054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.652 [2024-11-27 21:06:06.870033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.870067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.652 [2024-11-27 21:06:06.878038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.878063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.652 [2024-11-27 21:06:06.886084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.652 [2024-11-27 21:06:06.886120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.894137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.894173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.902094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.902114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.910119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.910140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.918151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.918180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.926174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.926198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.934198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.934221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.942218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.942242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.950252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.950277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.958264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.958285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.966286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.966314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.974308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.974329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.982329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.982351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.990354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.990375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:06.998393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:06.998420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.006415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.006443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.014435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.014460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.022457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.022482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.030482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.030507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.038509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.038546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.046540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.046589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.054560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.054598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.062598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.062630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.070619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.070640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.078645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.078667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.086655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.086679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.094677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.094702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 [2024-11-27 21:06:07.102696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.102719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.911 Running I/O for 5 seconds... 00:16:10.911 [2024-11-27 21:06:07.110717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.911 [2024-11-27 21:06:07.110739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.912 [2024-11-27 21:06:07.125795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.912 [2024-11-27 21:06:07.125849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.912 [2024-11-27 21:06:07.136922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.912 [2024-11-27 21:06:07.136955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.912 [2024-11-27 21:06:07.147860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.912 [2024-11-27 21:06:07.147891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.159772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.159800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.171082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.171113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.184034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.184065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.194253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.194283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.205355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.205386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.218297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.218328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.228685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.228713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.239882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.239913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.252652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.252680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.262249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.262280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.274206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.274238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.285288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.285319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.296351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.296382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.307823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.307855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.318878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.318909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.329781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.329825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.341457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.170 [2024-11-27 21:06:07.341488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.170 [2024-11-27 21:06:07.352896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.352927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.171 [2024-11-27 21:06:07.363728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.363756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.171 [2024-11-27 21:06:07.374682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.374710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.171 [2024-11-27 21:06:07.387328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.387359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.171 [2024-11-27 21:06:07.396656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.396685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.171 [2024-11-27 21:06:07.408506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.171 [2024-11-27 21:06:07.408546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.421512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.421554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.431678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.431707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.442498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.442539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.454938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.454970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.465327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.465358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.476673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.476702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.490033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.490065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.500393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.500427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.511664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.511692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.524404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.524435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.534173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.534201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.544499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.544537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.557080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.557109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.568607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.568635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.577948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.577979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.590237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.590267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.601342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.601373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.614619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.614646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.624933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.624964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.635888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.635919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.647305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.647334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.429 [2024-11-27 21:06:07.658415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.429 [2024-11-27 21:06:07.658446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.671744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.671772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.682325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.682355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.693763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.693790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.706908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.706939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.717106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.717136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.728151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.728181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.741145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.741176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.751114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.751146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.762794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.762841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.773986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.774017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.786876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.786907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.796994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.797025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.808049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.808080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.820884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.820915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.832622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.832650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.841879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.841910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.853711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.853739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.864791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.864836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.875894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.875932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.887272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.887302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.898692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.898719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.909227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.909257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.688 [2024-11-27 21:06:07.920724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.688 [2024-11-27 21:06:07.920751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.931664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.931691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.942757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.942785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.953453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.953483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.964433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.964464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.975601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.975636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.986338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.986369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:07.997240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:07.997270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.009908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.009939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.019974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.020002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.029734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.029761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.039812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.039847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.050147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.050175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.059998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.060026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.069928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.069955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.079910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.079938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.089828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.089855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.099677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.099705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.109558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.109586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.119558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.119597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.129300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.129327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.138906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.138934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.148828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.148855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.158781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.158809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.169001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.169038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.947 [2024-11-27 21:06:08.179040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.947 [2024-11-27 21:06:08.179067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.188545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.188573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.198499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.198538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.208542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.208579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.218716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.218743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.228486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.228512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.238310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.238337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.248508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.248544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.258567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.258594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.268601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.268628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.278553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.278580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.288573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.288600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.298401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.298428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.308045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.308072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.317986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.318013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.327848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.327876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.205 [2024-11-27 21:06:08.337945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.205 [2024-11-27 21:06:08.337973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.348219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.348246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.358286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.358319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.368178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.368206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.378201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.378229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.387886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.387913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.397789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.397817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.407670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.407697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.417644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.417671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.428350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.428378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.206 [2024-11-27 21:06:08.438521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.206 [2024-11-27 21:06:08.438557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.449196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.449224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.460988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.461015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.469808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.469836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.480624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.480651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.490799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.490826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.500625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.500652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.510596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.510623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.520404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.520430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.530421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.530448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.540357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.540385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.550192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.550230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.560462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.560492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.571324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.571354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.582039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.582068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.593281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.593311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.606023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.606053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.616685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.616712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.628596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.628625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.640238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.640269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.650834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.650879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.661984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.662015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.672750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.672778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.683903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.683934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.464 [2024-11-27 21:06:08.694742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.464 [2024-11-27 21:06:08.694770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.705886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.705917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.717642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.717670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.728744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.728773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.739419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.739449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.752393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.752424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.762800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.762841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.774194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.774224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.785089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.785119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.795940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.795970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.808641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.808669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.818711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.818739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.829659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.829687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.840620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.840647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.851499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.851541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.864587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.864616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.874028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.874055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.885334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.885364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.898545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.898601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.907843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.907870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.919230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.919260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.930365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.930396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.941277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.941307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.723 [2024-11-27 21:06:08.953965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.723 [2024-11-27 21:06:08.953996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:08.964063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:08.964093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:08.974903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:08.974933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:08.987689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:08.987716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:08.997648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:08.997675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:09.008689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:09.008716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:09.021440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:09.021472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:09.031978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:09.032009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.981 [2024-11-27 21:06:09.042939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.981 [2024-11-27 21:06:09.042970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.056063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.056093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.066222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.066252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.077492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.077522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.090158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.090188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.100607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.100635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.111401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.111431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.124225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.124255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.134268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.134299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.145881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.145912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.156517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.156571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.167981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.168012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.178801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.178830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.189755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.189783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.200932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.200962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.982 [2024-11-27 21:06:09.211973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.982 [2024-11-27 21:06:09.212004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.222789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.222817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.234074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.234105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.246738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.246766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.256649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.256677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.268570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.268598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.279342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.279373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.239 [2024-11-27 21:06:09.290767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.239 [2024-11-27 21:06:09.290795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.304165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.304196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.314816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.314844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.326206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.326236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.337540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.337584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.348489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.348519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.361216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.361247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.371233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.371263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.382220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.382250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.395576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.395604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.406019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.406049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.417092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.417122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.430659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.430687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.441510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.441549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.452708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.452736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.463730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.463757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.240 [2024-11-27 21:06:09.476340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.240 [2024-11-27 21:06:09.476370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.486394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.486424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.497113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.497143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.508246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.508276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.519052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.519082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.531763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.531818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.542084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.542114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.498 [2024-11-27 21:06:09.553274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.498 [2024-11-27 21:06:09.553305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.566388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.566419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.576824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.576851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.586768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.586795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.596873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.596900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.609434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.609470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.619177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.619204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.629119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.629145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.639205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.639232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.649276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.649303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.659105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.659132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.668989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.669015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.678915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.678942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.689071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.689098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.699144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.699171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.710398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.710425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.719801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.719828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.499 [2024-11-27 21:06:09.731726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.499 [2024-11-27 21:06:09.731753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.741320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.741347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.753275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.753302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.762646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.762674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.774334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.774362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.783070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.783098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.793563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.793591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.803486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.803522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.813281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.813308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.823692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.823720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.835422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.835450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.844404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.844432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.757 [2024-11-27 21:06:09.854990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.757 [2024-11-27 21:06:09.855018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.864987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.865014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.875065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.875093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.885092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.885118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.895033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.895060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.905201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.905228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.915293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.915319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.925166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.925193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.935040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.935066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.945069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.945096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.954980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.955007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.964645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.964673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.974542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.974569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.984507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.984542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.758 [2024-11-27 21:06:09.994387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.758 [2024-11-27 21:06:09.994423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.004320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.004348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.014391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.014418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.024180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.024207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.035028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.035061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.046809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.046839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.055488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.055516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.066393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.066422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.076300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.076328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.086551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.086580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.096499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.096533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.106926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.106953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.119898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.119929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.130504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.130605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.142590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.142617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.154016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.154046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.165155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.165185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.176413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.176442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.187617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.187645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.016 [2024-11-27 21:06:10.198878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.016 [2024-11-27 21:06:10.198917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.017 [2024-11-27 21:06:10.209614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.017 [2024-11-27 21:06:10.209641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.017 [2024-11-27 21:06:10.220658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.017 [2024-11-27 21:06:10.220685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.017 [2024-11-27 21:06:10.231376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.017 [2024-11-27 21:06:10.231407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.017 [2024-11-27 21:06:10.243781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.017 [2024-11-27 21:06:10.243808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.017 [2024-11-27 21:06:10.254160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.017 [2024-11-27 21:06:10.254191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.265165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.265195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.276270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.276301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.286945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.286975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.300154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.300185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.310487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.310517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.321086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.321117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.333654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.333681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.343256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.343286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.355115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.355145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.367949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.367979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.378215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.378245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.389813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.389858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.400623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.400651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.411681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.411716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.424650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.424677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.436706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.436734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.445839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.445882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.457522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.457583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.470212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.470243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.480097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.480127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.491782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.491810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.502479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.502509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.275 [2024-11-27 21:06:10.513587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.275 [2024-11-27 21:06:10.513614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.524601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.524628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.536269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.536299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.546737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.546764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.558137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.558168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.570966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.570997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.582720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.582753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.591834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.591865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.603948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.603992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.615449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.615479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.627007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.627037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.637759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.637786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.649221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.649250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.662364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.662393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.672417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.672446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.683293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.683323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.695957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.695987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.706250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.706279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.717798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.717841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.729031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.729061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.739939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.739969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.750953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.750984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.763654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.763682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.535 [2024-11-27 21:06:10.773686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.535 [2024-11-27 21:06:10.773714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.784485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.784515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.797877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.797907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.808195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.808225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.819224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.819253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.832096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.832127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.842039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.842069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.853677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.853704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.864470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.864500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.875962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.875993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.886787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.886815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.900055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.900086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.910491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.910522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.921389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.921420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.932228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.932259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.943161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.943191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.955915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.955946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.965753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.965781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.976705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.976734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.989644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.989672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:10.999619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:10.999647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:11.010290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:11.010320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:11.023401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:11.023432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.794 [2024-11-27 21:06:11.033798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.794 [2024-11-27 21:06:11.033844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.044720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.044747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.057521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.057561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.067597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.067625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.078613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.078641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.090315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.090345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.101099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.101130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.112195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.112225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.122720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.122747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.134072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.134103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.145039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.145069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.155745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.155772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.166842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.166872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.179949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.179980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.190181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.190211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.200969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.200999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.213511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.213550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.223360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.223390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.233736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.233763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.244924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.244954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.257625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.257659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.267858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.267888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.279071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.279101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.053 [2024-11-27 21:06:11.292242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.053 [2024-11-27 21:06:11.292273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.302849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.302880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.314095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.314126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.326825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.326870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.336699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.336726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.347762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.347789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.360409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.360439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.371002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.371033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.382266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.382296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.392916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.392946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.403200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.403231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.413960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.413990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.426490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.426520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.436354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.436383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.447111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.447141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.458296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.458326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.469436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.469475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.480259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.480289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.493551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.493594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.503710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.503738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.514426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.514457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.527946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.527976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.538671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.538699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.312 [2024-11-27 21:06:11.549543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.312 [2024-11-27 21:06:11.549587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.562343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.562374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.572671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.572698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.584017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.584048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.594646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.594674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.605423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.605454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.617740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.617768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.627739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.627766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.639426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.639456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.650614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.650641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.662143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.662173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.673464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.673494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.685099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.685137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.696491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.696522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.707541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.707571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.718708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.718735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.731917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.731948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.742256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.742287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.753282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.753312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.764487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.764517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.775300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.775330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.788353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.788383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.798677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.798704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.571 [2024-11-27 21:06:11.809804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.571 [2024-11-27 21:06:11.809832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.829 [2024-11-27 21:06:11.822676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.829 [2024-11-27 21:06:11.822703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.832518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.832573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.844220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.844250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.854964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.854993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.865598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.865626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.876635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.876662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.897026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.897058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.907379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.907424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.918663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.918690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.929641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.929668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.940792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.940819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.953237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.953267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.962413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.962443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.976076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.976107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.987045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.987075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:11.998167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:11.998197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.009269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.009299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.022191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.022222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.032317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.032348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.043644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.043673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.055269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.055299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.830 [2024-11-27 21:06:12.066094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.830 [2024-11-27 21:06:12.066125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.088 [2024-11-27 21:06:12.076746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.088 [2024-11-27 21:06:12.076774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.088 [2024-11-27 21:06:12.087636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.088 [2024-11-27 21:06:12.087664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.088 [2024-11-27 21:06:12.098608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.088 [2024-11-27 21:06:12.098636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.111624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.111651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.121785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.121819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.130233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.130262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 00:16:16.089 Latency(us) 00:16:16.089 [2024-11-27T20:06:12.330Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:16.089 [2024-11-27T20:06:12.330Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:16.089 Nvme1n1 : 5.01 11809.93 92.27 0.00 0.00 10823.81 4611.79 21165.70 00:16:16.089 [2024-11-27T20:06:12.330Z] =================================================================================================================== 00:16:16.089 [2024-11-27T20:06:12.330Z] Total : 11809.93 92.27 0.00 0.00 10823.81 4611.79 21165.70 00:16:16.089 [2024-11-27 21:06:12.136128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.136156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.144148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.144177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.152166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.152192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.160226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.160270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.168249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.168296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.176263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.176309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.184288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.184333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.192310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.192356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.200340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.200388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.208356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.208404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.216379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.216425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.224404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.224452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.232434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.232483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.240456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.240505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.248472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.248518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.256491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.256544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.264512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.264564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.272544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.272587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.280560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.280617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.288554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.288591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.296589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.296610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.304608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.304629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.312628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.312649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.320655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.320689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.089 [2024-11-27 21:06:12.328693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.089 [2024-11-27 21:06:12.328736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.336724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.336771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.344695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.344715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.352716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.352736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.360739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.360760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.368758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.368778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.376786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.376808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.384850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.384895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.392866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.392909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.400869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.400894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.408891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.408915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 [2024-11-27 21:06:12.416926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.347 [2024-11-27 21:06:12.416950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.347 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3982400) - No such process 00:16:16.347 21:06:12 -- target/zcopy.sh@49 -- # wait 3982400 00:16:16.347 21:06:12 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:16.347 21:06:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.347 21:06:12 -- common/autotest_common.sh@10 -- # set +x 00:16:16.347 21:06:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.347 21:06:12 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:16.347 21:06:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.347 21:06:12 -- common/autotest_common.sh@10 -- # set +x 00:16:16.347 delay0 00:16:16.347 21:06:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.347 21:06:12 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:16.347 21:06:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.347 21:06:12 -- common/autotest_common.sh@10 -- # set +x 00:16:16.348 21:06:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.348 21:06:12 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:16.348 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.348 [2024-11-27 21:06:12.580646] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:22.899 Initializing NVMe Controllers 00:16:22.899 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:22.899 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:22.899 Initialization complete. Launching workers. 00:16:22.899 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 140 00:16:22.899 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 427, failed to submit 33 00:16:22.899 success 270, unsuccess 157, failed 0 00:16:22.899 21:06:18 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:22.899 21:06:18 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:22.899 21:06:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:22.899 21:06:18 -- nvmf/common.sh@116 -- # sync 00:16:22.899 21:06:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:22.899 21:06:18 -- nvmf/common.sh@119 -- # set +e 00:16:22.899 21:06:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:22.899 21:06:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:22.899 rmmod nvme_tcp 00:16:22.899 rmmod nvme_fabrics 00:16:22.899 rmmod nvme_keyring 00:16:22.899 21:06:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:22.899 21:06:18 -- nvmf/common.sh@123 -- # set -e 00:16:22.899 21:06:18 -- nvmf/common.sh@124 -- # return 0 00:16:22.899 21:06:18 -- nvmf/common.sh@477 -- # '[' -n 3980776 ']' 00:16:22.899 21:06:18 -- nvmf/common.sh@478 -- # killprocess 3980776 00:16:22.899 21:06:18 -- common/autotest_common.sh@936 -- # '[' -z 3980776 ']' 00:16:22.899 21:06:18 -- common/autotest_common.sh@940 -- # kill -0 3980776 00:16:22.899 21:06:18 -- common/autotest_common.sh@941 -- # uname 00:16:22.899 21:06:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:22.899 21:06:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3980776 00:16:22.899 21:06:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:22.899 21:06:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:22.899 21:06:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3980776' 00:16:22.899 killing process with pid 3980776 00:16:22.899 21:06:18 -- common/autotest_common.sh@955 -- # kill 3980776 00:16:22.899 21:06:18 -- common/autotest_common.sh@960 -- # wait 3980776 00:16:22.899 21:06:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:22.899 21:06:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:22.899 21:06:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:22.899 21:06:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:22.899 21:06:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:22.899 21:06:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:22.899 21:06:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:22.899 21:06:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.441 21:06:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:25.441 00:16:25.441 real 0m28.933s 00:16:25.441 user 0m42.704s 00:16:25.441 sys 0m8.194s 00:16:25.441 21:06:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:25.441 21:06:21 -- common/autotest_common.sh@10 -- # set +x 00:16:25.441 ************************************ 00:16:25.441 END TEST nvmf_zcopy 00:16:25.441 ************************************ 00:16:25.441 21:06:21 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:25.441 21:06:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:25.441 21:06:21 -- common/autotest_common.sh@10 -- # set +x 00:16:25.441 ************************************ 00:16:25.441 START TEST nvmf_nmic 00:16:25.441 ************************************ 00:16:25.441 21:06:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:25.441 * Looking for test storage... 00:16:25.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:25.441 21:06:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:25.441 21:06:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:25.441 21:06:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:25.441 21:06:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:25.441 21:06:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:25.441 21:06:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:25.441 21:06:21 -- scripts/common.sh@335 -- # IFS=.-: 00:16:25.441 21:06:21 -- scripts/common.sh@335 -- # read -ra ver1 00:16:25.441 21:06:21 -- scripts/common.sh@336 -- # IFS=.-: 00:16:25.441 21:06:21 -- scripts/common.sh@336 -- # read -ra ver2 00:16:25.441 21:06:21 -- scripts/common.sh@337 -- # local 'op=<' 00:16:25.441 21:06:21 -- scripts/common.sh@339 -- # ver1_l=2 00:16:25.441 21:06:21 -- scripts/common.sh@340 -- # ver2_l=1 00:16:25.441 21:06:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:25.441 21:06:21 -- scripts/common.sh@343 -- # case "$op" in 00:16:25.441 21:06:21 -- scripts/common.sh@344 -- # : 1 00:16:25.441 21:06:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:25.441 21:06:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:25.441 21:06:21 -- scripts/common.sh@364 -- # decimal 1 00:16:25.441 21:06:21 -- scripts/common.sh@352 -- # local d=1 00:16:25.441 21:06:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:25.441 21:06:21 -- scripts/common.sh@354 -- # echo 1 00:16:25.441 21:06:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:25.441 21:06:21 -- scripts/common.sh@365 -- # decimal 2 00:16:25.441 21:06:21 -- scripts/common.sh@352 -- # local d=2 00:16:25.441 21:06:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:25.441 21:06:21 -- scripts/common.sh@354 -- # echo 2 00:16:25.441 21:06:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:25.441 21:06:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:25.441 21:06:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:25.441 21:06:21 -- scripts/common.sh@367 -- # return 0 00:16:25.441 21:06:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 21:06:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:25.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.441 --rc genhtml_branch_coverage=1 00:16:25.441 --rc genhtml_function_coverage=1 00:16:25.441 --rc genhtml_legend=1 00:16:25.441 --rc geninfo_all_blocks=1 00:16:25.441 --rc geninfo_unexecuted_blocks=1 00:16:25.441 00:16:25.441 ' 00:16:25.441 21:06:21 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:25.441 21:06:21 -- nvmf/common.sh@7 -- # uname -s 00:16:25.441 21:06:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:25.441 21:06:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:25.441 21:06:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:25.441 21:06:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:25.441 21:06:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:25.441 21:06:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:25.441 21:06:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:25.441 21:06:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:25.441 21:06:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:25.441 21:06:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:25.441 21:06:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.441 21:06:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.441 21:06:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:25.441 21:06:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:25.441 21:06:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:25.441 21:06:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:25.441 21:06:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:25.441 21:06:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:25.441 21:06:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:25.441 21:06:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 21:06:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 21:06:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.441 21:06:21 -- paths/export.sh@5 -- # export PATH 00:16:25.442 21:06:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.442 21:06:21 -- nvmf/common.sh@46 -- # : 0 00:16:25.442 21:06:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:25.442 21:06:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:25.442 21:06:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:25.442 21:06:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:25.442 21:06:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:25.442 21:06:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:25.442 21:06:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:25.442 21:06:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:25.442 21:06:21 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:25.442 21:06:21 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:25.442 21:06:21 -- target/nmic.sh@14 -- # nvmftestinit 00:16:25.442 21:06:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:25.442 21:06:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:25.442 21:06:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:25.442 21:06:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:25.442 21:06:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:25.442 21:06:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.442 21:06:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.442 21:06:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.442 21:06:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:25.442 21:06:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:25.442 21:06:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:25.442 21:06:21 -- common/autotest_common.sh@10 -- # set +x 00:16:27.348 21:06:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:27.348 21:06:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:27.348 21:06:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:27.348 21:06:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:27.348 21:06:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:27.348 21:06:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:27.348 21:06:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:27.348 21:06:23 -- nvmf/common.sh@294 -- # net_devs=() 00:16:27.348 21:06:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:27.348 21:06:23 -- nvmf/common.sh@295 -- # e810=() 00:16:27.348 21:06:23 -- nvmf/common.sh@295 -- # local -ga e810 00:16:27.348 21:06:23 -- nvmf/common.sh@296 -- # x722=() 00:16:27.348 21:06:23 -- nvmf/common.sh@296 -- # local -ga x722 00:16:27.348 21:06:23 -- nvmf/common.sh@297 -- # mlx=() 00:16:27.348 21:06:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:27.348 21:06:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:27.348 21:06:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:27.348 21:06:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:27.348 21:06:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:27.348 21:06:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:27.348 21:06:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:27.348 21:06:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:27.348 21:06:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:27.348 21:06:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:27.348 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:27.348 21:06:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:27.349 21:06:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:27.349 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:27.349 21:06:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:27.349 21:06:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:27.349 21:06:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:27.349 21:06:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:27.349 21:06:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:27.349 21:06:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:27.349 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:27.349 21:06:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:27.349 21:06:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:27.349 21:06:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:27.349 21:06:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:27.349 21:06:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:27.349 21:06:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:27.349 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:27.349 21:06:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:27.349 21:06:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:27.349 21:06:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:27.349 21:06:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:27.349 21:06:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:27.349 21:06:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:27.349 21:06:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:27.349 21:06:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:27.349 21:06:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:27.349 21:06:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:27.349 21:06:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:27.349 21:06:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:27.349 21:06:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:27.349 21:06:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:27.349 21:06:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:27.349 21:06:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:27.349 21:06:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:27.349 21:06:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:27.349 21:06:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:27.349 21:06:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:27.349 21:06:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:27.349 21:06:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:27.349 21:06:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:27.349 21:06:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:27.349 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:27.349 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:16:27.349 00:16:27.349 --- 10.0.0.2 ping statistics --- 00:16:27.349 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:27.349 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:16:27.349 21:06:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:27.349 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:27.349 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:16:27.349 00:16:27.349 --- 10.0.0.1 ping statistics --- 00:16:27.349 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:27.349 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:16:27.349 21:06:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:27.349 21:06:23 -- nvmf/common.sh@410 -- # return 0 00:16:27.349 21:06:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:27.349 21:06:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:27.349 21:06:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:27.349 21:06:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:27.349 21:06:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:27.349 21:06:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:27.349 21:06:23 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:27.349 21:06:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:27.349 21:06:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:27.349 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:16:27.349 21:06:23 -- nvmf/common.sh@469 -- # nvmfpid=3986297 00:16:27.349 21:06:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:27.349 21:06:23 -- nvmf/common.sh@470 -- # waitforlisten 3986297 00:16:27.349 21:06:23 -- common/autotest_common.sh@829 -- # '[' -z 3986297 ']' 00:16:27.349 21:06:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:27.349 21:06:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:27.349 21:06:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:27.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:27.349 21:06:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:27.349 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:16:27.349 [2024-11-27 21:06:23.534429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:27.349 [2024-11-27 21:06:23.534515] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:27.349 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.607 [2024-11-27 21:06:23.599856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:27.607 [2024-11-27 21:06:23.705766] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:27.607 [2024-11-27 21:06:23.705920] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:27.607 [2024-11-27 21:06:23.705937] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:27.607 [2024-11-27 21:06:23.705949] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:27.607 [2024-11-27 21:06:23.706001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:27.607 [2024-11-27 21:06:23.706062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:27.607 [2024-11-27 21:06:23.706128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:27.607 [2024-11-27 21:06:23.706131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:28.539 21:06:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:28.539 21:06:24 -- common/autotest_common.sh@862 -- # return 0 00:16:28.539 21:06:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:28.539 21:06:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 21:06:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:28.539 21:06:24 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 [2024-11-27 21:06:24.586278] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 Malloc0 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 [2024-11-27 21:06:24.638374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:28.539 test case1: single bdev can't be used in multiple subsystems 00:16:28.539 21:06:24 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.539 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.539 21:06:24 -- target/nmic.sh@28 -- # nmic_status=0 00:16:28.539 21:06:24 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:28.539 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.539 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.540 [2024-11-27 21:06:24.662216] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:28.540 [2024-11-27 21:06:24.662252] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:28.540 [2024-11-27 21:06:24.662281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:28.540 request: 00:16:28.540 { 00:16:28.540 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:28.540 "namespace": { 00:16:28.540 "bdev_name": "Malloc0" 00:16:28.540 }, 00:16:28.540 "method": "nvmf_subsystem_add_ns", 00:16:28.540 "req_id": 1 00:16:28.540 } 00:16:28.540 Got JSON-RPC error response 00:16:28.540 response: 00:16:28.540 { 00:16:28.540 "code": -32602, 00:16:28.540 "message": "Invalid parameters" 00:16:28.540 } 00:16:28.540 21:06:24 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:28.540 21:06:24 -- target/nmic.sh@29 -- # nmic_status=1 00:16:28.540 21:06:24 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:28.540 21:06:24 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:28.540 Adding namespace failed - expected result. 00:16:28.540 21:06:24 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:28.540 test case2: host connect to nvmf target in multiple paths 00:16:28.540 21:06:24 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:28.540 21:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.540 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.540 [2024-11-27 21:06:24.670344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:28.540 21:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.540 21:06:24 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:29.105 21:06:25 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:30.039 21:06:25 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:30.039 21:06:25 -- common/autotest_common.sh@1187 -- # local i=0 00:16:30.039 21:06:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:30.039 21:06:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:30.039 21:06:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:31.942 21:06:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:31.942 21:06:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:31.942 21:06:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:31.942 21:06:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:31.942 21:06:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:31.942 21:06:27 -- common/autotest_common.sh@1197 -- # return 0 00:16:31.942 21:06:27 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:31.942 [global] 00:16:31.942 thread=1 00:16:31.942 invalidate=1 00:16:31.942 rw=write 00:16:31.942 time_based=1 00:16:31.942 runtime=1 00:16:31.942 ioengine=libaio 00:16:31.942 direct=1 00:16:31.942 bs=4096 00:16:31.942 iodepth=1 00:16:31.942 norandommap=0 00:16:31.942 numjobs=1 00:16:31.942 00:16:31.942 verify_dump=1 00:16:31.942 verify_backlog=512 00:16:31.942 verify_state_save=0 00:16:31.942 do_verify=1 00:16:31.942 verify=crc32c-intel 00:16:31.942 [job0] 00:16:31.942 filename=/dev/nvme0n1 00:16:31.942 Could not set queue depth (nvme0n1) 00:16:32.200 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:32.200 fio-3.35 00:16:32.200 Starting 1 thread 00:16:33.131 00:16:33.132 job0: (groupid=0, jobs=1): err= 0: pid=3987008: Wed Nov 27 21:06:29 2024 00:16:33.132 read: IOPS=21, BW=86.0KiB/s (88.1kB/s)(88.0KiB/1023msec) 00:16:33.132 slat (nsec): min=6938, max=34244, avg=27480.95, stdev=9257.41 00:16:33.132 clat (usec): min=40890, max=42054, avg=41733.75, stdev=443.58 00:16:33.132 lat (usec): min=40924, max=42071, avg=41761.23, stdev=441.68 00:16:33.132 clat percentiles (usec): 00:16:33.132 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:33.132 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:16:33.132 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:33.132 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:33.132 | 99.99th=[42206] 00:16:33.132 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:16:33.132 slat (nsec): min=7083, max=35988, avg=16544.23, stdev=7501.47 00:16:33.132 clat (usec): min=142, max=316, avg=181.18, stdev=16.89 00:16:33.132 lat (usec): min=149, max=351, avg=197.72, stdev=21.25 00:16:33.132 clat percentiles (usec): 00:16:33.132 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 159], 20.00th=[ 169], 00:16:33.132 | 30.00th=[ 176], 40.00th=[ 180], 50.00th=[ 182], 60.00th=[ 186], 00:16:33.132 | 70.00th=[ 190], 80.00th=[ 194], 90.00th=[ 200], 95.00th=[ 204], 00:16:33.132 | 99.00th=[ 215], 99.50th=[ 235], 99.90th=[ 318], 99.95th=[ 318], 00:16:33.132 | 99.99th=[ 318] 00:16:33.132 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:33.132 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:33.132 lat (usec) : 250=95.51%, 500=0.37% 00:16:33.132 lat (msec) : 50=4.12% 00:16:33.132 cpu : usr=0.88%, sys=0.88%, ctx=534, majf=0, minf=1 00:16:33.132 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:33.132 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:33.132 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:33.132 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:33.132 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:33.132 00:16:33.132 Run status group 0 (all jobs): 00:16:33.132 READ: bw=86.0KiB/s (88.1kB/s), 86.0KiB/s-86.0KiB/s (88.1kB/s-88.1kB/s), io=88.0KiB (90.1kB), run=1023-1023msec 00:16:33.132 WRITE: bw=2002KiB/s (2050kB/s), 2002KiB/s-2002KiB/s (2050kB/s-2050kB/s), io=2048KiB (2097kB), run=1023-1023msec 00:16:33.132 00:16:33.132 Disk stats (read/write): 00:16:33.132 nvme0n1: ios=69/512, merge=0/0, ticks=819/101, in_queue=920, util=91.68% 00:16:33.132 21:06:29 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:33.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:33.390 21:06:29 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:33.390 21:06:29 -- common/autotest_common.sh@1208 -- # local i=0 00:16:33.390 21:06:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:33.390 21:06:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:33.390 21:06:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:33.390 21:06:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:33.390 21:06:29 -- common/autotest_common.sh@1220 -- # return 0 00:16:33.390 21:06:29 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:33.390 21:06:29 -- target/nmic.sh@53 -- # nvmftestfini 00:16:33.390 21:06:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:33.390 21:06:29 -- nvmf/common.sh@116 -- # sync 00:16:33.390 21:06:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:33.390 21:06:29 -- nvmf/common.sh@119 -- # set +e 00:16:33.390 21:06:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:33.390 21:06:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:33.390 rmmod nvme_tcp 00:16:33.390 rmmod nvme_fabrics 00:16:33.390 rmmod nvme_keyring 00:16:33.390 21:06:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:33.390 21:06:29 -- nvmf/common.sh@123 -- # set -e 00:16:33.390 21:06:29 -- nvmf/common.sh@124 -- # return 0 00:16:33.390 21:06:29 -- nvmf/common.sh@477 -- # '[' -n 3986297 ']' 00:16:33.390 21:06:29 -- nvmf/common.sh@478 -- # killprocess 3986297 00:16:33.390 21:06:29 -- common/autotest_common.sh@936 -- # '[' -z 3986297 ']' 00:16:33.390 21:06:29 -- common/autotest_common.sh@940 -- # kill -0 3986297 00:16:33.390 21:06:29 -- common/autotest_common.sh@941 -- # uname 00:16:33.390 21:06:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:33.390 21:06:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3986297 00:16:33.390 21:06:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:33.390 21:06:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:33.390 21:06:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3986297' 00:16:33.390 killing process with pid 3986297 00:16:33.390 21:06:29 -- common/autotest_common.sh@955 -- # kill 3986297 00:16:33.390 21:06:29 -- common/autotest_common.sh@960 -- # wait 3986297 00:16:33.648 21:06:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:33.648 21:06:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:33.907 21:06:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:33.907 21:06:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:33.907 21:06:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:33.907 21:06:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:33.907 21:06:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:33.907 21:06:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.813 21:06:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:35.813 00:16:35.813 real 0m10.816s 00:16:35.813 user 0m25.769s 00:16:35.813 sys 0m2.347s 00:16:35.813 21:06:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:35.813 21:06:31 -- common/autotest_common.sh@10 -- # set +x 00:16:35.813 ************************************ 00:16:35.813 END TEST nvmf_nmic 00:16:35.813 ************************************ 00:16:35.813 21:06:31 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:35.813 21:06:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:35.813 21:06:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:35.813 21:06:31 -- common/autotest_common.sh@10 -- # set +x 00:16:35.813 ************************************ 00:16:35.813 START TEST nvmf_fio_target 00:16:35.813 ************************************ 00:16:35.813 21:06:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:35.813 * Looking for test storage... 00:16:35.813 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:35.813 21:06:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:35.813 21:06:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:35.813 21:06:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:36.072 21:06:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:36.072 21:06:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:36.072 21:06:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:36.072 21:06:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:36.072 21:06:32 -- scripts/common.sh@335 -- # IFS=.-: 00:16:36.072 21:06:32 -- scripts/common.sh@335 -- # read -ra ver1 00:16:36.072 21:06:32 -- scripts/common.sh@336 -- # IFS=.-: 00:16:36.072 21:06:32 -- scripts/common.sh@336 -- # read -ra ver2 00:16:36.072 21:06:32 -- scripts/common.sh@337 -- # local 'op=<' 00:16:36.072 21:06:32 -- scripts/common.sh@339 -- # ver1_l=2 00:16:36.072 21:06:32 -- scripts/common.sh@340 -- # ver2_l=1 00:16:36.072 21:06:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:36.072 21:06:32 -- scripts/common.sh@343 -- # case "$op" in 00:16:36.072 21:06:32 -- scripts/common.sh@344 -- # : 1 00:16:36.072 21:06:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:36.072 21:06:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:36.072 21:06:32 -- scripts/common.sh@364 -- # decimal 1 00:16:36.072 21:06:32 -- scripts/common.sh@352 -- # local d=1 00:16:36.072 21:06:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:36.072 21:06:32 -- scripts/common.sh@354 -- # echo 1 00:16:36.072 21:06:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:36.072 21:06:32 -- scripts/common.sh@365 -- # decimal 2 00:16:36.072 21:06:32 -- scripts/common.sh@352 -- # local d=2 00:16:36.072 21:06:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:36.072 21:06:32 -- scripts/common.sh@354 -- # echo 2 00:16:36.072 21:06:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:36.072 21:06:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:36.072 21:06:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:36.072 21:06:32 -- scripts/common.sh@367 -- # return 0 00:16:36.072 21:06:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:36.072 21:06:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:36.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.072 --rc genhtml_branch_coverage=1 00:16:36.072 --rc genhtml_function_coverage=1 00:16:36.072 --rc genhtml_legend=1 00:16:36.072 --rc geninfo_all_blocks=1 00:16:36.072 --rc geninfo_unexecuted_blocks=1 00:16:36.072 00:16:36.072 ' 00:16:36.072 21:06:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:36.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.072 --rc genhtml_branch_coverage=1 00:16:36.072 --rc genhtml_function_coverage=1 00:16:36.072 --rc genhtml_legend=1 00:16:36.072 --rc geninfo_all_blocks=1 00:16:36.072 --rc geninfo_unexecuted_blocks=1 00:16:36.072 00:16:36.072 ' 00:16:36.072 21:06:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:36.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.072 --rc genhtml_branch_coverage=1 00:16:36.072 --rc genhtml_function_coverage=1 00:16:36.072 --rc genhtml_legend=1 00:16:36.072 --rc geninfo_all_blocks=1 00:16:36.072 --rc geninfo_unexecuted_blocks=1 00:16:36.072 00:16:36.073 ' 00:16:36.073 21:06:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:36.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:36.073 --rc genhtml_branch_coverage=1 00:16:36.073 --rc genhtml_function_coverage=1 00:16:36.073 --rc genhtml_legend=1 00:16:36.073 --rc geninfo_all_blocks=1 00:16:36.073 --rc geninfo_unexecuted_blocks=1 00:16:36.073 00:16:36.073 ' 00:16:36.073 21:06:32 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:36.073 21:06:32 -- nvmf/common.sh@7 -- # uname -s 00:16:36.073 21:06:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:36.073 21:06:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:36.073 21:06:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:36.073 21:06:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:36.073 21:06:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:36.073 21:06:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:36.073 21:06:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:36.073 21:06:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:36.073 21:06:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:36.073 21:06:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:36.073 21:06:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.073 21:06:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:36.073 21:06:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:36.073 21:06:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:36.073 21:06:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:36.073 21:06:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:36.073 21:06:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:36.073 21:06:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:36.073 21:06:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:36.073 21:06:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.073 21:06:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.073 21:06:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.073 21:06:32 -- paths/export.sh@5 -- # export PATH 00:16:36.073 21:06:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:36.073 21:06:32 -- nvmf/common.sh@46 -- # : 0 00:16:36.073 21:06:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:36.073 21:06:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:36.073 21:06:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:36.073 21:06:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:36.073 21:06:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:36.073 21:06:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:36.073 21:06:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:36.073 21:06:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:36.073 21:06:32 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:36.073 21:06:32 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:36.073 21:06:32 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:36.073 21:06:32 -- target/fio.sh@16 -- # nvmftestinit 00:16:36.073 21:06:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:36.073 21:06:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:36.073 21:06:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:36.073 21:06:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:36.073 21:06:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:36.073 21:06:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:36.073 21:06:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:36.073 21:06:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:36.073 21:06:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:36.073 21:06:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:36.073 21:06:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:36.073 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:16:38.604 21:06:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:38.604 21:06:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:38.604 21:06:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:38.604 21:06:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:38.604 21:06:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:38.604 21:06:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:38.604 21:06:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:38.604 21:06:34 -- nvmf/common.sh@294 -- # net_devs=() 00:16:38.604 21:06:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:38.604 21:06:34 -- nvmf/common.sh@295 -- # e810=() 00:16:38.604 21:06:34 -- nvmf/common.sh@295 -- # local -ga e810 00:16:38.604 21:06:34 -- nvmf/common.sh@296 -- # x722=() 00:16:38.604 21:06:34 -- nvmf/common.sh@296 -- # local -ga x722 00:16:38.604 21:06:34 -- nvmf/common.sh@297 -- # mlx=() 00:16:38.604 21:06:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:38.604 21:06:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:38.604 21:06:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.604 21:06:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:38.604 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:38.604 21:06:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:38.604 21:06:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:38.604 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:38.604 21:06:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.604 21:06:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.604 21:06:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.604 21:06:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:38.604 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:38.604 21:06:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:38.604 21:06:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.604 21:06:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.604 21:06:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:38.604 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:38.604 21:06:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:38.604 21:06:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:38.604 21:06:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:38.604 21:06:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:38.604 21:06:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:38.604 21:06:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:38.604 21:06:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:38.604 21:06:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:38.604 21:06:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:38.604 21:06:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:38.604 21:06:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:38.604 21:06:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:38.604 21:06:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:38.604 21:06:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:38.604 21:06:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:38.604 21:06:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:38.604 21:06:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:38.604 21:06:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:38.604 21:06:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:38.604 21:06:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:38.604 21:06:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:38.604 21:06:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:38.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:38.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:16:38.604 00:16:38.604 --- 10.0.0.2 ping statistics --- 00:16:38.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.604 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:16:38.604 21:06:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:38.604 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:38.604 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:16:38.604 00:16:38.604 --- 10.0.0.1 ping statistics --- 00:16:38.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:38.604 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:16:38.604 21:06:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:38.604 21:06:34 -- nvmf/common.sh@410 -- # return 0 00:16:38.605 21:06:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:38.605 21:06:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:38.605 21:06:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:38.605 21:06:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:38.605 21:06:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:38.605 21:06:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:38.605 21:06:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:38.605 21:06:34 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:38.605 21:06:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:38.605 21:06:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:38.605 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:16:38.605 21:06:34 -- nvmf/common.sh@469 -- # nvmfpid=3989107 00:16:38.605 21:06:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:38.605 21:06:34 -- nvmf/common.sh@470 -- # waitforlisten 3989107 00:16:38.605 21:06:34 -- common/autotest_common.sh@829 -- # '[' -z 3989107 ']' 00:16:38.605 21:06:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:38.605 21:06:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:38.605 21:06:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:38.605 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:38.605 21:06:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:38.605 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:16:38.605 [2024-11-27 21:06:34.617400] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:38.605 [2024-11-27 21:06:34.617494] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:38.605 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.605 [2024-11-27 21:06:34.683355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:38.605 [2024-11-27 21:06:34.795198] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:38.605 [2024-11-27 21:06:34.795359] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:38.605 [2024-11-27 21:06:34.795376] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:38.605 [2024-11-27 21:06:34.795389] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:38.605 [2024-11-27 21:06:34.795444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:38.605 [2024-11-27 21:06:34.795503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.605 [2024-11-27 21:06:34.795553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:38.605 [2024-11-27 21:06:34.795557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:39.535 21:06:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:39.535 21:06:35 -- common/autotest_common.sh@862 -- # return 0 00:16:39.535 21:06:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:39.535 21:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:39.535 21:06:35 -- common/autotest_common.sh@10 -- # set +x 00:16:39.535 21:06:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:39.535 21:06:35 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:39.792 [2024-11-27 21:06:35.842947] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:39.792 21:06:35 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:40.049 21:06:36 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:40.049 21:06:36 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:40.307 21:06:36 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:40.307 21:06:36 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:40.565 21:06:36 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:40.565 21:06:36 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:40.823 21:06:36 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:40.823 21:06:36 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:41.080 21:06:37 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.338 21:06:37 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:41.338 21:06:37 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.596 21:06:37 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:41.596 21:06:37 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.854 21:06:37 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:41.854 21:06:37 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:42.112 21:06:38 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:42.369 21:06:38 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:42.369 21:06:38 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:42.627 21:06:38 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:42.627 21:06:38 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:42.885 21:06:39 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:43.191 [2024-11-27 21:06:39.234920] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:43.191 21:06:39 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:43.447 21:06:39 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:43.713 21:06:39 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:44.372 21:06:40 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:44.372 21:06:40 -- common/autotest_common.sh@1187 -- # local i=0 00:16:44.372 21:06:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:44.372 21:06:40 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:44.372 21:06:40 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:44.372 21:06:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:46.273 21:06:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:46.273 21:06:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:46.273 21:06:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:46.273 21:06:42 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:46.273 21:06:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:46.273 21:06:42 -- common/autotest_common.sh@1197 -- # return 0 00:16:46.273 21:06:42 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:46.273 [global] 00:16:46.273 thread=1 00:16:46.273 invalidate=1 00:16:46.273 rw=write 00:16:46.273 time_based=1 00:16:46.273 runtime=1 00:16:46.273 ioengine=libaio 00:16:46.273 direct=1 00:16:46.273 bs=4096 00:16:46.273 iodepth=1 00:16:46.273 norandommap=0 00:16:46.273 numjobs=1 00:16:46.273 00:16:46.273 verify_dump=1 00:16:46.273 verify_backlog=512 00:16:46.273 verify_state_save=0 00:16:46.273 do_verify=1 00:16:46.273 verify=crc32c-intel 00:16:46.273 [job0] 00:16:46.273 filename=/dev/nvme0n1 00:16:46.273 [job1] 00:16:46.273 filename=/dev/nvme0n2 00:16:46.273 [job2] 00:16:46.273 filename=/dev/nvme0n3 00:16:46.273 [job3] 00:16:46.273 filename=/dev/nvme0n4 00:16:46.273 Could not set queue depth (nvme0n1) 00:16:46.273 Could not set queue depth (nvme0n2) 00:16:46.273 Could not set queue depth (nvme0n3) 00:16:46.273 Could not set queue depth (nvme0n4) 00:16:46.530 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.530 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.530 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.530 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.530 fio-3.35 00:16:46.530 Starting 4 threads 00:16:47.901 00:16:47.901 job0: (groupid=0, jobs=1): err= 0: pid=3990252: Wed Nov 27 21:06:43 2024 00:16:47.901 read: IOPS=261, BW=1047KiB/s (1072kB/s)(1048KiB/1001msec) 00:16:47.901 slat (nsec): min=5544, max=61633, avg=19650.46, stdev=10250.77 00:16:47.901 clat (usec): min=210, max=41016, avg=3404.91, stdev=10809.73 00:16:47.901 lat (usec): min=225, max=41032, avg=3424.56, stdev=10810.56 00:16:47.901 clat percentiles (usec): 00:16:47.901 | 1.00th=[ 223], 5.00th=[ 233], 10.00th=[ 253], 20.00th=[ 273], 00:16:47.901 | 30.00th=[ 285], 40.00th=[ 293], 50.00th=[ 302], 60.00th=[ 322], 00:16:47.901 | 70.00th=[ 334], 80.00th=[ 351], 90.00th=[ 371], 95.00th=[41157], 00:16:47.901 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:47.901 | 99.99th=[41157] 00:16:47.901 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:16:47.901 slat (nsec): min=5757, max=41932, avg=6986.12, stdev=2368.92 00:16:47.901 clat (usec): min=160, max=273, avg=189.05, stdev=22.63 00:16:47.901 lat (usec): min=167, max=315, avg=196.04, stdev=23.07 00:16:47.901 clat percentiles (usec): 00:16:47.901 | 1.00th=[ 165], 5.00th=[ 169], 10.00th=[ 172], 20.00th=[ 176], 00:16:47.901 | 30.00th=[ 178], 40.00th=[ 180], 50.00th=[ 182], 60.00th=[ 186], 00:16:47.901 | 70.00th=[ 190], 80.00th=[ 196], 90.00th=[ 241], 95.00th=[ 247], 00:16:47.901 | 99.00th=[ 253], 99.50th=[ 262], 99.90th=[ 273], 99.95th=[ 273], 00:16:47.901 | 99.99th=[ 273] 00:16:47.901 bw ( KiB/s): min= 4096, max= 4096, per=25.48%, avg=4096.00, stdev= 0.00, samples=1 00:16:47.901 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:47.901 lat (usec) : 250=68.09%, 500=29.33% 00:16:47.901 lat (msec) : 50=2.58% 00:16:47.901 cpu : usr=0.60%, sys=0.70%, ctx=774, majf=0, minf=1 00:16:47.901 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.901 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.901 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.901 issued rwts: total=262,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.901 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.901 job1: (groupid=0, jobs=1): err= 0: pid=3990274: Wed Nov 27 21:06:43 2024 00:16:47.901 read: IOPS=21, BW=86.4KiB/s (88.4kB/s)(88.0KiB/1019msec) 00:16:47.901 slat (nsec): min=8238, max=39855, avg=27643.86, stdev=10044.66 00:16:47.901 clat (usec): min=40844, max=41189, avg=40972.49, stdev=73.56 00:16:47.901 lat (usec): min=40880, max=41197, avg=41000.14, stdev=66.97 00:16:47.901 clat percentiles (usec): 00:16:47.901 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:47.901 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:47.901 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:47.901 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:47.901 | 99.99th=[41157] 00:16:47.901 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:16:47.901 slat (nsec): min=7520, max=24772, avg=9066.74, stdev=1836.83 00:16:47.901 clat (usec): min=143, max=264, avg=213.25, stdev=17.99 00:16:47.902 lat (usec): min=151, max=273, avg=222.32, stdev=18.17 00:16:47.902 clat percentiles (usec): 00:16:47.902 | 1.00th=[ 174], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 200], 00:16:47.902 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 210], 60.00th=[ 217], 00:16:47.902 | 70.00th=[ 223], 80.00th=[ 229], 90.00th=[ 239], 95.00th=[ 245], 00:16:47.902 | 99.00th=[ 258], 99.50th=[ 265], 99.90th=[ 265], 99.95th=[ 265], 00:16:47.902 | 99.99th=[ 265] 00:16:47.902 bw ( KiB/s): min= 4096, max= 4096, per=25.48%, avg=4096.00, stdev= 0.00, samples=1 00:16:47.902 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:47.902 lat (usec) : 250=93.63%, 500=2.25% 00:16:47.902 lat (msec) : 50=4.12% 00:16:47.902 cpu : usr=0.29%, sys=0.69%, ctx=536, majf=0, minf=1 00:16:47.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.902 job2: (groupid=0, jobs=1): err= 0: pid=3990307: Wed Nov 27 21:06:43 2024 00:16:47.902 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(88.0KiB/1016msec) 00:16:47.902 slat (nsec): min=7528, max=38611, avg=25699.23, stdev=10815.88 00:16:47.902 clat (usec): min=40919, max=41711, avg=41009.07, stdev=165.53 00:16:47.902 lat (usec): min=40955, max=41729, avg=41034.76, stdev=163.99 00:16:47.902 clat percentiles (usec): 00:16:47.902 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:47.902 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:47.902 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:47.902 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:16:47.902 | 99.99th=[41681] 00:16:47.902 write: IOPS=503, BW=2016KiB/s (2064kB/s)(2048KiB/1016msec); 0 zone resets 00:16:47.902 slat (nsec): min=8181, max=29382, avg=9548.19, stdev=1878.05 00:16:47.902 clat (usec): min=164, max=421, avg=205.40, stdev=18.72 00:16:47.902 lat (usec): min=173, max=434, avg=214.95, stdev=18.88 00:16:47.902 clat percentiles (usec): 00:16:47.902 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 188], 20.00th=[ 194], 00:16:47.902 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 208], 00:16:47.902 | 70.00th=[ 210], 80.00th=[ 217], 90.00th=[ 221], 95.00th=[ 229], 00:16:47.902 | 99.00th=[ 258], 99.50th=[ 277], 99.90th=[ 420], 99.95th=[ 420], 00:16:47.902 | 99.99th=[ 420] 00:16:47.902 bw ( KiB/s): min= 4096, max= 4096, per=25.48%, avg=4096.00, stdev= 0.00, samples=1 00:16:47.902 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:47.902 lat (usec) : 250=94.38%, 500=1.50% 00:16:47.902 lat (msec) : 50=4.12% 00:16:47.902 cpu : usr=0.39%, sys=0.59%, ctx=537, majf=0, minf=1 00:16:47.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.902 job3: (groupid=0, jobs=1): err= 0: pid=3990319: Wed Nov 27 21:06:43 2024 00:16:47.902 read: IOPS=2148, BW=8595KiB/s (8802kB/s)(8604KiB/1001msec) 00:16:47.902 slat (nsec): min=4537, max=39590, avg=11870.68, stdev=5778.04 00:16:47.902 clat (usec): min=192, max=437, avg=227.62, stdev=32.32 00:16:47.902 lat (usec): min=198, max=471, avg=239.50, stdev=35.32 00:16:47.902 clat percentiles (usec): 00:16:47.902 | 1.00th=[ 196], 5.00th=[ 202], 10.00th=[ 204], 20.00th=[ 208], 00:16:47.902 | 30.00th=[ 212], 40.00th=[ 215], 50.00th=[ 217], 60.00th=[ 221], 00:16:47.902 | 70.00th=[ 225], 80.00th=[ 235], 90.00th=[ 281], 95.00th=[ 302], 00:16:47.902 | 99.00th=[ 351], 99.50th=[ 359], 99.90th=[ 388], 99.95th=[ 392], 00:16:47.902 | 99.99th=[ 437] 00:16:47.902 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:47.902 slat (nsec): min=6003, max=42868, avg=11754.49, stdev=4985.51 00:16:47.902 clat (usec): min=140, max=679, avg=171.59, stdev=30.22 00:16:47.902 lat (usec): min=146, max=689, avg=183.34, stdev=29.70 00:16:47.902 clat percentiles (usec): 00:16:47.902 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 149], 20.00th=[ 153], 00:16:47.902 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 161], 60.00th=[ 165], 00:16:47.902 | 70.00th=[ 172], 80.00th=[ 196], 90.00th=[ 217], 95.00th=[ 227], 00:16:47.902 | 99.00th=[ 249], 99.50th=[ 258], 99.90th=[ 420], 99.95th=[ 578], 00:16:47.902 | 99.99th=[ 676] 00:16:47.902 bw ( KiB/s): min=10992, max=10992, per=68.36%, avg=10992.00, stdev= 0.00, samples=1 00:16:47.902 iops : min= 2748, max= 2748, avg=2748.00, stdev= 0.00, samples=1 00:16:47.902 lat (usec) : 250=92.76%, 500=7.20%, 750=0.04% 00:16:47.902 cpu : usr=4.10%, sys=4.60%, ctx=4711, majf=0, minf=1 00:16:47.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.902 issued rwts: total=2151,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.902 00:16:47.902 Run status group 0 (all jobs): 00:16:47.902 READ: bw=9645KiB/s (9876kB/s), 86.4KiB/s-8595KiB/s (88.4kB/s-8802kB/s), io=9828KiB (10.1MB), run=1001-1019msec 00:16:47.902 WRITE: bw=15.7MiB/s (16.5MB/s), 2010KiB/s-9.99MiB/s (2058kB/s-10.5MB/s), io=16.0MiB (16.8MB), run=1001-1019msec 00:16:47.902 00:16:47.902 Disk stats (read/write): 00:16:47.902 nvme0n1: ios=218/512, merge=0/0, ticks=941/93, in_queue=1034, util=91.18% 00:16:47.902 nvme0n2: ios=68/512, merge=0/0, ticks=1553/106, in_queue=1659, util=97.97% 00:16:47.902 nvme0n3: ios=76/512, merge=0/0, ticks=1600/102, in_queue=1702, util=97.91% 00:16:47.902 nvme0n4: ios=1917/2048, merge=0/0, ticks=407/349, in_queue=756, util=89.65% 00:16:47.902 21:06:43 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:47.902 [global] 00:16:47.902 thread=1 00:16:47.902 invalidate=1 00:16:47.902 rw=randwrite 00:16:47.902 time_based=1 00:16:47.902 runtime=1 00:16:47.902 ioengine=libaio 00:16:47.902 direct=1 00:16:47.902 bs=4096 00:16:47.902 iodepth=1 00:16:47.902 norandommap=0 00:16:47.902 numjobs=1 00:16:47.902 00:16:47.902 verify_dump=1 00:16:47.902 verify_backlog=512 00:16:47.902 verify_state_save=0 00:16:47.902 do_verify=1 00:16:47.902 verify=crc32c-intel 00:16:47.902 [job0] 00:16:47.902 filename=/dev/nvme0n1 00:16:47.902 [job1] 00:16:47.902 filename=/dev/nvme0n2 00:16:47.902 [job2] 00:16:47.902 filename=/dev/nvme0n3 00:16:47.902 [job3] 00:16:47.902 filename=/dev/nvme0n4 00:16:47.902 Could not set queue depth (nvme0n1) 00:16:47.902 Could not set queue depth (nvme0n2) 00:16:47.902 Could not set queue depth (nvme0n3) 00:16:47.902 Could not set queue depth (nvme0n4) 00:16:48.160 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.160 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.160 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.160 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.160 fio-3.35 00:16:48.160 Starting 4 threads 00:16:49.530 00:16:49.530 job0: (groupid=0, jobs=1): err= 0: pid=3990580: Wed Nov 27 21:06:45 2024 00:16:49.530 read: IOPS=1915, BW=7660KiB/s (7844kB/s)(7668KiB/1001msec) 00:16:49.530 slat (nsec): min=5669, max=45758, avg=12008.72, stdev=5986.26 00:16:49.530 clat (usec): min=188, max=1266, avg=281.25, stdev=70.49 00:16:49.530 lat (usec): min=194, max=1304, avg=293.26, stdev=74.11 00:16:49.530 clat percentiles (usec): 00:16:49.530 | 1.00th=[ 202], 5.00th=[ 210], 10.00th=[ 215], 20.00th=[ 225], 00:16:49.530 | 30.00th=[ 243], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 285], 00:16:49.530 | 70.00th=[ 297], 80.00th=[ 310], 90.00th=[ 334], 95.00th=[ 412], 00:16:49.530 | 99.00th=[ 537], 99.50th=[ 570], 99.90th=[ 1156], 99.95th=[ 1270], 00:16:49.530 | 99.99th=[ 1270] 00:16:49.530 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:49.530 slat (nsec): min=7325, max=55802, avg=14072.41, stdev=7095.47 00:16:49.530 clat (usec): min=141, max=1144, avg=192.13, stdev=53.18 00:16:49.530 lat (usec): min=150, max=1155, avg=206.20, stdev=55.30 00:16:49.530 clat percentiles (usec): 00:16:49.530 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 161], 20.00th=[ 165], 00:16:49.530 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 186], 00:16:49.530 | 70.00th=[ 192], 80.00th=[ 202], 90.00th=[ 235], 95.00th=[ 281], 00:16:49.530 | 99.00th=[ 310], 99.50th=[ 363], 99.90th=[ 979], 99.95th=[ 1057], 00:16:49.530 | 99.99th=[ 1139] 00:16:49.530 bw ( KiB/s): min= 9285, max= 9285, per=46.29%, avg=9285.00, stdev= 0.00, samples=1 00:16:49.530 iops : min= 2321, max= 2321, avg=2321.00, stdev= 0.00, samples=1 00:16:49.530 lat (usec) : 250=62.82%, 500=36.14%, 750=0.88%, 1000=0.05% 00:16:49.530 lat (msec) : 2=0.10% 00:16:49.530 cpu : usr=3.90%, sys=7.00%, ctx=3966, majf=0, minf=1 00:16:49.530 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.530 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.530 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.530 issued rwts: total=1917,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.530 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.530 job1: (groupid=0, jobs=1): err= 0: pid=3990581: Wed Nov 27 21:06:45 2024 00:16:49.530 read: IOPS=831, BW=3325KiB/s (3404kB/s)(3328KiB/1001msec) 00:16:49.530 slat (nsec): min=6245, max=78293, avg=18766.50, stdev=11093.68 00:16:49.530 clat (usec): min=194, max=41244, avg=927.22, stdev=4879.88 00:16:49.530 lat (usec): min=213, max=41254, avg=945.99, stdev=4879.49 00:16:49.530 clat percentiles (usec): 00:16:49.530 | 1.00th=[ 210], 5.00th=[ 219], 10.00th=[ 227], 20.00th=[ 241], 00:16:49.530 | 30.00th=[ 269], 40.00th=[ 285], 50.00th=[ 302], 60.00th=[ 318], 00:16:49.530 | 70.00th=[ 351], 80.00th=[ 371], 90.00th=[ 400], 95.00th=[ 465], 00:16:49.530 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:49.530 | 99.99th=[41157] 00:16:49.530 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:49.530 slat (nsec): min=7872, max=41945, avg=12352.72, stdev=4691.01 00:16:49.530 clat (usec): min=144, max=435, avg=187.52, stdev=21.39 00:16:49.530 lat (usec): min=153, max=469, avg=199.88, stdev=22.69 00:16:49.530 clat percentiles (usec): 00:16:49.530 | 1.00th=[ 151], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 172], 00:16:49.530 | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 192], 00:16:49.530 | 70.00th=[ 196], 80.00th=[ 202], 90.00th=[ 210], 95.00th=[ 221], 00:16:49.530 | 99.00th=[ 249], 99.50th=[ 265], 99.90th=[ 351], 99.95th=[ 437], 00:16:49.530 | 99.99th=[ 437] 00:16:49.530 bw ( KiB/s): min= 4087, max= 4087, per=20.38%, avg=4087.00, stdev= 0.00, samples=1 00:16:49.530 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:49.530 lat (usec) : 250=64.92%, 500=33.57%, 750=0.70% 00:16:49.530 lat (msec) : 10=0.11%, 20=0.05%, 50=0.65% 00:16:49.530 cpu : usr=1.70%, sys=3.10%, ctx=1857, majf=0, minf=1 00:16:49.530 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.530 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.530 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.530 issued rwts: total=832,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.530 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.530 job2: (groupid=0, jobs=1): err= 0: pid=3990582: Wed Nov 27 21:06:45 2024 00:16:49.530 read: IOPS=21, BW=86.2KiB/s (88.3kB/s)(88.0KiB/1021msec) 00:16:49.531 slat (nsec): min=7615, max=38707, avg=22898.64, stdev=9813.17 00:16:49.531 clat (usec): min=40777, max=41257, avg=40967.93, stdev=87.86 00:16:49.531 lat (usec): min=40791, max=41271, avg=40990.83, stdev=86.67 00:16:49.531 clat percentiles (usec): 00:16:49.531 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:16:49.531 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:49.531 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:49.531 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:49.531 | 99.99th=[41157] 00:16:49.531 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:16:49.531 slat (nsec): min=7627, max=30897, avg=9055.70, stdev=2135.27 00:16:49.531 clat (usec): min=167, max=403, avg=220.05, stdev=20.55 00:16:49.531 lat (usec): min=178, max=413, avg=229.10, stdev=20.76 00:16:49.531 clat percentiles (usec): 00:16:49.531 | 1.00th=[ 186], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 208], 00:16:49.531 | 30.00th=[ 212], 40.00th=[ 215], 50.00th=[ 219], 60.00th=[ 221], 00:16:49.531 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 237], 95.00th=[ 247], 00:16:49.531 | 99.00th=[ 297], 99.50th=[ 338], 99.90th=[ 404], 99.95th=[ 404], 00:16:49.531 | 99.99th=[ 404] 00:16:49.531 bw ( KiB/s): min= 4087, max= 4087, per=20.38%, avg=4087.00, stdev= 0.00, samples=1 00:16:49.531 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:49.531 lat (usec) : 250=91.76%, 500=4.12% 00:16:49.531 lat (msec) : 50=4.12% 00:16:49.531 cpu : usr=0.59%, sys=0.39%, ctx=535, majf=0, minf=2 00:16:49.531 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.531 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.531 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.531 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.531 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.531 job3: (groupid=0, jobs=1): err= 0: pid=3990583: Wed Nov 27 21:06:45 2024 00:16:49.531 read: IOPS=1038, BW=4156KiB/s (4256kB/s)(4160KiB/1001msec) 00:16:49.531 slat (nsec): min=4904, max=66369, avg=11706.87, stdev=9482.98 00:16:49.531 clat (usec): min=195, max=40997, avg=622.14, stdev=3764.08 00:16:49.531 lat (usec): min=201, max=41011, avg=633.85, stdev=3765.25 00:16:49.531 clat percentiles (usec): 00:16:49.531 | 1.00th=[ 200], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 217], 00:16:49.531 | 30.00th=[ 221], 40.00th=[ 229], 50.00th=[ 241], 60.00th=[ 253], 00:16:49.531 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 482], 95.00th=[ 519], 00:16:49.531 | 99.00th=[ 734], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:49.531 | 99.99th=[41157] 00:16:49.531 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:49.531 slat (nsec): min=6756, max=50266, avg=12574.20, stdev=6159.83 00:16:49.531 clat (usec): min=140, max=3056, avg=203.93, stdev=80.78 00:16:49.531 lat (usec): min=148, max=3064, avg=216.50, stdev=81.18 00:16:49.531 clat percentiles (usec): 00:16:49.531 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 161], 20.00th=[ 172], 00:16:49.531 | 30.00th=[ 180], 40.00th=[ 192], 50.00th=[ 204], 60.00th=[ 212], 00:16:49.531 | 70.00th=[ 221], 80.00th=[ 229], 90.00th=[ 237], 95.00th=[ 245], 00:16:49.531 | 99.00th=[ 302], 99.50th=[ 388], 99.90th=[ 603], 99.95th=[ 3064], 00:16:49.531 | 99.99th=[ 3064] 00:16:49.531 bw ( KiB/s): min= 8175, max= 8175, per=40.76%, avg=8175.00, stdev= 0.00, samples=1 00:16:49.531 iops : min= 2043, max= 2043, avg=2043.00, stdev= 0.00, samples=1 00:16:49.531 lat (usec) : 250=80.98%, 500=15.06%, 750=3.53% 00:16:49.531 lat (msec) : 4=0.08%, 50=0.35% 00:16:49.531 cpu : usr=1.80%, sys=3.30%, ctx=2578, majf=0, minf=2 00:16:49.531 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.531 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.531 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.531 issued rwts: total=1040,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.531 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.531 00:16:49.531 Run status group 0 (all jobs): 00:16:49.531 READ: bw=14.6MiB/s (15.3MB/s), 86.2KiB/s-7660KiB/s (88.3kB/s-7844kB/s), io=14.9MiB (15.6MB), run=1001-1021msec 00:16:49.531 WRITE: bw=19.6MiB/s (20.5MB/s), 2006KiB/s-8184KiB/s (2054kB/s-8380kB/s), io=20.0MiB (21.0MB), run=1001-1021msec 00:16:49.531 00:16:49.531 Disk stats (read/write): 00:16:49.531 nvme0n1: ios=1575/2027, merge=0/0, ticks=1276/364, in_queue=1640, util=99.60% 00:16:49.531 nvme0n2: ios=536/870, merge=0/0, ticks=1649/150, in_queue=1799, util=98.48% 00:16:49.531 nvme0n3: ios=75/512, merge=0/0, ticks=1270/110, in_queue=1380, util=98.65% 00:16:49.531 nvme0n4: ios=1011/1024, merge=0/0, ticks=1583/191, in_queue=1774, util=98.32% 00:16:49.531 21:06:45 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:49.531 [global] 00:16:49.531 thread=1 00:16:49.531 invalidate=1 00:16:49.531 rw=write 00:16:49.531 time_based=1 00:16:49.531 runtime=1 00:16:49.531 ioengine=libaio 00:16:49.531 direct=1 00:16:49.531 bs=4096 00:16:49.531 iodepth=128 00:16:49.531 norandommap=0 00:16:49.531 numjobs=1 00:16:49.531 00:16:49.531 verify_dump=1 00:16:49.531 verify_backlog=512 00:16:49.531 verify_state_save=0 00:16:49.531 do_verify=1 00:16:49.531 verify=crc32c-intel 00:16:49.531 [job0] 00:16:49.531 filename=/dev/nvme0n1 00:16:49.531 [job1] 00:16:49.531 filename=/dev/nvme0n2 00:16:49.531 [job2] 00:16:49.531 filename=/dev/nvme0n3 00:16:49.531 [job3] 00:16:49.531 filename=/dev/nvme0n4 00:16:49.531 Could not set queue depth (nvme0n1) 00:16:49.531 Could not set queue depth (nvme0n2) 00:16:49.531 Could not set queue depth (nvme0n3) 00:16:49.531 Could not set queue depth (nvme0n4) 00:16:49.531 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.531 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.531 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.531 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.531 fio-3.35 00:16:49.531 Starting 4 threads 00:16:50.905 00:16:50.905 job0: (groupid=0, jobs=1): err= 0: pid=3990811: Wed Nov 27 21:06:46 2024 00:16:50.905 read: IOPS=5466, BW=21.4MiB/s (22.4MB/s)(21.4MiB/1003msec) 00:16:50.905 slat (usec): min=3, max=9195, avg=82.20, stdev=508.83 00:16:50.905 clat (usec): min=1705, max=23212, avg=10697.13, stdev=2099.64 00:16:50.905 lat (usec): min=3159, max=23228, avg=10779.33, stdev=2146.76 00:16:50.905 clat percentiles (usec): 00:16:50.905 | 1.00th=[ 6325], 5.00th=[ 8356], 10.00th=[ 9372], 20.00th=[ 9634], 00:16:50.905 | 30.00th=[ 9896], 40.00th=[10028], 50.00th=[10159], 60.00th=[10290], 00:16:50.905 | 70.00th=[10552], 80.00th=[11731], 90.00th=[13698], 95.00th=[14353], 00:16:50.905 | 99.00th=[20317], 99.50th=[20317], 99.90th=[20317], 99.95th=[20579], 00:16:50.905 | 99.99th=[23200] 00:16:50.905 write: IOPS=5615, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1003msec); 0 zone resets 00:16:50.905 slat (usec): min=3, max=7880, avg=87.70, stdev=486.73 00:16:50.905 clat (usec): min=6021, max=23215, avg=12105.13, stdev=3225.03 00:16:50.905 lat (usec): min=6034, max=23229, avg=12192.83, stdev=3259.15 00:16:50.905 clat percentiles (usec): 00:16:50.905 | 1.00th=[ 6521], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[10290], 00:16:50.905 | 30.00th=[10421], 40.00th=[10552], 50.00th=[10683], 60.00th=[10945], 00:16:50.905 | 70.00th=[11207], 80.00th=[15008], 90.00th=[18220], 95.00th=[18744], 00:16:50.905 | 99.00th=[21103], 99.50th=[21365], 99.90th=[22152], 99.95th=[22938], 00:16:50.905 | 99.99th=[23200] 00:16:50.905 bw ( KiB/s): min=20480, max=24576, per=34.19%, avg=22528.00, stdev=2896.31, samples=2 00:16:50.905 iops : min= 5120, max= 6144, avg=5632.00, stdev=724.08, samples=2 00:16:50.905 lat (msec) : 2=0.01%, 4=0.32%, 10=22.69%, 20=74.88%, 50=2.10% 00:16:50.905 cpu : usr=7.58%, sys=10.58%, ctx=458, majf=0, minf=1 00:16:50.905 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:50.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.905 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.905 issued rwts: total=5483,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.905 job1: (groupid=0, jobs=1): err= 0: pid=3990812: Wed Nov 27 21:06:46 2024 00:16:50.905 read: IOPS=2202, BW=8811KiB/s (9023kB/s)(8864KiB/1006msec) 00:16:50.905 slat (usec): min=2, max=12494, avg=159.96, stdev=865.92 00:16:50.905 clat (usec): min=2339, max=76508, avg=22220.32, stdev=11658.13 00:16:50.905 lat (usec): min=7348, max=76513, avg=22380.27, stdev=11703.61 00:16:50.905 clat percentiles (usec): 00:16:50.905 | 1.00th=[ 7767], 5.00th=[13435], 10.00th=[14484], 20.00th=[15270], 00:16:50.905 | 30.00th=[16319], 40.00th=[18220], 50.00th=[18482], 60.00th=[18744], 00:16:50.905 | 70.00th=[20579], 80.00th=[23725], 90.00th=[45351], 95.00th=[50070], 00:16:50.905 | 99.00th=[62653], 99.50th=[62653], 99.90th=[62653], 99.95th=[71828], 00:16:50.905 | 99.99th=[76022] 00:16:50.905 write: IOPS=2544, BW=9.94MiB/s (10.4MB/s)(10.0MiB/1006msec); 0 zone resets 00:16:50.905 slat (usec): min=3, max=26104, avg=244.93, stdev=1270.99 00:16:50.905 clat (msec): min=12, max=117, avg=30.25, stdev=21.55 00:16:50.905 lat (msec): min=12, max=117, avg=30.49, stdev=21.70 00:16:50.905 clat percentiles (msec): 00:16:50.905 | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], 00:16:50.906 | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 23], 60.00th=[ 23], 00:16:50.906 | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 56], 95.00th=[ 79], 00:16:50.906 | 99.00th=[ 115], 99.50th=[ 117], 99.90th=[ 117], 99.95th=[ 117], 00:16:50.906 | 99.99th=[ 117] 00:16:50.906 bw ( KiB/s): min= 8192, max=12263, per=15.52%, avg=10227.50, stdev=2878.63, samples=2 00:16:50.906 iops : min= 2048, max= 3065, avg=2556.50, stdev=719.13, samples=2 00:16:50.906 lat (msec) : 4=0.02%, 10=1.11%, 20=47.82%, 50=40.77%, 100=8.29% 00:16:50.906 lat (msec) : 250=1.99% 00:16:50.906 cpu : usr=2.79%, sys=4.28%, ctx=312, majf=0, minf=1 00:16:50.906 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:16:50.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.906 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.906 issued rwts: total=2216,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.906 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.906 job2: (groupid=0, jobs=1): err= 0: pid=3990813: Wed Nov 27 21:06:46 2024 00:16:50.906 read: IOPS=3545, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1011msec) 00:16:50.906 slat (usec): min=2, max=14594, avg=132.89, stdev=877.86 00:16:50.906 clat (usec): min=5010, max=37234, avg=16209.38, stdev=5658.96 00:16:50.906 lat (usec): min=5018, max=37238, avg=16342.27, stdev=5716.40 00:16:50.906 clat percentiles (usec): 00:16:50.906 | 1.00th=[ 8455], 5.00th=[ 9634], 10.00th=[10814], 20.00th=[11994], 00:16:50.906 | 30.00th=[12518], 40.00th=[12649], 50.00th=[14484], 60.00th=[16909], 00:16:50.906 | 70.00th=[17957], 80.00th=[19792], 90.00th=[23462], 95.00th=[28967], 00:16:50.906 | 99.00th=[33817], 99.50th=[35914], 99.90th=[36963], 99.95th=[37487], 00:16:50.906 | 99.99th=[37487] 00:16:50.906 write: IOPS=3812, BW=14.9MiB/s (15.6MB/s)(15.1MiB/1011msec); 0 zone resets 00:16:50.906 slat (usec): min=3, max=11464, avg=130.53, stdev=787.14 00:16:50.906 clat (usec): min=3646, max=36724, avg=18013.47, stdev=6186.34 00:16:50.906 lat (usec): min=3654, max=36733, avg=18144.01, stdev=6250.81 00:16:50.906 clat percentiles (usec): 00:16:50.906 | 1.00th=[ 5407], 5.00th=[ 9503], 10.00th=[11076], 20.00th=[11731], 00:16:50.906 | 30.00th=[13698], 40.00th=[14353], 50.00th=[19268], 60.00th=[20841], 00:16:50.906 | 70.00th=[21890], 80.00th=[22938], 90.00th=[24773], 95.00th=[27657], 00:16:50.906 | 99.00th=[34341], 99.50th=[35390], 99.90th=[35914], 99.95th=[36963], 00:16:50.906 | 99.99th=[36963] 00:16:50.906 bw ( KiB/s): min=14866, max=14920, per=22.60%, avg=14893.00, stdev=38.18, samples=2 00:16:50.906 iops : min= 3716, max= 3730, avg=3723.00, stdev= 9.90, samples=2 00:16:50.906 lat (msec) : 4=0.08%, 10=8.11%, 20=58.46%, 50=33.36% 00:16:50.906 cpu : usr=2.57%, sys=4.55%, ctx=326, majf=0, minf=1 00:16:50.906 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:50.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.906 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.906 issued rwts: total=3584,3854,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.906 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.906 job3: (groupid=0, jobs=1): err= 0: pid=3990814: Wed Nov 27 21:06:46 2024 00:16:50.906 read: IOPS=4587, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec) 00:16:50.906 slat (usec): min=2, max=11169, avg=111.45, stdev=781.34 00:16:50.906 clat (usec): min=950, max=47089, avg=14315.74, stdev=6871.54 00:16:50.906 lat (usec): min=3416, max=47104, avg=14427.18, stdev=6935.44 00:16:50.906 clat percentiles (usec): 00:16:50.906 | 1.00th=[ 7308], 5.00th=[ 8979], 10.00th=[10159], 20.00th=[10552], 00:16:50.906 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:16:50.906 | 70.00th=[14222], 80.00th=[17171], 90.00th=[26084], 95.00th=[31065], 00:16:50.906 | 99.00th=[40633], 99.50th=[43779], 99.90th=[44827], 99.95th=[44827], 00:16:50.906 | 99.99th=[46924] 00:16:50.906 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:16:50.906 slat (usec): min=3, max=10698, avg=95.28, stdev=605.43 00:16:50.906 clat (usec): min=1891, max=35474, avg=13261.44, stdev=5375.79 00:16:50.906 lat (usec): min=1901, max=35481, avg=13356.72, stdev=5425.56 00:16:50.906 clat percentiles (usec): 00:16:50.906 | 1.00th=[ 3261], 5.00th=[ 5145], 10.00th=[ 7570], 20.00th=[10945], 00:16:50.906 | 30.00th=[11600], 40.00th=[12256], 50.00th=[12518], 60.00th=[12518], 00:16:50.906 | 70.00th=[12649], 80.00th=[16057], 90.00th=[21103], 95.00th=[24249], 00:16:50.906 | 99.00th=[32900], 99.50th=[35390], 99.90th=[35390], 99.95th=[35390], 00:16:50.906 | 99.99th=[35390] 00:16:50.906 bw ( KiB/s): min=16351, max=20480, per=27.95%, avg=18415.50, stdev=2919.64, samples=2 00:16:50.906 iops : min= 4087, max= 5120, avg=4603.50, stdev=730.44, samples=2 00:16:50.906 lat (usec) : 1000=0.01% 00:16:50.906 lat (msec) : 2=0.07%, 4=1.26%, 10=11.94%, 20=71.52%, 50=15.20% 00:16:50.906 cpu : usr=4.89%, sys=10.08%, ctx=485, majf=0, minf=1 00:16:50.906 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:50.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.906 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.906 issued rwts: total=4601,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.906 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.906 00:16:50.906 Run status group 0 (all jobs): 00:16:50.906 READ: bw=61.4MiB/s (64.4MB/s), 8811KiB/s-21.4MiB/s (9023kB/s-22.4MB/s), io=62.0MiB (65.1MB), run=1003-1011msec 00:16:50.906 WRITE: bw=64.3MiB/s (67.5MB/s), 9.94MiB/s-21.9MiB/s (10.4MB/s-23.0MB/s), io=65.1MiB (68.2MB), run=1003-1011msec 00:16:50.906 00:16:50.906 Disk stats (read/write): 00:16:50.906 nvme0n1: ios=4639/4619, merge=0/0, ticks=23889/26486, in_queue=50375, util=91.08% 00:16:50.906 nvme0n2: ios=2061/2367, merge=0/0, ticks=14628/19797, in_queue=34425, util=86.80% 00:16:50.906 nvme0n3: ios=2826/3072, merge=0/0, ticks=37052/48652, in_queue=85704, util=98.96% 00:16:50.906 nvme0n4: ios=3584/3975, merge=0/0, ticks=39986/40116, in_queue=80102, util=89.71% 00:16:50.906 21:06:46 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:50.906 [global] 00:16:50.906 thread=1 00:16:50.906 invalidate=1 00:16:50.906 rw=randwrite 00:16:50.906 time_based=1 00:16:50.906 runtime=1 00:16:50.906 ioengine=libaio 00:16:50.906 direct=1 00:16:50.906 bs=4096 00:16:50.906 iodepth=128 00:16:50.906 norandommap=0 00:16:50.906 numjobs=1 00:16:50.906 00:16:50.906 verify_dump=1 00:16:50.906 verify_backlog=512 00:16:50.906 verify_state_save=0 00:16:50.906 do_verify=1 00:16:50.906 verify=crc32c-intel 00:16:50.906 [job0] 00:16:50.906 filename=/dev/nvme0n1 00:16:50.906 [job1] 00:16:50.906 filename=/dev/nvme0n2 00:16:50.906 [job2] 00:16:50.906 filename=/dev/nvme0n3 00:16:50.906 [job3] 00:16:50.906 filename=/dev/nvme0n4 00:16:50.906 Could not set queue depth (nvme0n1) 00:16:50.906 Could not set queue depth (nvme0n2) 00:16:50.906 Could not set queue depth (nvme0n3) 00:16:50.906 Could not set queue depth (nvme0n4) 00:16:50.906 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.906 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.906 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.906 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.906 fio-3.35 00:16:50.906 Starting 4 threads 00:16:52.279 00:16:52.279 job0: (groupid=0, jobs=1): err= 0: pid=3991050: Wed Nov 27 21:06:48 2024 00:16:52.279 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:52.279 slat (usec): min=2, max=13597, avg=86.32, stdev=587.96 00:16:52.279 clat (usec): min=618, max=37914, avg=11839.20, stdev=4641.85 00:16:52.279 lat (usec): min=635, max=37922, avg=11925.52, stdev=4664.83 00:16:52.279 clat percentiles (usec): 00:16:52.279 | 1.00th=[ 4752], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 9503], 00:16:52.279 | 30.00th=[ 9765], 40.00th=[ 9896], 50.00th=[10159], 60.00th=[10945], 00:16:52.279 | 70.00th=[12387], 80.00th=[13960], 90.00th=[16057], 95.00th=[21103], 00:16:52.279 | 99.00th=[33817], 99.50th=[34341], 99.90th=[34866], 99.95th=[34866], 00:16:52.279 | 99.99th=[38011] 00:16:52.279 write: IOPS=5260, BW=20.5MiB/s (21.5MB/s)(20.6MiB/1002msec); 0 zone resets 00:16:52.279 slat (usec): min=3, max=16329, avg=91.84, stdev=580.95 00:16:52.279 clat (usec): min=1327, max=73762, avg=12622.47, stdev=7552.02 00:16:52.279 lat (usec): min=1344, max=73805, avg=12714.31, stdev=7591.20 00:16:52.279 clat percentiles (usec): 00:16:52.279 | 1.00th=[ 5866], 5.00th=[ 7504], 10.00th=[ 9241], 20.00th=[10159], 00:16:52.279 | 30.00th=[10421], 40.00th=[10683], 50.00th=[10814], 60.00th=[11076], 00:16:52.279 | 70.00th=[12125], 80.00th=[13042], 90.00th=[15139], 95.00th=[22414], 00:16:52.279 | 99.00th=[55313], 99.50th=[62653], 99.90th=[69731], 99.95th=[70779], 00:16:52.279 | 99.99th=[73925] 00:16:52.279 bw ( KiB/s): min=16920, max=24232, per=29.15%, avg=20576.00, stdev=5170.36, samples=2 00:16:52.279 iops : min= 4230, max= 6058, avg=5144.00, stdev=1292.59, samples=2 00:16:52.279 lat (usec) : 750=0.22%, 1000=0.05% 00:16:52.279 lat (msec) : 2=0.21%, 10=28.88%, 20=64.55%, 50=5.34%, 100=0.75% 00:16:52.279 cpu : usr=5.19%, sys=10.39%, ctx=537, majf=0, minf=1 00:16:52.279 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:52.279 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.279 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:52.279 issued rwts: total=5120,5271,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.279 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:52.279 job1: (groupid=0, jobs=1): err= 0: pid=3991051: Wed Nov 27 21:06:48 2024 00:16:52.279 read: IOPS=3320, BW=13.0MiB/s (13.6MB/s)(13.0MiB/1003msec) 00:16:52.279 slat (nsec): min=1999, max=36212k, avg=149493.19, stdev=1295744.55 00:16:52.279 clat (usec): min=2395, max=76140, avg=17188.68, stdev=9329.72 00:16:52.279 lat (usec): min=2400, max=95062, avg=17338.18, stdev=9466.68 00:16:52.279 clat percentiles (usec): 00:16:52.279 | 1.00th=[ 4752], 5.00th=[ 8029], 10.00th=[ 9896], 20.00th=[10683], 00:16:52.279 | 30.00th=[11469], 40.00th=[11863], 50.00th=[13435], 60.00th=[18744], 00:16:52.279 | 70.00th=[21627], 80.00th=[22414], 90.00th=[27132], 95.00th=[30540], 00:16:52.279 | 99.00th=[45351], 99.50th=[76022], 99.90th=[76022], 99.95th=[76022], 00:16:52.279 | 99.99th=[76022] 00:16:52.280 write: IOPS=3573, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1003msec); 0 zone resets 00:16:52.280 slat (usec): min=3, max=29682, avg=113.46, stdev=1120.38 00:16:52.280 clat (msec): min=3, max=100, avg=19.54, stdev=16.62 00:16:52.280 lat (msec): min=3, max=105, avg=19.65, stdev=16.70 00:16:52.280 clat percentiles (msec): 00:16:52.280 | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], 00:16:52.280 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], 00:16:52.280 | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 42], 95.00th=[ 47], 00:16:52.280 | 99.00th=[ 95], 99.50th=[ 102], 99.90th=[ 102], 99.95th=[ 102], 00:16:52.280 | 99.99th=[ 102] 00:16:52.280 bw ( KiB/s): min=10976, max=17696, per=20.31%, avg=14336.00, stdev=4751.76, samples=2 00:16:52.280 iops : min= 2744, max= 4424, avg=3584.00, stdev=1187.94, samples=2 00:16:52.280 lat (msec) : 4=0.81%, 10=12.48%, 20=53.23%, 50=30.86%, 100=2.17% 00:16:52.280 lat (msec) : 250=0.45% 00:16:52.280 cpu : usr=2.50%, sys=4.59%, ctx=241, majf=0, minf=1 00:16:52.280 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:52.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.280 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:52.280 issued rwts: total=3330,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.280 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:52.280 job2: (groupid=0, jobs=1): err= 0: pid=3991057: Wed Nov 27 21:06:48 2024 00:16:52.280 read: IOPS=4051, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1011msec) 00:16:52.280 slat (nsec): min=1988, max=17190k, avg=105519.86, stdev=780957.91 00:16:52.280 clat (usec): min=5861, max=59532, avg=13961.47, stdev=7199.81 00:16:52.280 lat (usec): min=5864, max=59536, avg=14066.99, stdev=7252.74 00:16:52.280 clat percentiles (usec): 00:16:52.280 | 1.00th=[ 8455], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10683], 00:16:52.280 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11731], 60.00th=[12125], 00:16:52.280 | 70.00th=[13042], 80.00th=[14615], 90.00th=[19006], 95.00th=[23462], 00:16:52.280 | 99.00th=[55313], 99.50th=[57934], 99.90th=[59507], 99.95th=[59507], 00:16:52.280 | 99.99th=[59507] 00:16:52.280 write: IOPS=4466, BW=17.4MiB/s (18.3MB/s)(17.6MiB/1011msec); 0 zone resets 00:16:52.280 slat (usec): min=3, max=21320, avg=105.69, stdev=811.57 00:16:52.280 clat (usec): min=1075, max=59947, avg=15765.87, stdev=7899.14 00:16:52.280 lat (usec): min=1080, max=59952, avg=15871.56, stdev=7941.78 00:16:52.280 clat percentiles (usec): 00:16:52.280 | 1.00th=[ 5473], 5.00th=[ 8160], 10.00th=[ 9765], 20.00th=[11469], 00:16:52.280 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12387], 60.00th=[13435], 00:16:52.280 | 70.00th=[15926], 80.00th=[19792], 90.00th=[27657], 95.00th=[33817], 00:16:52.280 | 99.00th=[40633], 99.50th=[51119], 99.90th=[60031], 99.95th=[60031], 00:16:52.280 | 99.99th=[60031] 00:16:52.280 bw ( KiB/s): min=16368, max=18744, per=24.87%, avg=17556.00, stdev=1680.09, samples=2 00:16:52.280 iops : min= 4092, max= 4686, avg=4389.00, stdev=420.02, samples=2 00:16:52.280 lat (msec) : 2=0.15%, 4=0.27%, 10=9.06%, 20=76.67%, 50=12.87% 00:16:52.280 lat (msec) : 100=0.99% 00:16:52.280 cpu : usr=4.85%, sys=8.61%, ctx=387, majf=0, minf=1 00:16:52.280 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:52.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.280 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:52.280 issued rwts: total=4096,4516,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.280 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:52.280 job3: (groupid=0, jobs=1): err= 0: pid=3991058: Wed Nov 27 21:06:48 2024 00:16:52.280 read: IOPS=4051, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1011msec) 00:16:52.280 slat (usec): min=2, max=15395, avg=111.73, stdev=816.55 00:16:52.280 clat (usec): min=1889, max=42059, avg=15119.33, stdev=5956.50 00:16:52.280 lat (usec): min=1903, max=43576, avg=15231.06, stdev=6025.14 00:16:52.280 clat percentiles (usec): 00:16:52.280 | 1.00th=[ 3621], 5.00th=[ 7177], 10.00th=[ 9634], 20.00th=[11076], 00:16:52.280 | 30.00th=[11731], 40.00th=[12649], 50.00th=[13829], 60.00th=[14353], 00:16:52.280 | 70.00th=[16319], 80.00th=[18744], 90.00th=[25560], 95.00th=[27395], 00:16:52.280 | 99.00th=[34341], 99.50th=[35390], 99.90th=[36963], 99.95th=[36963], 00:16:52.280 | 99.99th=[42206] 00:16:52.280 write: IOPS=4419, BW=17.3MiB/s (18.1MB/s)(17.5MiB/1011msec); 0 zone resets 00:16:52.280 slat (usec): min=3, max=13665, avg=108.28, stdev=745.31 00:16:52.280 clat (usec): min=496, max=37034, avg=14863.04, stdev=4867.69 00:16:52.280 lat (usec): min=537, max=37073, avg=14971.32, stdev=4918.29 00:16:52.280 clat percentiles (usec): 00:16:52.280 | 1.00th=[ 4883], 5.00th=[ 9241], 10.00th=[10552], 20.00th=[11731], 00:16:52.280 | 30.00th=[12125], 40.00th=[12780], 50.00th=[13304], 60.00th=[13698], 00:16:52.280 | 70.00th=[14615], 80.00th=[21103], 90.00th=[22152], 95.00th=[23725], 00:16:52.280 | 99.00th=[29230], 99.50th=[29492], 99.90th=[31589], 99.95th=[32113], 00:16:52.280 | 99.99th=[36963] 00:16:52.280 bw ( KiB/s): min=14248, max=20472, per=24.60%, avg=17360.00, stdev=4401.03, samples=2 00:16:52.280 iops : min= 3562, max= 5118, avg=4340.00, stdev=1100.26, samples=2 00:16:52.280 lat (usec) : 500=0.01% 00:16:52.280 lat (msec) : 2=0.09%, 4=0.65%, 10=8.59%, 20=70.98%, 50=19.66% 00:16:52.280 cpu : usr=4.46%, sys=7.62%, ctx=374, majf=0, minf=1 00:16:52.280 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:52.280 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.280 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:52.280 issued rwts: total=4096,4468,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.280 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:52.280 00:16:52.280 Run status group 0 (all jobs): 00:16:52.280 READ: bw=64.3MiB/s (67.4MB/s), 13.0MiB/s-20.0MiB/s (13.6MB/s-20.9MB/s), io=65.0MiB (68.2MB), run=1002-1011msec 00:16:52.280 WRITE: bw=68.9MiB/s (72.3MB/s), 14.0MiB/s-20.5MiB/s (14.6MB/s-21.5MB/s), io=69.7MiB (73.1MB), run=1002-1011msec 00:16:52.280 00:16:52.280 Disk stats (read/write): 00:16:52.280 nvme0n1: ios=4148/4350, merge=0/0, ticks=29349/32496, in_queue=61845, util=97.90% 00:16:52.280 nvme0n2: ios=2674/3072, merge=0/0, ticks=33486/37185, in_queue=70671, util=98.17% 00:16:52.280 nvme0n3: ios=3610/3836, merge=0/0, ticks=32711/36298, in_queue=69009, util=90.81% 00:16:52.280 nvme0n4: ios=3641/3767, merge=0/0, ticks=43190/47234, in_queue=90424, util=98.11% 00:16:52.280 21:06:48 -- target/fio.sh@55 -- # sync 00:16:52.280 21:06:48 -- target/fio.sh@59 -- # fio_pid=3991223 00:16:52.280 21:06:48 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:52.280 21:06:48 -- target/fio.sh@61 -- # sleep 3 00:16:52.280 [global] 00:16:52.280 thread=1 00:16:52.280 invalidate=1 00:16:52.280 rw=read 00:16:52.280 time_based=1 00:16:52.280 runtime=10 00:16:52.280 ioengine=libaio 00:16:52.280 direct=1 00:16:52.280 bs=4096 00:16:52.280 iodepth=1 00:16:52.280 norandommap=1 00:16:52.280 numjobs=1 00:16:52.280 00:16:52.280 [job0] 00:16:52.280 filename=/dev/nvme0n1 00:16:52.280 [job1] 00:16:52.280 filename=/dev/nvme0n2 00:16:52.280 [job2] 00:16:52.280 filename=/dev/nvme0n3 00:16:52.280 [job3] 00:16:52.280 filename=/dev/nvme0n4 00:16:52.280 Could not set queue depth (nvme0n1) 00:16:52.280 Could not set queue depth (nvme0n2) 00:16:52.280 Could not set queue depth (nvme0n3) 00:16:52.280 Could not set queue depth (nvme0n4) 00:16:52.537 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.537 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.537 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.537 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:52.537 fio-3.35 00:16:52.537 Starting 4 threads 00:16:55.819 21:06:51 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:55.819 21:06:51 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:55.819 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=39600128, buflen=4096 00:16:55.819 fio: pid=3991411, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:55.819 21:06:51 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:55.819 21:06:51 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:55.819 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=16662528, buflen=4096 00:16:55.819 fio: pid=3991410, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:56.076 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=45445120, buflen=4096 00:16:56.076 fio: pid=3991404, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:56.076 21:06:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:56.076 21:06:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:56.336 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=413696, buflen=4096 00:16:56.336 fio: pid=3991405, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:56.336 21:06:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:56.336 21:06:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:56.336 00:16:56.336 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3991404: Wed Nov 27 21:06:52 2024 00:16:56.336 read: IOPS=3189, BW=12.5MiB/s (13.1MB/s)(43.3MiB/3479msec) 00:16:56.336 slat (usec): min=4, max=14445, avg=16.16, stdev=213.33 00:16:56.336 clat (usec): min=185, max=41193, avg=292.11, stdev=398.81 00:16:56.336 lat (usec): min=190, max=41199, avg=308.27, stdev=452.40 00:16:56.336 clat percentiles (usec): 00:16:56.336 | 1.00th=[ 206], 5.00th=[ 223], 10.00th=[ 233], 20.00th=[ 245], 00:16:56.336 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 277], 60.00th=[ 285], 00:16:56.336 | 70.00th=[ 297], 80.00th=[ 314], 90.00th=[ 351], 95.00th=[ 408], 00:16:56.336 | 99.00th=[ 498], 99.50th=[ 529], 99.90th=[ 930], 99.95th=[ 1303], 00:16:56.336 | 99.99th=[ 4228] 00:16:56.336 bw ( KiB/s): min=11768, max=14768, per=47.81%, avg=12725.33, stdev=1200.61, samples=6 00:16:56.336 iops : min= 2942, max= 3692, avg=3181.33, stdev=300.15, samples=6 00:16:56.336 lat (usec) : 250=24.51%, 500=74.52%, 750=0.79%, 1000=0.08% 00:16:56.336 lat (msec) : 2=0.04%, 4=0.02%, 10=0.02%, 50=0.01% 00:16:56.336 cpu : usr=1.70%, sys=5.49%, ctx=11103, majf=0, minf=2 00:16:56.336 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:56.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 issued rwts: total=11096,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.336 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:56.336 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3991405: Wed Nov 27 21:06:52 2024 00:16:56.336 read: IOPS=27, BW=108KiB/s (110kB/s)(404KiB/3747msec) 00:16:56.336 slat (usec): min=8, max=11907, avg=258.02, stdev=1454.34 00:16:56.336 clat (usec): min=350, max=42032, avg=36593.29, stdev=12700.50 00:16:56.336 lat (usec): min=367, max=52958, avg=36798.64, stdev=12840.37 00:16:56.336 clat percentiles (usec): 00:16:56.336 | 1.00th=[ 351], 5.00th=[ 457], 10.00th=[ 586], 20.00th=[40633], 00:16:56.336 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:56.336 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:56.336 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:56.336 | 99.99th=[42206] 00:16:56.336 bw ( KiB/s): min= 93, max= 136, per=0.41%, avg=109.29, stdev=18.71, samples=7 00:16:56.336 iops : min= 23, max= 34, avg=27.29, stdev= 4.72, samples=7 00:16:56.336 lat (usec) : 500=8.82%, 750=1.96% 00:16:56.336 lat (msec) : 50=88.24% 00:16:56.336 cpu : usr=0.11%, sys=0.00%, ctx=106, majf=0, minf=2 00:16:56.336 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:56.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 complete : 0=1.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 issued rwts: total=102,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.336 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:56.336 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3991410: Wed Nov 27 21:06:52 2024 00:16:56.336 read: IOPS=1269, BW=5079KiB/s (5201kB/s)(15.9MiB/3204msec) 00:16:56.336 slat (nsec): min=4188, max=59830, avg=10487.75, stdev=6855.06 00:16:56.336 clat (usec): min=207, max=41979, avg=768.98, stdev=4389.79 00:16:56.336 lat (usec): min=212, max=41993, avg=779.47, stdev=4391.03 00:16:56.336 clat percentiles (usec): 00:16:56.336 | 1.00th=[ 223], 5.00th=[ 233], 10.00th=[ 237], 20.00th=[ 243], 00:16:56.336 | 30.00th=[ 249], 40.00th=[ 255], 50.00th=[ 265], 60.00th=[ 281], 00:16:56.336 | 70.00th=[ 306], 80.00th=[ 338], 90.00th=[ 383], 95.00th=[ 416], 00:16:56.336 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:56.336 | 99.99th=[42206] 00:16:56.336 bw ( KiB/s): min= 96, max=15160, per=20.20%, avg=5376.00, stdev=6242.74, samples=6 00:16:56.336 iops : min= 24, max= 3790, avg=1344.00, stdev=1560.68, samples=6 00:16:56.336 lat (usec) : 250=31.95%, 500=65.47%, 750=1.35%, 1000=0.02% 00:16:56.336 lat (msec) : 50=1.18% 00:16:56.336 cpu : usr=0.53%, sys=1.56%, ctx=4069, majf=0, minf=1 00:16:56.336 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:56.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 issued rwts: total=4069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.336 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:56.336 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3991411: Wed Nov 27 21:06:52 2024 00:16:56.336 read: IOPS=3312, BW=12.9MiB/s (13.6MB/s)(37.8MiB/2919msec) 00:16:56.336 slat (nsec): min=4237, max=68427, avg=13283.84, stdev=7983.43 00:16:56.336 clat (usec): min=213, max=1932, avg=283.04, stdev=56.56 00:16:56.336 lat (usec): min=219, max=1952, avg=296.33, stdev=57.84 00:16:56.336 clat percentiles (usec): 00:16:56.336 | 1.00th=[ 227], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 245], 00:16:56.336 | 30.00th=[ 253], 40.00th=[ 262], 50.00th=[ 273], 60.00th=[ 277], 00:16:56.336 | 70.00th=[ 289], 80.00th=[ 306], 90.00th=[ 334], 95.00th=[ 379], 00:16:56.336 | 99.00th=[ 506], 99.50th=[ 523], 99.90th=[ 562], 99.95th=[ 824], 00:16:56.336 | 99.99th=[ 1926] 00:16:56.336 bw ( KiB/s): min=11440, max=14464, per=49.45%, avg=13161.60, stdev=1092.61, samples=5 00:16:56.336 iops : min= 2860, max= 3616, avg=3290.40, stdev=273.15, samples=5 00:16:56.336 lat (usec) : 250=26.33%, 500=72.53%, 750=1.07%, 1000=0.04% 00:16:56.336 lat (msec) : 2=0.02% 00:16:56.336 cpu : usr=1.61%, sys=5.55%, ctx=9669, majf=0, minf=1 00:16:56.336 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:56.336 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.336 issued rwts: total=9669,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.336 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:56.336 00:16:56.336 Run status group 0 (all jobs): 00:16:56.336 READ: bw=26.0MiB/s (27.3MB/s), 108KiB/s-12.9MiB/s (110kB/s-13.6MB/s), io=97.4MiB (102MB), run=2919-3747msec 00:16:56.336 00:16:56.336 Disk stats (read/write): 00:16:56.336 nvme0n1: ios=10733/0, merge=0/0, ticks=3138/0, in_queue=3138, util=95.42% 00:16:56.336 nvme0n2: ios=98/0, merge=0/0, ticks=3575/0, in_queue=3575, util=96.12% 00:16:56.336 nvme0n3: ios=4064/0, merge=0/0, ticks=3110/0, in_queue=3110, util=98.82% 00:16:56.336 nvme0n4: ios=9518/0, merge=0/0, ticks=2597/0, in_queue=2597, util=96.75% 00:16:56.595 21:06:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:56.595 21:06:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:56.853 21:06:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:56.853 21:06:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:57.111 21:06:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:57.111 21:06:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:57.370 21:06:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:57.370 21:06:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:57.628 21:06:53 -- target/fio.sh@69 -- # fio_status=0 00:16:57.628 21:06:53 -- target/fio.sh@70 -- # wait 3991223 00:16:57.628 21:06:53 -- target/fio.sh@70 -- # fio_status=4 00:16:57.628 21:06:53 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:57.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:57.886 21:06:53 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:57.886 21:06:53 -- common/autotest_common.sh@1208 -- # local i=0 00:16:57.886 21:06:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:57.886 21:06:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:57.886 21:06:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:57.886 21:06:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:57.886 21:06:53 -- common/autotest_common.sh@1220 -- # return 0 00:16:57.886 21:06:53 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:57.886 21:06:53 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:57.886 nvmf hotplug test: fio failed as expected 00:16:57.886 21:06:53 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:58.144 21:06:54 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:58.144 21:06:54 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:58.144 21:06:54 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:58.144 21:06:54 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:58.144 21:06:54 -- target/fio.sh@91 -- # nvmftestfini 00:16:58.144 21:06:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:58.144 21:06:54 -- nvmf/common.sh@116 -- # sync 00:16:58.144 21:06:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:58.144 21:06:54 -- nvmf/common.sh@119 -- # set +e 00:16:58.144 21:06:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:58.144 21:06:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:58.144 rmmod nvme_tcp 00:16:58.144 rmmod nvme_fabrics 00:16:58.144 rmmod nvme_keyring 00:16:58.144 21:06:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:58.144 21:06:54 -- nvmf/common.sh@123 -- # set -e 00:16:58.144 21:06:54 -- nvmf/common.sh@124 -- # return 0 00:16:58.144 21:06:54 -- nvmf/common.sh@477 -- # '[' -n 3989107 ']' 00:16:58.144 21:06:54 -- nvmf/common.sh@478 -- # killprocess 3989107 00:16:58.144 21:06:54 -- common/autotest_common.sh@936 -- # '[' -z 3989107 ']' 00:16:58.144 21:06:54 -- common/autotest_common.sh@940 -- # kill -0 3989107 00:16:58.144 21:06:54 -- common/autotest_common.sh@941 -- # uname 00:16:58.144 21:06:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:58.144 21:06:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3989107 00:16:58.144 21:06:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:58.144 21:06:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:58.144 21:06:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3989107' 00:16:58.144 killing process with pid 3989107 00:16:58.144 21:06:54 -- common/autotest_common.sh@955 -- # kill 3989107 00:16:58.144 21:06:54 -- common/autotest_common.sh@960 -- # wait 3989107 00:16:58.403 21:06:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:58.403 21:06:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:58.404 21:06:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:58.404 21:06:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:58.404 21:06:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:58.404 21:06:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.404 21:06:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.404 21:06:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.938 21:06:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:00.938 00:17:00.938 real 0m24.705s 00:17:00.938 user 1m25.169s 00:17:00.938 sys 0m7.331s 00:17:00.938 21:06:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:00.938 21:06:56 -- common/autotest_common.sh@10 -- # set +x 00:17:00.938 ************************************ 00:17:00.938 END TEST nvmf_fio_target 00:17:00.938 ************************************ 00:17:00.938 21:06:56 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:00.938 21:06:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:00.938 21:06:56 -- common/autotest_common.sh@10 -- # set +x 00:17:00.938 ************************************ 00:17:00.938 START TEST nvmf_bdevio 00:17:00.938 ************************************ 00:17:00.938 21:06:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:00.938 * Looking for test storage... 00:17:00.938 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:00.938 21:06:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:00.938 21:06:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:00.938 21:06:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:00.938 21:06:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:00.938 21:06:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:00.938 21:06:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:00.938 21:06:56 -- scripts/common.sh@335 -- # IFS=.-: 00:17:00.938 21:06:56 -- scripts/common.sh@335 -- # read -ra ver1 00:17:00.938 21:06:56 -- scripts/common.sh@336 -- # IFS=.-: 00:17:00.938 21:06:56 -- scripts/common.sh@336 -- # read -ra ver2 00:17:00.938 21:06:56 -- scripts/common.sh@337 -- # local 'op=<' 00:17:00.938 21:06:56 -- scripts/common.sh@339 -- # ver1_l=2 00:17:00.938 21:06:56 -- scripts/common.sh@340 -- # ver2_l=1 00:17:00.938 21:06:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:00.938 21:06:56 -- scripts/common.sh@343 -- # case "$op" in 00:17:00.938 21:06:56 -- scripts/common.sh@344 -- # : 1 00:17:00.938 21:06:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:00.938 21:06:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:00.938 21:06:56 -- scripts/common.sh@364 -- # decimal 1 00:17:00.938 21:06:56 -- scripts/common.sh@352 -- # local d=1 00:17:00.938 21:06:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:00.938 21:06:56 -- scripts/common.sh@354 -- # echo 1 00:17:00.938 21:06:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:00.938 21:06:56 -- scripts/common.sh@365 -- # decimal 2 00:17:00.938 21:06:56 -- scripts/common.sh@352 -- # local d=2 00:17:00.938 21:06:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:00.938 21:06:56 -- scripts/common.sh@354 -- # echo 2 00:17:00.938 21:06:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:00.938 21:06:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:00.938 21:06:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:00.938 21:06:56 -- scripts/common.sh@367 -- # return 0 00:17:00.938 21:06:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:00.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.938 --rc genhtml_branch_coverage=1 00:17:00.938 --rc genhtml_function_coverage=1 00:17:00.938 --rc genhtml_legend=1 00:17:00.938 --rc geninfo_all_blocks=1 00:17:00.938 --rc geninfo_unexecuted_blocks=1 00:17:00.938 00:17:00.938 ' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:00.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.938 --rc genhtml_branch_coverage=1 00:17:00.938 --rc genhtml_function_coverage=1 00:17:00.938 --rc genhtml_legend=1 00:17:00.938 --rc geninfo_all_blocks=1 00:17:00.938 --rc geninfo_unexecuted_blocks=1 00:17:00.938 00:17:00.938 ' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:00.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.938 --rc genhtml_branch_coverage=1 00:17:00.938 --rc genhtml_function_coverage=1 00:17:00.938 --rc genhtml_legend=1 00:17:00.938 --rc geninfo_all_blocks=1 00:17:00.938 --rc geninfo_unexecuted_blocks=1 00:17:00.938 00:17:00.938 ' 00:17:00.938 21:06:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:00.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.938 --rc genhtml_branch_coverage=1 00:17:00.938 --rc genhtml_function_coverage=1 00:17:00.938 --rc genhtml_legend=1 00:17:00.938 --rc geninfo_all_blocks=1 00:17:00.938 --rc geninfo_unexecuted_blocks=1 00:17:00.938 00:17:00.938 ' 00:17:00.938 21:06:56 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:00.938 21:06:56 -- nvmf/common.sh@7 -- # uname -s 00:17:00.938 21:06:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:00.938 21:06:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:00.938 21:06:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:00.938 21:06:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:00.938 21:06:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:00.938 21:06:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:00.938 21:06:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:00.938 21:06:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:00.938 21:06:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:00.938 21:06:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:00.938 21:06:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.938 21:06:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.938 21:06:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:00.938 21:06:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:00.938 21:06:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:00.938 21:06:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:00.938 21:06:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:00.938 21:06:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:00.938 21:06:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:00.938 21:06:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.938 21:06:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.938 21:06:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.938 21:06:56 -- paths/export.sh@5 -- # export PATH 00:17:00.939 21:06:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.939 21:06:56 -- nvmf/common.sh@46 -- # : 0 00:17:00.939 21:06:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:00.939 21:06:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:00.939 21:06:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:00.939 21:06:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:00.939 21:06:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:00.939 21:06:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:00.939 21:06:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:00.939 21:06:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:00.939 21:06:56 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:00.939 21:06:56 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:00.939 21:06:56 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:00.939 21:06:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:00.939 21:06:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:00.939 21:06:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:00.939 21:06:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:00.939 21:06:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:00.939 21:06:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:00.939 21:06:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:00.939 21:06:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.939 21:06:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:00.939 21:06:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:00.939 21:06:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:00.939 21:06:56 -- common/autotest_common.sh@10 -- # set +x 00:17:02.841 21:06:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:02.841 21:06:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:02.841 21:06:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:02.841 21:06:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:02.841 21:06:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:02.841 21:06:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:02.841 21:06:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:02.841 21:06:58 -- nvmf/common.sh@294 -- # net_devs=() 00:17:02.841 21:06:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:02.841 21:06:58 -- nvmf/common.sh@295 -- # e810=() 00:17:02.841 21:06:58 -- nvmf/common.sh@295 -- # local -ga e810 00:17:02.841 21:06:58 -- nvmf/common.sh@296 -- # x722=() 00:17:02.841 21:06:58 -- nvmf/common.sh@296 -- # local -ga x722 00:17:02.841 21:06:58 -- nvmf/common.sh@297 -- # mlx=() 00:17:02.841 21:06:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:02.841 21:06:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:02.841 21:06:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:02.841 21:06:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:02.841 21:06:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.841 21:06:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:02.841 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:02.841 21:06:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.841 21:06:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:02.841 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:02.841 21:06:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.841 21:06:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.841 21:06:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.841 21:06:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:02.841 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:02.841 21:06:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.841 21:06:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.841 21:06:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.841 21:06:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.841 21:06:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:02.841 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:02.841 21:06:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.841 21:06:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:02.841 21:06:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:02.841 21:06:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:02.841 21:06:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:02.841 21:06:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:02.841 21:06:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:02.841 21:06:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:02.841 21:06:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:02.841 21:06:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:02.841 21:06:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:02.841 21:06:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:02.841 21:06:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:02.841 21:06:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:02.841 21:06:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:02.841 21:06:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:02.841 21:06:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:02.841 21:06:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:02.841 21:06:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:02.841 21:06:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:02.841 21:06:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:02.841 21:06:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:02.841 21:06:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:02.841 21:06:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:02.841 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:02.841 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:17:02.841 00:17:02.841 --- 10.0.0.2 ping statistics --- 00:17:02.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.841 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:17:02.841 21:06:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:02.841 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:02.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:17:02.841 00:17:02.841 --- 10.0.0.1 ping statistics --- 00:17:02.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.841 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:17:02.841 21:06:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:02.841 21:06:59 -- nvmf/common.sh@410 -- # return 0 00:17:02.841 21:06:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:02.841 21:06:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:02.841 21:06:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:02.841 21:06:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:02.841 21:06:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:02.841 21:06:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:02.841 21:06:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:02.841 21:06:59 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:02.841 21:06:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:02.841 21:06:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:02.841 21:06:59 -- common/autotest_common.sh@10 -- # set +x 00:17:02.841 21:06:59 -- nvmf/common.sh@469 -- # nvmfpid=3994064 00:17:02.841 21:06:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:02.841 21:06:59 -- nvmf/common.sh@470 -- # waitforlisten 3994064 00:17:02.841 21:06:59 -- common/autotest_common.sh@829 -- # '[' -z 3994064 ']' 00:17:02.841 21:06:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:02.841 21:06:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:02.841 21:06:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:02.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:02.841 21:06:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:02.841 21:06:59 -- common/autotest_common.sh@10 -- # set +x 00:17:02.841 [2024-11-27 21:06:59.073662] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.842 [2024-11-27 21:06:59.073735] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:03.099 EAL: No free 2048 kB hugepages reported on node 1 00:17:03.099 [2024-11-27 21:06:59.143204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:03.099 [2024-11-27 21:06:59.265319] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:03.099 [2024-11-27 21:06:59.265474] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:03.099 [2024-11-27 21:06:59.265494] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:03.099 [2024-11-27 21:06:59.265508] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:03.099 [2024-11-27 21:06:59.265755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:03.099 [2024-11-27 21:06:59.265810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:03.099 [2024-11-27 21:06:59.265833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:03.099 [2024-11-27 21:06:59.265836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:04.032 21:07:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:04.032 21:07:00 -- common/autotest_common.sh@862 -- # return 0 00:17:04.032 21:07:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:04.032 21:07:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 21:07:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.032 21:07:00 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:04.032 21:07:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 [2024-11-27 21:07:00.054941] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.032 21:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.032 21:07:00 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:04.032 21:07:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 Malloc0 00:17:04.032 21:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.032 21:07:00 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:04.032 21:07:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 21:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.032 21:07:00 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:04.032 21:07:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 21:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.032 21:07:00 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:04.032 21:07:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.032 21:07:00 -- common/autotest_common.sh@10 -- # set +x 00:17:04.032 [2024-11-27 21:07:00.109129] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:04.032 21:07:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.032 21:07:00 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:04.032 21:07:00 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:04.032 21:07:00 -- nvmf/common.sh@520 -- # config=() 00:17:04.032 21:07:00 -- nvmf/common.sh@520 -- # local subsystem config 00:17:04.032 21:07:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:04.032 21:07:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:04.032 { 00:17:04.032 "params": { 00:17:04.032 "name": "Nvme$subsystem", 00:17:04.032 "trtype": "$TEST_TRANSPORT", 00:17:04.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.032 "adrfam": "ipv4", 00:17:04.032 "trsvcid": "$NVMF_PORT", 00:17:04.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.032 "hdgst": ${hdgst:-false}, 00:17:04.032 "ddgst": ${ddgst:-false} 00:17:04.032 }, 00:17:04.032 "method": "bdev_nvme_attach_controller" 00:17:04.033 } 00:17:04.033 EOF 00:17:04.033 )") 00:17:04.033 21:07:00 -- nvmf/common.sh@542 -- # cat 00:17:04.033 21:07:00 -- nvmf/common.sh@544 -- # jq . 00:17:04.033 21:07:00 -- nvmf/common.sh@545 -- # IFS=, 00:17:04.033 21:07:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:04.033 "params": { 00:17:04.033 "name": "Nvme1", 00:17:04.033 "trtype": "tcp", 00:17:04.033 "traddr": "10.0.0.2", 00:17:04.033 "adrfam": "ipv4", 00:17:04.033 "trsvcid": "4420", 00:17:04.033 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:04.033 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:04.033 "hdgst": false, 00:17:04.033 "ddgst": false 00:17:04.033 }, 00:17:04.033 "method": "bdev_nvme_attach_controller" 00:17:04.033 }' 00:17:04.033 [2024-11-27 21:07:00.152717] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:04.033 [2024-11-27 21:07:00.152783] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3994225 ] 00:17:04.033 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.033 [2024-11-27 21:07:00.214121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:04.291 [2024-11-27 21:07:00.329699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:04.291 [2024-11-27 21:07:00.329751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:04.291 [2024-11-27 21:07:00.329754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.549 [2024-11-27 21:07:00.630369] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:04.549 [2024-11-27 21:07:00.630423] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:04.549 I/O targets: 00:17:04.549 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:04.549 00:17:04.549 00:17:04.549 CUnit - A unit testing framework for C - Version 2.1-3 00:17:04.549 http://cunit.sourceforge.net/ 00:17:04.549 00:17:04.549 00:17:04.549 Suite: bdevio tests on: Nvme1n1 00:17:04.549 Test: blockdev write read block ...passed 00:17:04.549 Test: blockdev write zeroes read block ...passed 00:17:04.549 Test: blockdev write zeroes read no split ...passed 00:17:04.549 Test: blockdev write zeroes read split ...passed 00:17:04.805 Test: blockdev write zeroes read split partial ...passed 00:17:04.805 Test: blockdev reset ...[2024-11-27 21:07:00.829374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:04.805 [2024-11-27 21:07:00.829487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf3bf20 (9): Bad file descriptor 00:17:04.805 [2024-11-27 21:07:00.891414] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:04.805 passed 00:17:04.805 Test: blockdev write read 8 blocks ...passed 00:17:04.805 Test: blockdev write read size > 128k ...passed 00:17:04.805 Test: blockdev write read invalid size ...passed 00:17:04.805 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:04.805 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:04.805 Test: blockdev write read max offset ...passed 00:17:04.805 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:05.063 Test: blockdev writev readv 8 blocks ...passed 00:17:05.063 Test: blockdev writev readv 30 x 1block ...passed 00:17:05.063 Test: blockdev writev readv block ...passed 00:17:05.063 Test: blockdev writev readv size > 128k ...passed 00:17:05.063 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:05.063 Test: blockdev comparev and writev ...[2024-11-27 21:07:01.103028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.103089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.103453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.103499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.103879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.103922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.103938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.104276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.104299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.104320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.063 [2024-11-27 21:07:01.104335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:05.063 passed 00:17:05.063 Test: blockdev nvme passthru rw ...passed 00:17:05.063 Test: blockdev nvme passthru vendor specific ...[2024-11-27 21:07:01.186801] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.063 [2024-11-27 21:07:01.186826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.186972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.063 [2024-11-27 21:07:01.186994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.187139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.063 [2024-11-27 21:07:01.187160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:05.063 [2024-11-27 21:07:01.187305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.063 [2024-11-27 21:07:01.187328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:05.063 passed 00:17:05.063 Test: blockdev nvme admin passthru ...passed 00:17:05.063 Test: blockdev copy ...passed 00:17:05.063 00:17:05.063 Run Summary: Type Total Ran Passed Failed Inactive 00:17:05.063 suites 1 1 n/a 0 0 00:17:05.063 tests 23 23 23 0 0 00:17:05.063 asserts 152 152 152 0 n/a 00:17:05.063 00:17:05.063 Elapsed time = 1.221 seconds 00:17:05.322 21:07:01 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:05.322 21:07:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.322 21:07:01 -- common/autotest_common.sh@10 -- # set +x 00:17:05.322 21:07:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.322 21:07:01 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:05.322 21:07:01 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:05.322 21:07:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:05.322 21:07:01 -- nvmf/common.sh@116 -- # sync 00:17:05.322 21:07:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:05.322 21:07:01 -- nvmf/common.sh@119 -- # set +e 00:17:05.322 21:07:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:05.322 21:07:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:05.322 rmmod nvme_tcp 00:17:05.322 rmmod nvme_fabrics 00:17:05.322 rmmod nvme_keyring 00:17:05.322 21:07:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:05.322 21:07:01 -- nvmf/common.sh@123 -- # set -e 00:17:05.322 21:07:01 -- nvmf/common.sh@124 -- # return 0 00:17:05.322 21:07:01 -- nvmf/common.sh@477 -- # '[' -n 3994064 ']' 00:17:05.322 21:07:01 -- nvmf/common.sh@478 -- # killprocess 3994064 00:17:05.322 21:07:01 -- common/autotest_common.sh@936 -- # '[' -z 3994064 ']' 00:17:05.322 21:07:01 -- common/autotest_common.sh@940 -- # kill -0 3994064 00:17:05.322 21:07:01 -- common/autotest_common.sh@941 -- # uname 00:17:05.322 21:07:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:05.322 21:07:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3994064 00:17:05.593 21:07:01 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:05.593 21:07:01 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:05.593 21:07:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3994064' 00:17:05.593 killing process with pid 3994064 00:17:05.593 21:07:01 -- common/autotest_common.sh@955 -- # kill 3994064 00:17:05.593 21:07:01 -- common/autotest_common.sh@960 -- # wait 3994064 00:17:05.852 21:07:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:05.852 21:07:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:05.852 21:07:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:05.852 21:07:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:05.852 21:07:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:05.852 21:07:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.852 21:07:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.852 21:07:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:07.756 21:07:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:07.756 00:17:07.756 real 0m7.242s 00:17:07.756 user 0m13.851s 00:17:07.756 sys 0m2.140s 00:17:07.756 21:07:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:07.756 21:07:03 -- common/autotest_common.sh@10 -- # set +x 00:17:07.756 ************************************ 00:17:07.756 END TEST nvmf_bdevio 00:17:07.756 ************************************ 00:17:07.756 21:07:03 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:07.756 21:07:03 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:07.756 21:07:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:07.756 21:07:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:07.756 21:07:03 -- common/autotest_common.sh@10 -- # set +x 00:17:07.756 ************************************ 00:17:07.756 START TEST nvmf_bdevio_no_huge 00:17:07.756 ************************************ 00:17:07.756 21:07:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:08.015 * Looking for test storage... 00:17:08.015 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:08.015 21:07:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:08.015 21:07:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:08.015 21:07:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:08.015 21:07:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:08.015 21:07:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:08.015 21:07:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:08.015 21:07:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:08.015 21:07:04 -- scripts/common.sh@335 -- # IFS=.-: 00:17:08.015 21:07:04 -- scripts/common.sh@335 -- # read -ra ver1 00:17:08.015 21:07:04 -- scripts/common.sh@336 -- # IFS=.-: 00:17:08.015 21:07:04 -- scripts/common.sh@336 -- # read -ra ver2 00:17:08.015 21:07:04 -- scripts/common.sh@337 -- # local 'op=<' 00:17:08.015 21:07:04 -- scripts/common.sh@339 -- # ver1_l=2 00:17:08.015 21:07:04 -- scripts/common.sh@340 -- # ver2_l=1 00:17:08.015 21:07:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:08.015 21:07:04 -- scripts/common.sh@343 -- # case "$op" in 00:17:08.015 21:07:04 -- scripts/common.sh@344 -- # : 1 00:17:08.015 21:07:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:08.015 21:07:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:08.015 21:07:04 -- scripts/common.sh@364 -- # decimal 1 00:17:08.015 21:07:04 -- scripts/common.sh@352 -- # local d=1 00:17:08.015 21:07:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:08.015 21:07:04 -- scripts/common.sh@354 -- # echo 1 00:17:08.015 21:07:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:08.015 21:07:04 -- scripts/common.sh@365 -- # decimal 2 00:17:08.015 21:07:04 -- scripts/common.sh@352 -- # local d=2 00:17:08.015 21:07:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:08.015 21:07:04 -- scripts/common.sh@354 -- # echo 2 00:17:08.015 21:07:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:08.015 21:07:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:08.015 21:07:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:08.015 21:07:04 -- scripts/common.sh@367 -- # return 0 00:17:08.015 21:07:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:08.015 21:07:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:08.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.015 --rc genhtml_branch_coverage=1 00:17:08.015 --rc genhtml_function_coverage=1 00:17:08.015 --rc genhtml_legend=1 00:17:08.015 --rc geninfo_all_blocks=1 00:17:08.015 --rc geninfo_unexecuted_blocks=1 00:17:08.015 00:17:08.015 ' 00:17:08.015 21:07:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:08.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.015 --rc genhtml_branch_coverage=1 00:17:08.015 --rc genhtml_function_coverage=1 00:17:08.015 --rc genhtml_legend=1 00:17:08.015 --rc geninfo_all_blocks=1 00:17:08.015 --rc geninfo_unexecuted_blocks=1 00:17:08.015 00:17:08.015 ' 00:17:08.015 21:07:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:08.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.015 --rc genhtml_branch_coverage=1 00:17:08.015 --rc genhtml_function_coverage=1 00:17:08.015 --rc genhtml_legend=1 00:17:08.015 --rc geninfo_all_blocks=1 00:17:08.015 --rc geninfo_unexecuted_blocks=1 00:17:08.015 00:17:08.015 ' 00:17:08.015 21:07:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:08.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.015 --rc genhtml_branch_coverage=1 00:17:08.015 --rc genhtml_function_coverage=1 00:17:08.015 --rc genhtml_legend=1 00:17:08.015 --rc geninfo_all_blocks=1 00:17:08.015 --rc geninfo_unexecuted_blocks=1 00:17:08.015 00:17:08.015 ' 00:17:08.015 21:07:04 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:08.015 21:07:04 -- nvmf/common.sh@7 -- # uname -s 00:17:08.015 21:07:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:08.015 21:07:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:08.015 21:07:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:08.015 21:07:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:08.015 21:07:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:08.015 21:07:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:08.015 21:07:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:08.015 21:07:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:08.015 21:07:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:08.015 21:07:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:08.015 21:07:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.015 21:07:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.015 21:07:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:08.015 21:07:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:08.015 21:07:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:08.015 21:07:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:08.015 21:07:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:08.015 21:07:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:08.015 21:07:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:08.015 21:07:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.015 21:07:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.015 21:07:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.015 21:07:04 -- paths/export.sh@5 -- # export PATH 00:17:08.015 21:07:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.015 21:07:04 -- nvmf/common.sh@46 -- # : 0 00:17:08.015 21:07:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:08.015 21:07:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:08.015 21:07:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:08.015 21:07:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:08.015 21:07:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:08.015 21:07:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:08.015 21:07:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:08.015 21:07:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:08.015 21:07:04 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:08.015 21:07:04 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:08.015 21:07:04 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:08.015 21:07:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:08.015 21:07:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:08.015 21:07:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:08.015 21:07:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:08.015 21:07:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:08.015 21:07:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.015 21:07:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.015 21:07:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.015 21:07:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:08.015 21:07:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:08.015 21:07:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:08.015 21:07:04 -- common/autotest_common.sh@10 -- # set +x 00:17:10.546 21:07:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:10.546 21:07:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:10.546 21:07:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:10.546 21:07:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:10.546 21:07:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:10.546 21:07:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:10.546 21:07:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:10.546 21:07:06 -- nvmf/common.sh@294 -- # net_devs=() 00:17:10.546 21:07:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:10.546 21:07:06 -- nvmf/common.sh@295 -- # e810=() 00:17:10.546 21:07:06 -- nvmf/common.sh@295 -- # local -ga e810 00:17:10.546 21:07:06 -- nvmf/common.sh@296 -- # x722=() 00:17:10.546 21:07:06 -- nvmf/common.sh@296 -- # local -ga x722 00:17:10.546 21:07:06 -- nvmf/common.sh@297 -- # mlx=() 00:17:10.546 21:07:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:10.546 21:07:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:10.546 21:07:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:10.546 21:07:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:10.546 21:07:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:10.546 21:07:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:10.546 21:07:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:10.546 21:07:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:10.546 21:07:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.546 21:07:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:10.547 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:10.547 21:07:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.547 21:07:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:10.547 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:10.547 21:07:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:10.547 21:07:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.547 21:07:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.547 21:07:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.547 21:07:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.547 21:07:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:10.547 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:10.547 21:07:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.547 21:07:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.547 21:07:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.547 21:07:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.547 21:07:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.547 21:07:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:10.547 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:10.547 21:07:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.547 21:07:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:10.547 21:07:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:10.547 21:07:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:10.547 21:07:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:10.547 21:07:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:10.547 21:07:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:10.547 21:07:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:10.547 21:07:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:10.547 21:07:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:10.547 21:07:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:10.547 21:07:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:10.547 21:07:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:10.547 21:07:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:10.547 21:07:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:10.547 21:07:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:10.547 21:07:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:10.547 21:07:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:10.547 21:07:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:10.547 21:07:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:10.547 21:07:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:10.547 21:07:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:10.547 21:07:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:10.547 21:07:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:10.547 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:10.547 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:17:10.547 00:17:10.547 --- 10.0.0.2 ping statistics --- 00:17:10.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.547 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:17:10.547 21:07:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:10.547 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:10.547 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:17:10.547 00:17:10.547 --- 10.0.0.1 ping statistics --- 00:17:10.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.547 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:17:10.547 21:07:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:10.547 21:07:06 -- nvmf/common.sh@410 -- # return 0 00:17:10.547 21:07:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:10.547 21:07:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:10.547 21:07:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:10.547 21:07:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:10.547 21:07:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:10.547 21:07:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:10.547 21:07:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:10.547 21:07:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:10.547 21:07:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:10.547 21:07:06 -- common/autotest_common.sh@10 -- # set +x 00:17:10.547 21:07:06 -- nvmf/common.sh@469 -- # nvmfpid=3996333 00:17:10.547 21:07:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:10.547 21:07:06 -- nvmf/common.sh@470 -- # waitforlisten 3996333 00:17:10.547 21:07:06 -- common/autotest_common.sh@829 -- # '[' -z 3996333 ']' 00:17:10.547 21:07:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:10.547 21:07:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:10.547 21:07:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:10.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:10.547 21:07:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:10.547 21:07:06 -- common/autotest_common.sh@10 -- # set +x 00:17:10.547 [2024-11-27 21:07:06.485653] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:10.547 [2024-11-27 21:07:06.485730] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:10.547 [2024-11-27 21:07:06.563396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:10.547 [2024-11-27 21:07:06.684773] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:10.547 [2024-11-27 21:07:06.684939] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:10.547 [2024-11-27 21:07:06.684959] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:10.547 [2024-11-27 21:07:06.684973] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:10.547 [2024-11-27 21:07:06.685069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:10.547 [2024-11-27 21:07:06.685188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:10.547 [2024-11-27 21:07:06.685143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:10.547 [2024-11-27 21:07:06.685192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:11.481 21:07:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:11.481 21:07:07 -- common/autotest_common.sh@862 -- # return 0 00:17:11.481 21:07:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:11.481 21:07:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 21:07:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:11.481 21:07:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:11.481 21:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 [2024-11-27 21:07:07.481821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:11.481 21:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.481 21:07:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:11.481 21:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 Malloc0 00:17:11.481 21:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.481 21:07:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:11.481 21:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 21:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.481 21:07:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:11.481 21:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 21:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.481 21:07:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:11.481 21:07:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.481 21:07:07 -- common/autotest_common.sh@10 -- # set +x 00:17:11.481 [2024-11-27 21:07:07.519928] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:11.481 21:07:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.481 21:07:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:11.481 21:07:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:11.481 21:07:07 -- nvmf/common.sh@520 -- # config=() 00:17:11.481 21:07:07 -- nvmf/common.sh@520 -- # local subsystem config 00:17:11.481 21:07:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:11.481 21:07:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:11.481 { 00:17:11.481 "params": { 00:17:11.481 "name": "Nvme$subsystem", 00:17:11.481 "trtype": "$TEST_TRANSPORT", 00:17:11.481 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.481 "adrfam": "ipv4", 00:17:11.481 "trsvcid": "$NVMF_PORT", 00:17:11.481 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.481 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.481 "hdgst": ${hdgst:-false}, 00:17:11.481 "ddgst": ${ddgst:-false} 00:17:11.481 }, 00:17:11.481 "method": "bdev_nvme_attach_controller" 00:17:11.481 } 00:17:11.481 EOF 00:17:11.481 )") 00:17:11.481 21:07:07 -- nvmf/common.sh@542 -- # cat 00:17:11.481 21:07:07 -- nvmf/common.sh@544 -- # jq . 00:17:11.481 21:07:07 -- nvmf/common.sh@545 -- # IFS=, 00:17:11.481 21:07:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:11.481 "params": { 00:17:11.481 "name": "Nvme1", 00:17:11.481 "trtype": "tcp", 00:17:11.481 "traddr": "10.0.0.2", 00:17:11.481 "adrfam": "ipv4", 00:17:11.481 "trsvcid": "4420", 00:17:11.481 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.481 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:11.481 "hdgst": false, 00:17:11.481 "ddgst": false 00:17:11.481 }, 00:17:11.481 "method": "bdev_nvme_attach_controller" 00:17:11.481 }' 00:17:11.481 [2024-11-27 21:07:07.563300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:11.481 [2024-11-27 21:07:07.563379] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3996483 ] 00:17:11.481 [2024-11-27 21:07:07.631701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:11.738 [2024-11-27 21:07:07.745304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:11.738 [2024-11-27 21:07:07.745356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:11.738 [2024-11-27 21:07:07.745359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:11.995 [2024-11-27 21:07:08.023957] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:11.995 [2024-11-27 21:07:08.024012] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:11.995 I/O targets: 00:17:11.995 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:11.995 00:17:11.995 00:17:11.995 CUnit - A unit testing framework for C - Version 2.1-3 00:17:11.995 http://cunit.sourceforge.net/ 00:17:11.995 00:17:11.995 00:17:11.995 Suite: bdevio tests on: Nvme1n1 00:17:11.995 Test: blockdev write read block ...passed 00:17:11.995 Test: blockdev write zeroes read block ...passed 00:17:11.995 Test: blockdev write zeroes read no split ...passed 00:17:11.995 Test: blockdev write zeroes read split ...passed 00:17:11.995 Test: blockdev write zeroes read split partial ...passed 00:17:11.995 Test: blockdev reset ...[2024-11-27 21:07:08.228935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:11.995 [2024-11-27 21:07:08.229049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18e77d0 (9): Bad file descriptor 00:17:12.253 [2024-11-27 21:07:08.244551] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:12.253 passed 00:17:12.253 Test: blockdev write read 8 blocks ...passed 00:17:12.253 Test: blockdev write read size > 128k ...passed 00:17:12.253 Test: blockdev write read invalid size ...passed 00:17:12.253 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:12.253 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:12.253 Test: blockdev write read max offset ...passed 00:17:12.253 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:12.253 Test: blockdev writev readv 8 blocks ...passed 00:17:12.253 Test: blockdev writev readv 30 x 1block ...passed 00:17:12.510 Test: blockdev writev readv block ...passed 00:17:12.510 Test: blockdev writev readv size > 128k ...passed 00:17:12.510 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:12.510 Test: blockdev comparev and writev ...[2024-11-27 21:07:08.502126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.502186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.502533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.502581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.502939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.502983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.502999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.503329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.503352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.503379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:12.510 [2024-11-27 21:07:08.503397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:12.510 passed 00:17:12.510 Test: blockdev nvme passthru rw ...passed 00:17:12.510 Test: blockdev nvme passthru vendor specific ...[2024-11-27 21:07:08.586810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:12.510 [2024-11-27 21:07:08.586837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.586989] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:12.510 [2024-11-27 21:07:08.587011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.587165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:12.510 [2024-11-27 21:07:08.587186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:12.510 [2024-11-27 21:07:08.587334] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:12.510 [2024-11-27 21:07:08.587356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:12.510 passed 00:17:12.510 Test: blockdev nvme admin passthru ...passed 00:17:12.510 Test: blockdev copy ...passed 00:17:12.510 00:17:12.510 Run Summary: Type Total Ran Passed Failed Inactive 00:17:12.510 suites 1 1 n/a 0 0 00:17:12.510 tests 23 23 23 0 0 00:17:12.510 asserts 152 152 152 0 n/a 00:17:12.510 00:17:12.510 Elapsed time = 1.233 seconds 00:17:13.076 21:07:09 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:13.076 21:07:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.076 21:07:09 -- common/autotest_common.sh@10 -- # set +x 00:17:13.076 21:07:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.076 21:07:09 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:13.076 21:07:09 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:13.076 21:07:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:13.076 21:07:09 -- nvmf/common.sh@116 -- # sync 00:17:13.076 21:07:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:13.076 21:07:09 -- nvmf/common.sh@119 -- # set +e 00:17:13.076 21:07:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:13.076 21:07:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:13.076 rmmod nvme_tcp 00:17:13.076 rmmod nvme_fabrics 00:17:13.076 rmmod nvme_keyring 00:17:13.076 21:07:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:13.076 21:07:09 -- nvmf/common.sh@123 -- # set -e 00:17:13.076 21:07:09 -- nvmf/common.sh@124 -- # return 0 00:17:13.076 21:07:09 -- nvmf/common.sh@477 -- # '[' -n 3996333 ']' 00:17:13.076 21:07:09 -- nvmf/common.sh@478 -- # killprocess 3996333 00:17:13.076 21:07:09 -- common/autotest_common.sh@936 -- # '[' -z 3996333 ']' 00:17:13.076 21:07:09 -- common/autotest_common.sh@940 -- # kill -0 3996333 00:17:13.076 21:07:09 -- common/autotest_common.sh@941 -- # uname 00:17:13.076 21:07:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:13.076 21:07:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3996333 00:17:13.076 21:07:09 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:13.076 21:07:09 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:13.076 21:07:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3996333' 00:17:13.076 killing process with pid 3996333 00:17:13.076 21:07:09 -- common/autotest_common.sh@955 -- # kill 3996333 00:17:13.076 21:07:09 -- common/autotest_common.sh@960 -- # wait 3996333 00:17:13.334 21:07:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:13.334 21:07:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:13.334 21:07:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:13.593 21:07:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:13.593 21:07:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:13.593 21:07:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.593 21:07:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.593 21:07:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:15.496 21:07:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:15.496 00:17:15.496 real 0m7.655s 00:17:15.496 user 0m14.569s 00:17:15.496 sys 0m2.699s 00:17:15.496 21:07:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:15.496 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:17:15.496 ************************************ 00:17:15.496 END TEST nvmf_bdevio_no_huge 00:17:15.496 ************************************ 00:17:15.496 21:07:11 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:15.496 21:07:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:15.496 21:07:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:15.496 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:17:15.496 ************************************ 00:17:15.496 START TEST nvmf_tls 00:17:15.496 ************************************ 00:17:15.496 21:07:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:15.496 * Looking for test storage... 00:17:15.496 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:15.496 21:07:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:15.496 21:07:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:15.496 21:07:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:15.754 21:07:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:15.754 21:07:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:15.754 21:07:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:15.754 21:07:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:15.754 21:07:11 -- scripts/common.sh@335 -- # IFS=.-: 00:17:15.754 21:07:11 -- scripts/common.sh@335 -- # read -ra ver1 00:17:15.754 21:07:11 -- scripts/common.sh@336 -- # IFS=.-: 00:17:15.754 21:07:11 -- scripts/common.sh@336 -- # read -ra ver2 00:17:15.754 21:07:11 -- scripts/common.sh@337 -- # local 'op=<' 00:17:15.754 21:07:11 -- scripts/common.sh@339 -- # ver1_l=2 00:17:15.754 21:07:11 -- scripts/common.sh@340 -- # ver2_l=1 00:17:15.754 21:07:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:15.754 21:07:11 -- scripts/common.sh@343 -- # case "$op" in 00:17:15.754 21:07:11 -- scripts/common.sh@344 -- # : 1 00:17:15.754 21:07:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:15.754 21:07:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:15.754 21:07:11 -- scripts/common.sh@364 -- # decimal 1 00:17:15.754 21:07:11 -- scripts/common.sh@352 -- # local d=1 00:17:15.754 21:07:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:15.754 21:07:11 -- scripts/common.sh@354 -- # echo 1 00:17:15.754 21:07:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:15.754 21:07:11 -- scripts/common.sh@365 -- # decimal 2 00:17:15.754 21:07:11 -- scripts/common.sh@352 -- # local d=2 00:17:15.754 21:07:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:15.754 21:07:11 -- scripts/common.sh@354 -- # echo 2 00:17:15.754 21:07:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:15.754 21:07:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:15.754 21:07:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:15.754 21:07:11 -- scripts/common.sh@367 -- # return 0 00:17:15.754 21:07:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:15.754 21:07:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:15.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:15.754 --rc genhtml_branch_coverage=1 00:17:15.754 --rc genhtml_function_coverage=1 00:17:15.754 --rc genhtml_legend=1 00:17:15.754 --rc geninfo_all_blocks=1 00:17:15.754 --rc geninfo_unexecuted_blocks=1 00:17:15.754 00:17:15.754 ' 00:17:15.754 21:07:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:15.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:15.754 --rc genhtml_branch_coverage=1 00:17:15.754 --rc genhtml_function_coverage=1 00:17:15.754 --rc genhtml_legend=1 00:17:15.754 --rc geninfo_all_blocks=1 00:17:15.754 --rc geninfo_unexecuted_blocks=1 00:17:15.754 00:17:15.754 ' 00:17:15.754 21:07:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:15.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:15.754 --rc genhtml_branch_coverage=1 00:17:15.754 --rc genhtml_function_coverage=1 00:17:15.754 --rc genhtml_legend=1 00:17:15.754 --rc geninfo_all_blocks=1 00:17:15.754 --rc geninfo_unexecuted_blocks=1 00:17:15.754 00:17:15.754 ' 00:17:15.754 21:07:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:15.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:15.754 --rc genhtml_branch_coverage=1 00:17:15.754 --rc genhtml_function_coverage=1 00:17:15.754 --rc genhtml_legend=1 00:17:15.754 --rc geninfo_all_blocks=1 00:17:15.754 --rc geninfo_unexecuted_blocks=1 00:17:15.754 00:17:15.754 ' 00:17:15.754 21:07:11 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:15.754 21:07:11 -- nvmf/common.sh@7 -- # uname -s 00:17:15.754 21:07:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:15.754 21:07:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:15.754 21:07:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:15.754 21:07:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:15.754 21:07:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:15.754 21:07:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:15.754 21:07:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:15.754 21:07:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:15.754 21:07:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:15.754 21:07:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:15.754 21:07:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:15.754 21:07:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:15.754 21:07:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:15.754 21:07:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:15.754 21:07:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:15.754 21:07:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:15.754 21:07:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:15.754 21:07:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:15.754 21:07:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:15.755 21:07:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:15.755 21:07:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:15.755 21:07:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:15.755 21:07:11 -- paths/export.sh@5 -- # export PATH 00:17:15.755 21:07:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:15.755 21:07:11 -- nvmf/common.sh@46 -- # : 0 00:17:15.755 21:07:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:15.755 21:07:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:15.755 21:07:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:15.755 21:07:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:15.755 21:07:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:15.755 21:07:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:15.755 21:07:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:15.755 21:07:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:15.755 21:07:11 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:15.755 21:07:11 -- target/tls.sh@71 -- # nvmftestinit 00:17:15.755 21:07:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:15.755 21:07:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:15.755 21:07:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:15.755 21:07:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:15.755 21:07:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:15.755 21:07:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:15.755 21:07:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:15.755 21:07:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:15.755 21:07:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:15.755 21:07:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:15.755 21:07:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:15.755 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:17:17.656 21:07:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:17.656 21:07:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:17.656 21:07:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:17.656 21:07:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:17.656 21:07:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:17.656 21:07:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:17.656 21:07:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:17.656 21:07:13 -- nvmf/common.sh@294 -- # net_devs=() 00:17:17.656 21:07:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:17.656 21:07:13 -- nvmf/common.sh@295 -- # e810=() 00:17:17.656 21:07:13 -- nvmf/common.sh@295 -- # local -ga e810 00:17:17.656 21:07:13 -- nvmf/common.sh@296 -- # x722=() 00:17:17.656 21:07:13 -- nvmf/common.sh@296 -- # local -ga x722 00:17:17.656 21:07:13 -- nvmf/common.sh@297 -- # mlx=() 00:17:17.656 21:07:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:17.656 21:07:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:17.656 21:07:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:17.656 21:07:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:17.656 21:07:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:17.656 21:07:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:17.656 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:17.656 21:07:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:17.656 21:07:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:17.656 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:17.656 21:07:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:17.656 21:07:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:17.656 21:07:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:17.656 21:07:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:17.656 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:17.656 21:07:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:17.656 21:07:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:17.656 21:07:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:17.656 21:07:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:17.656 21:07:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:17.656 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:17.656 21:07:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:17.656 21:07:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:17.656 21:07:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:17.656 21:07:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:17.656 21:07:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:17.656 21:07:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:17.656 21:07:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:17.656 21:07:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:17.656 21:07:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:17.656 21:07:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:17.656 21:07:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:17.656 21:07:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:17.656 21:07:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:17.656 21:07:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:17.656 21:07:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:17.656 21:07:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:17.656 21:07:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:17.915 21:07:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:17.915 21:07:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:17.915 21:07:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:17.915 21:07:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:17.915 21:07:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:17.915 21:07:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:17.915 21:07:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:17.915 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:17.915 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.412 ms 00:17:17.915 00:17:17.915 --- 10.0.0.2 ping statistics --- 00:17:17.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.915 rtt min/avg/max/mdev = 0.412/0.412/0.412/0.000 ms 00:17:17.915 21:07:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:17.915 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:17.915 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:17:17.915 00:17:17.915 --- 10.0.0.1 ping statistics --- 00:17:17.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.915 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:17:17.915 21:07:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:17.915 21:07:13 -- nvmf/common.sh@410 -- # return 0 00:17:17.915 21:07:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:17.915 21:07:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:17.915 21:07:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:17.915 21:07:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:17.915 21:07:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:17.915 21:07:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:17.915 21:07:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:17.915 21:07:13 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:17.916 21:07:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:17.916 21:07:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:17.916 21:07:13 -- common/autotest_common.sh@10 -- # set +x 00:17:17.916 21:07:14 -- nvmf/common.sh@469 -- # nvmfpid=3998699 00:17:17.916 21:07:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:17.916 21:07:14 -- nvmf/common.sh@470 -- # waitforlisten 3998699 00:17:17.916 21:07:14 -- common/autotest_common.sh@829 -- # '[' -z 3998699 ']' 00:17:17.916 21:07:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:17.916 21:07:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:17.916 21:07:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:17.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:17.916 21:07:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:17.916 21:07:14 -- common/autotest_common.sh@10 -- # set +x 00:17:17.916 [2024-11-27 21:07:14.042233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:17.916 [2024-11-27 21:07:14.042327] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:17.916 EAL: No free 2048 kB hugepages reported on node 1 00:17:17.916 [2024-11-27 21:07:14.109286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.175 [2024-11-27 21:07:14.220599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:18.175 [2024-11-27 21:07:14.220776] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.175 [2024-11-27 21:07:14.220795] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.175 [2024-11-27 21:07:14.220808] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.175 [2024-11-27 21:07:14.220853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:18.175 21:07:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:18.175 21:07:14 -- common/autotest_common.sh@862 -- # return 0 00:17:18.175 21:07:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:18.175 21:07:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:18.175 21:07:14 -- common/autotest_common.sh@10 -- # set +x 00:17:18.175 21:07:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:18.175 21:07:14 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:18.175 21:07:14 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:18.433 true 00:17:18.433 21:07:14 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:18.433 21:07:14 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:18.691 21:07:14 -- target/tls.sh@82 -- # version=0 00:17:18.691 21:07:14 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:18.691 21:07:14 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:19.280 21:07:15 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:19.280 21:07:15 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:19.280 21:07:15 -- target/tls.sh@90 -- # version=13 00:17:19.280 21:07:15 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:19.280 21:07:15 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:19.539 21:07:15 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:19.539 21:07:15 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:19.796 21:07:16 -- target/tls.sh@98 -- # version=7 00:17:19.797 21:07:16 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:19.797 21:07:16 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:19.797 21:07:16 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:20.054 21:07:16 -- target/tls.sh@105 -- # ktls=false 00:17:20.054 21:07:16 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:20.054 21:07:16 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:20.312 21:07:16 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:20.312 21:07:16 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:20.570 21:07:16 -- target/tls.sh@113 -- # ktls=true 00:17:20.570 21:07:16 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:20.570 21:07:16 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:20.828 21:07:17 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:20.828 21:07:17 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:21.086 21:07:17 -- target/tls.sh@121 -- # ktls=false 00:17:21.086 21:07:17 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:21.086 21:07:17 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:21.086 21:07:17 -- target/tls.sh@49 -- # local key hash crc 00:17:21.086 21:07:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:21.086 21:07:17 -- target/tls.sh@51 -- # hash=01 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # gzip -1 -c 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # tail -c8 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # head -c 4 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # crc='p$H�' 00:17:21.086 21:07:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:21.086 21:07:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:21.086 21:07:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:21.086 21:07:17 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:21.086 21:07:17 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:21.086 21:07:17 -- target/tls.sh@49 -- # local key hash crc 00:17:21.086 21:07:17 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:21.086 21:07:17 -- target/tls.sh@51 -- # hash=01 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # gzip -1 -c 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # tail -c8 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # head -c 4 00:17:21.086 21:07:17 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:21.343 21:07:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:21.343 21:07:17 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:21.343 21:07:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:21.343 21:07:17 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:21.343 21:07:17 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.343 21:07:17 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:21.343 21:07:17 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:21.343 21:07:17 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:21.343 21:07:17 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.343 21:07:17 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:21.343 21:07:17 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:21.343 21:07:17 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:21.909 21:07:17 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.909 21:07:17 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.909 21:07:17 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:22.167 [2024-11-27 21:07:18.181423] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:22.167 21:07:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:22.424 21:07:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:22.682 [2024-11-27 21:07:18.722892] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:22.682 [2024-11-27 21:07:18.723130] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:22.682 21:07:18 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:22.941 malloc0 00:17:22.941 21:07:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:23.198 21:07:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.455 21:07:19 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.455 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.417 Initializing NVMe Controllers 00:17:33.417 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:33.417 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:33.417 Initialization complete. Launching workers. 00:17:33.417 ======================================================== 00:17:33.417 Latency(us) 00:17:33.417 Device Information : IOPS MiB/s Average min max 00:17:33.417 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7846.09 30.65 8159.44 1226.87 9289.67 00:17:33.417 ======================================================== 00:17:33.417 Total : 7846.09 30.65 8159.44 1226.87 9289.67 00:17:33.417 00:17:33.417 21:07:29 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:33.417 21:07:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:33.417 21:07:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:33.417 21:07:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:33.417 21:07:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:33.417 21:07:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:33.417 21:07:29 -- target/tls.sh@28 -- # bdevperf_pid=4000669 00:17:33.417 21:07:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:33.417 21:07:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:33.417 21:07:29 -- target/tls.sh@31 -- # waitforlisten 4000669 /var/tmp/bdevperf.sock 00:17:33.418 21:07:29 -- common/autotest_common.sh@829 -- # '[' -z 4000669 ']' 00:17:33.418 21:07:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.418 21:07:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.418 21:07:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.418 21:07:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.418 21:07:29 -- common/autotest_common.sh@10 -- # set +x 00:17:33.676 [2024-11-27 21:07:29.684967] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.676 [2024-11-27 21:07:29.685047] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4000669 ] 00:17:33.676 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.676 [2024-11-27 21:07:29.740915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.676 [2024-11-27 21:07:29.843679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:34.610 21:07:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.610 21:07:30 -- common/autotest_common.sh@862 -- # return 0 00:17:34.610 21:07:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:34.868 [2024-11-27 21:07:30.893224] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:34.868 TLSTESTn1 00:17:34.868 21:07:30 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:34.868 Running I/O for 10 seconds... 00:17:47.062 00:17:47.062 Latency(us) 00:17:47.062 [2024-11-27T20:07:43.303Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.062 [2024-11-27T20:07:43.303Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:47.062 Verification LBA range: start 0x0 length 0x2000 00:17:47.062 TLSTESTn1 : 10.04 2944.01 11.50 0.00 0.00 43392.63 8932.31 90488.23 00:17:47.062 [2024-11-27T20:07:43.303Z] =================================================================================================================== 00:17:47.062 [2024-11-27T20:07:43.303Z] Total : 2944.01 11.50 0.00 0.00 43392.63 8932.31 90488.23 00:17:47.062 0 00:17:47.062 21:07:41 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:47.062 21:07:41 -- target/tls.sh@45 -- # killprocess 4000669 00:17:47.062 21:07:41 -- common/autotest_common.sh@936 -- # '[' -z 4000669 ']' 00:17:47.062 21:07:41 -- common/autotest_common.sh@940 -- # kill -0 4000669 00:17:47.062 21:07:41 -- common/autotest_common.sh@941 -- # uname 00:17:47.062 21:07:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.062 21:07:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4000669 00:17:47.062 21:07:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:47.062 21:07:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:47.062 21:07:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4000669' 00:17:47.062 killing process with pid 4000669 00:17:47.062 21:07:41 -- common/autotest_common.sh@955 -- # kill 4000669 00:17:47.062 Received shutdown signal, test time was about 10.000000 seconds 00:17:47.062 00:17:47.062 Latency(us) 00:17:47.062 [2024-11-27T20:07:43.303Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.062 [2024-11-27T20:07:43.303Z] =================================================================================================================== 00:17:47.062 [2024-11-27T20:07:43.303Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:47.062 21:07:41 -- common/autotest_common.sh@960 -- # wait 4000669 00:17:47.062 21:07:41 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.062 21:07:41 -- common/autotest_common.sh@650 -- # local es=0 00:17:47.062 21:07:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.062 21:07:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:47.062 21:07:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.062 21:07:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:47.062 21:07:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.062 21:07:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.062 21:07:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:47.062 21:07:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:47.062 21:07:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:47.062 21:07:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:47.062 21:07:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:47.062 21:07:41 -- target/tls.sh@28 -- # bdevperf_pid=4002035 00:17:47.062 21:07:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:47.062 21:07:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:47.062 21:07:41 -- target/tls.sh@31 -- # waitforlisten 4002035 /var/tmp/bdevperf.sock 00:17:47.062 21:07:41 -- common/autotest_common.sh@829 -- # '[' -z 4002035 ']' 00:17:47.062 21:07:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:47.062 21:07:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.062 21:07:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:47.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:47.062 21:07:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.062 21:07:41 -- common/autotest_common.sh@10 -- # set +x 00:17:47.062 [2024-11-27 21:07:41.485190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:47.062 [2024-11-27 21:07:41.485270] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4002035 ] 00:17:47.062 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.062 [2024-11-27 21:07:41.542576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:47.062 [2024-11-27 21:07:41.653432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.062 21:07:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.062 21:07:42 -- common/autotest_common.sh@862 -- # return 0 00:17:47.062 21:07:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:47.062 [2024-11-27 21:07:42.749964] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.062 [2024-11-27 21:07:42.755370] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:47.062 [2024-11-27 21:07:42.755786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ac1f0 (107): Transport endpoint is not connected 00:17:47.062 [2024-11-27 21:07:42.756774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ac1f0 (9): Bad file descriptor 00:17:47.062 [2024-11-27 21:07:42.757773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:47.062 [2024-11-27 21:07:42.757796] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:47.062 [2024-11-27 21:07:42.757826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:47.062 request: 00:17:47.062 { 00:17:47.062 "name": "TLSTEST", 00:17:47.062 "trtype": "tcp", 00:17:47.062 "traddr": "10.0.0.2", 00:17:47.062 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.062 "adrfam": "ipv4", 00:17:47.062 "trsvcid": "4420", 00:17:47.062 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.062 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:47.062 "method": "bdev_nvme_attach_controller", 00:17:47.062 "req_id": 1 00:17:47.062 } 00:17:47.062 Got JSON-RPC error response 00:17:47.062 response: 00:17:47.062 { 00:17:47.062 "code": -32602, 00:17:47.062 "message": "Invalid parameters" 00:17:47.062 } 00:17:47.062 21:07:42 -- target/tls.sh@36 -- # killprocess 4002035 00:17:47.062 21:07:42 -- common/autotest_common.sh@936 -- # '[' -z 4002035 ']' 00:17:47.062 21:07:42 -- common/autotest_common.sh@940 -- # kill -0 4002035 00:17:47.062 21:07:42 -- common/autotest_common.sh@941 -- # uname 00:17:47.062 21:07:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.062 21:07:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4002035 00:17:47.062 21:07:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:47.062 21:07:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:47.062 21:07:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4002035' 00:17:47.062 killing process with pid 4002035 00:17:47.062 21:07:42 -- common/autotest_common.sh@955 -- # kill 4002035 00:17:47.062 Received shutdown signal, test time was about 10.000000 seconds 00:17:47.062 00:17:47.062 Latency(us) 00:17:47.062 [2024-11-27T20:07:43.303Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.062 [2024-11-27T20:07:43.303Z] =================================================================================================================== 00:17:47.062 [2024-11-27T20:07:43.304Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:47.063 21:07:42 -- common/autotest_common.sh@960 -- # wait 4002035 00:17:47.063 21:07:43 -- target/tls.sh@37 -- # return 1 00:17:47.063 21:07:43 -- common/autotest_common.sh@653 -- # es=1 00:17:47.063 21:07:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:47.063 21:07:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:47.063 21:07:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:47.063 21:07:43 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.063 21:07:43 -- common/autotest_common.sh@650 -- # local es=0 00:17:47.063 21:07:43 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.063 21:07:43 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:47.063 21:07:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.063 21:07:43 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:47.063 21:07:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.063 21:07:43 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.063 21:07:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:47.063 21:07:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:47.063 21:07:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:47.063 21:07:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:47.063 21:07:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:47.063 21:07:43 -- target/tls.sh@28 -- # bdevperf_pid=4002309 00:17:47.063 21:07:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:47.063 21:07:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:47.063 21:07:43 -- target/tls.sh@31 -- # waitforlisten 4002309 /var/tmp/bdevperf.sock 00:17:47.063 21:07:43 -- common/autotest_common.sh@829 -- # '[' -z 4002309 ']' 00:17:47.063 21:07:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:47.063 21:07:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.063 21:07:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:47.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:47.063 21:07:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.063 21:07:43 -- common/autotest_common.sh@10 -- # set +x 00:17:47.063 [2024-11-27 21:07:43.127730] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:47.063 [2024-11-27 21:07:43.127809] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4002309 ] 00:17:47.063 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.063 [2024-11-27 21:07:43.184343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:47.063 [2024-11-27 21:07:43.287775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.995 21:07:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.995 21:07:44 -- common/autotest_common.sh@862 -- # return 0 00:17:47.996 21:07:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.253 [2024-11-27 21:07:44.373299] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:48.253 [2024-11-27 21:07:44.378424] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:48.253 [2024-11-27 21:07:44.378455] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:48.253 [2024-11-27 21:07:44.378508] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:48.253 [2024-11-27 21:07:44.379084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d521f0 (107): Transport endpoint is not connected 00:17:48.253 [2024-11-27 21:07:44.380074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d521f0 (9): Bad file descriptor 00:17:48.253 [2024-11-27 21:07:44.381072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:48.253 [2024-11-27 21:07:44.381092] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:48.253 [2024-11-27 21:07:44.381120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:48.253 request: 00:17:48.253 { 00:17:48.253 "name": "TLSTEST", 00:17:48.253 "trtype": "tcp", 00:17:48.253 "traddr": "10.0.0.2", 00:17:48.253 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:48.253 "adrfam": "ipv4", 00:17:48.253 "trsvcid": "4420", 00:17:48.253 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.253 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:48.253 "method": "bdev_nvme_attach_controller", 00:17:48.253 "req_id": 1 00:17:48.253 } 00:17:48.253 Got JSON-RPC error response 00:17:48.253 response: 00:17:48.253 { 00:17:48.253 "code": -32602, 00:17:48.253 "message": "Invalid parameters" 00:17:48.253 } 00:17:48.253 21:07:44 -- target/tls.sh@36 -- # killprocess 4002309 00:17:48.253 21:07:44 -- common/autotest_common.sh@936 -- # '[' -z 4002309 ']' 00:17:48.253 21:07:44 -- common/autotest_common.sh@940 -- # kill -0 4002309 00:17:48.253 21:07:44 -- common/autotest_common.sh@941 -- # uname 00:17:48.253 21:07:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:48.253 21:07:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4002309 00:17:48.253 21:07:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:48.253 21:07:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:48.253 21:07:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4002309' 00:17:48.253 killing process with pid 4002309 00:17:48.253 21:07:44 -- common/autotest_common.sh@955 -- # kill 4002309 00:17:48.253 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.253 00:17:48.253 Latency(us) 00:17:48.253 [2024-11-27T20:07:44.494Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.253 [2024-11-27T20:07:44.494Z] =================================================================================================================== 00:17:48.253 [2024-11-27T20:07:44.494Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:48.253 21:07:44 -- common/autotest_common.sh@960 -- # wait 4002309 00:17:48.510 21:07:44 -- target/tls.sh@37 -- # return 1 00:17:48.510 21:07:44 -- common/autotest_common.sh@653 -- # es=1 00:17:48.510 21:07:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:48.510 21:07:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:48.510 21:07:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:48.510 21:07:44 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.510 21:07:44 -- common/autotest_common.sh@650 -- # local es=0 00:17:48.510 21:07:44 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.510 21:07:44 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:48.510 21:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:48.510 21:07:44 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:48.510 21:07:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:48.510 21:07:44 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.510 21:07:44 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:48.510 21:07:44 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:48.510 21:07:44 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:48.510 21:07:44 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:48.510 21:07:44 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:48.510 21:07:44 -- target/tls.sh@28 -- # bdevperf_pid=4002460 00:17:48.510 21:07:44 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:48.510 21:07:44 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:48.510 21:07:44 -- target/tls.sh@31 -- # waitforlisten 4002460 /var/tmp/bdevperf.sock 00:17:48.510 21:07:44 -- common/autotest_common.sh@829 -- # '[' -z 4002460 ']' 00:17:48.510 21:07:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.510 21:07:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:48.510 21:07:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.510 21:07:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:48.510 21:07:44 -- common/autotest_common.sh@10 -- # set +x 00:17:48.510 [2024-11-27 21:07:44.741263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:48.510 [2024-11-27 21:07:44.741342] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4002460 ] 00:17:48.767 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.767 [2024-11-27 21:07:44.800489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.767 [2024-11-27 21:07:44.904985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:49.725 21:07:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:49.725 21:07:45 -- common/autotest_common.sh@862 -- # return 0 00:17:49.725 21:07:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.725 [2024-11-27 21:07:45.928628] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:49.725 [2024-11-27 21:07:45.933783] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:49.725 [2024-11-27 21:07:45.933856] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:49.725 [2024-11-27 21:07:45.933922] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:49.725 [2024-11-27 21:07:45.934402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10311f0 (107): Transport endpoint is not connected 00:17:49.725 [2024-11-27 21:07:45.935389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10311f0 (9): Bad file descriptor 00:17:49.725 [2024-11-27 21:07:45.936388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:49.725 [2024-11-27 21:07:45.936409] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:49.725 [2024-11-27 21:07:45.936438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:49.725 request: 00:17:49.725 { 00:17:49.725 "name": "TLSTEST", 00:17:49.726 "trtype": "tcp", 00:17:49.726 "traddr": "10.0.0.2", 00:17:49.726 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:49.726 "adrfam": "ipv4", 00:17:49.726 "trsvcid": "4420", 00:17:49.726 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:49.726 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:49.726 "method": "bdev_nvme_attach_controller", 00:17:49.726 "req_id": 1 00:17:49.726 } 00:17:49.726 Got JSON-RPC error response 00:17:49.726 response: 00:17:49.726 { 00:17:49.726 "code": -32602, 00:17:49.726 "message": "Invalid parameters" 00:17:49.726 } 00:17:49.726 21:07:45 -- target/tls.sh@36 -- # killprocess 4002460 00:17:49.726 21:07:45 -- common/autotest_common.sh@936 -- # '[' -z 4002460 ']' 00:17:49.726 21:07:45 -- common/autotest_common.sh@940 -- # kill -0 4002460 00:17:49.726 21:07:45 -- common/autotest_common.sh@941 -- # uname 00:17:49.726 21:07:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.726 21:07:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4002460 00:17:49.983 21:07:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.983 21:07:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.983 21:07:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4002460' 00:17:49.983 killing process with pid 4002460 00:17:49.983 21:07:45 -- common/autotest_common.sh@955 -- # kill 4002460 00:17:49.983 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.983 00:17:49.983 Latency(us) 00:17:49.983 [2024-11-27T20:07:46.224Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.983 [2024-11-27T20:07:46.224Z] =================================================================================================================== 00:17:49.983 [2024-11-27T20:07:46.224Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:49.983 21:07:45 -- common/autotest_common.sh@960 -- # wait 4002460 00:17:50.241 21:07:46 -- target/tls.sh@37 -- # return 1 00:17:50.241 21:07:46 -- common/autotest_common.sh@653 -- # es=1 00:17:50.241 21:07:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:50.241 21:07:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:50.241 21:07:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:50.241 21:07:46 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:50.241 21:07:46 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.241 21:07:46 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:50.241 21:07:46 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:50.241 21:07:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.241 21:07:46 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:50.241 21:07:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.241 21:07:46 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:50.241 21:07:46 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:50.241 21:07:46 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:50.241 21:07:46 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:50.241 21:07:46 -- target/tls.sh@23 -- # psk= 00:17:50.241 21:07:46 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:50.241 21:07:46 -- target/tls.sh@28 -- # bdevperf_pid=4002733 00:17:50.241 21:07:46 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:50.241 21:07:46 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:50.241 21:07:46 -- target/tls.sh@31 -- # waitforlisten 4002733 /var/tmp/bdevperf.sock 00:17:50.241 21:07:46 -- common/autotest_common.sh@829 -- # '[' -z 4002733 ']' 00:17:50.241 21:07:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:50.241 21:07:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:50.241 21:07:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:50.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:50.241 21:07:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:50.241 21:07:46 -- common/autotest_common.sh@10 -- # set +x 00:17:50.241 [2024-11-27 21:07:46.291607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:50.241 [2024-11-27 21:07:46.291687] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4002733 ] 00:17:50.241 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.241 [2024-11-27 21:07:46.349424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.241 [2024-11-27 21:07:46.453896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:51.174 21:07:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.174 21:07:47 -- common/autotest_common.sh@862 -- # return 0 00:17:51.174 21:07:47 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:51.432 [2024-11-27 21:07:47.535371] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:51.432 [2024-11-27 21:07:47.537290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe0f050 (9): Bad file descriptor 00:17:51.432 [2024-11-27 21:07:47.538287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:51.432 [2024-11-27 21:07:47.538308] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:51.432 [2024-11-27 21:07:47.538336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:51.432 request: 00:17:51.432 { 00:17:51.432 "name": "TLSTEST", 00:17:51.432 "trtype": "tcp", 00:17:51.432 "traddr": "10.0.0.2", 00:17:51.432 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.432 "adrfam": "ipv4", 00:17:51.432 "trsvcid": "4420", 00:17:51.432 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.432 "method": "bdev_nvme_attach_controller", 00:17:51.432 "req_id": 1 00:17:51.432 } 00:17:51.432 Got JSON-RPC error response 00:17:51.432 response: 00:17:51.432 { 00:17:51.432 "code": -32602, 00:17:51.432 "message": "Invalid parameters" 00:17:51.432 } 00:17:51.432 21:07:47 -- target/tls.sh@36 -- # killprocess 4002733 00:17:51.432 21:07:47 -- common/autotest_common.sh@936 -- # '[' -z 4002733 ']' 00:17:51.432 21:07:47 -- common/autotest_common.sh@940 -- # kill -0 4002733 00:17:51.432 21:07:47 -- common/autotest_common.sh@941 -- # uname 00:17:51.432 21:07:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.432 21:07:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4002733 00:17:51.432 21:07:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:51.432 21:07:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:51.432 21:07:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4002733' 00:17:51.432 killing process with pid 4002733 00:17:51.432 21:07:47 -- common/autotest_common.sh@955 -- # kill 4002733 00:17:51.432 Received shutdown signal, test time was about 10.000000 seconds 00:17:51.432 00:17:51.432 Latency(us) 00:17:51.432 [2024-11-27T20:07:47.673Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.432 [2024-11-27T20:07:47.673Z] =================================================================================================================== 00:17:51.432 [2024-11-27T20:07:47.673Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:51.432 21:07:47 -- common/autotest_common.sh@960 -- # wait 4002733 00:17:51.690 21:07:47 -- target/tls.sh@37 -- # return 1 00:17:51.690 21:07:47 -- common/autotest_common.sh@653 -- # es=1 00:17:51.690 21:07:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.690 21:07:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.690 21:07:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.690 21:07:47 -- target/tls.sh@167 -- # killprocess 3998699 00:17:51.690 21:07:47 -- common/autotest_common.sh@936 -- # '[' -z 3998699 ']' 00:17:51.690 21:07:47 -- common/autotest_common.sh@940 -- # kill -0 3998699 00:17:51.690 21:07:47 -- common/autotest_common.sh@941 -- # uname 00:17:51.690 21:07:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.690 21:07:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3998699 00:17:51.690 21:07:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:51.690 21:07:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:51.690 21:07:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3998699' 00:17:51.690 killing process with pid 3998699 00:17:51.690 21:07:47 -- common/autotest_common.sh@955 -- # kill 3998699 00:17:51.690 21:07:47 -- common/autotest_common.sh@960 -- # wait 3998699 00:17:52.255 21:07:48 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:52.255 21:07:48 -- target/tls.sh@49 -- # local key hash crc 00:17:52.255 21:07:48 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:52.255 21:07:48 -- target/tls.sh@51 -- # hash=02 00:17:52.255 21:07:48 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:52.255 21:07:48 -- target/tls.sh@52 -- # gzip -1 -c 00:17:52.255 21:07:48 -- target/tls.sh@52 -- # tail -c8 00:17:52.255 21:07:48 -- target/tls.sh@52 -- # head -c 4 00:17:52.255 21:07:48 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:52.255 21:07:48 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:52.255 21:07:48 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:52.255 21:07:48 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:52.255 21:07:48 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:52.255 21:07:48 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:52.255 21:07:48 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:52.255 21:07:48 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:52.255 21:07:48 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:52.255 21:07:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:52.255 21:07:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:52.255 21:07:48 -- common/autotest_common.sh@10 -- # set +x 00:17:52.255 21:07:48 -- nvmf/common.sh@469 -- # nvmfpid=4002906 00:17:52.255 21:07:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:52.255 21:07:48 -- nvmf/common.sh@470 -- # waitforlisten 4002906 00:17:52.255 21:07:48 -- common/autotest_common.sh@829 -- # '[' -z 4002906 ']' 00:17:52.255 21:07:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:52.255 21:07:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.255 21:07:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:52.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:52.255 21:07:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.255 21:07:48 -- common/autotest_common.sh@10 -- # set +x 00:17:52.255 [2024-11-27 21:07:48.256317] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.255 [2024-11-27 21:07:48.256405] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:52.255 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.255 [2024-11-27 21:07:48.320503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.255 [2024-11-27 21:07:48.433686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:52.255 [2024-11-27 21:07:48.433853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:52.255 [2024-11-27 21:07:48.433874] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:52.255 [2024-11-27 21:07:48.433888] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:52.255 [2024-11-27 21:07:48.433920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:53.187 21:07:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.187 21:07:49 -- common/autotest_common.sh@862 -- # return 0 00:17:53.187 21:07:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:53.187 21:07:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:53.187 21:07:49 -- common/autotest_common.sh@10 -- # set +x 00:17:53.187 21:07:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:53.188 21:07:49 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:53.188 21:07:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:53.188 21:07:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:53.445 [2024-11-27 21:07:49.620666] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:53.445 21:07:49 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:53.705 21:07:49 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:54.272 [2024-11-27 21:07:50.214315] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:54.272 [2024-11-27 21:07:50.214592] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:54.272 21:07:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:54.272 malloc0 00:17:54.272 21:07:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:54.838 21:07:50 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.838 21:07:51 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.838 21:07:51 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:54.838 21:07:51 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:54.838 21:07:51 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:54.838 21:07:51 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:54.838 21:07:51 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:54.838 21:07:51 -- target/tls.sh@28 -- # bdevperf_pid=4003329 00:17:54.838 21:07:51 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:54.838 21:07:51 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:54.838 21:07:51 -- target/tls.sh@31 -- # waitforlisten 4003329 /var/tmp/bdevperf.sock 00:17:54.838 21:07:51 -- common/autotest_common.sh@829 -- # '[' -z 4003329 ']' 00:17:54.838 21:07:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:54.838 21:07:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.838 21:07:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:54.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:54.838 21:07:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.838 21:07:51 -- common/autotest_common.sh@10 -- # set +x 00:17:54.838 [2024-11-27 21:07:51.065862] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:54.838 [2024-11-27 21:07:51.065934] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4003329 ] 00:17:55.096 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.096 [2024-11-27 21:07:51.124002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.096 [2024-11-27 21:07:51.229246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.029 21:07:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.029 21:07:52 -- common/autotest_common.sh@862 -- # return 0 00:17:56.029 21:07:52 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.287 [2024-11-27 21:07:52.321871] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:56.287 TLSTESTn1 00:17:56.287 21:07:52 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:56.545 Running I/O for 10 seconds... 00:18:06.592 00:18:06.592 Latency(us) 00:18:06.592 [2024-11-27T20:08:02.833Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.592 [2024-11-27T20:08:02.833Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:06.592 Verification LBA range: start 0x0 length 0x2000 00:18:06.592 TLSTESTn1 : 10.03 4492.53 17.55 0.00 0.00 28444.33 4830.25 43496.49 00:18:06.592 [2024-11-27T20:08:02.833Z] =================================================================================================================== 00:18:06.592 [2024-11-27T20:08:02.833Z] Total : 4492.53 17.55 0.00 0.00 28444.33 4830.25 43496.49 00:18:06.592 0 00:18:06.592 21:08:02 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:06.592 21:08:02 -- target/tls.sh@45 -- # killprocess 4003329 00:18:06.592 21:08:02 -- common/autotest_common.sh@936 -- # '[' -z 4003329 ']' 00:18:06.592 21:08:02 -- common/autotest_common.sh@940 -- # kill -0 4003329 00:18:06.592 21:08:02 -- common/autotest_common.sh@941 -- # uname 00:18:06.592 21:08:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.592 21:08:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4003329 00:18:06.592 21:08:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:06.592 21:08:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:06.592 21:08:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4003329' 00:18:06.592 killing process with pid 4003329 00:18:06.592 21:08:02 -- common/autotest_common.sh@955 -- # kill 4003329 00:18:06.592 Received shutdown signal, test time was about 10.000000 seconds 00:18:06.592 00:18:06.592 Latency(us) 00:18:06.592 [2024-11-27T20:08:02.833Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.592 [2024-11-27T20:08:02.833Z] =================================================================================================================== 00:18:06.592 [2024-11-27T20:08:02.833Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:06.592 21:08:02 -- common/autotest_common.sh@960 -- # wait 4003329 00:18:06.850 21:08:02 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.850 21:08:02 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.850 21:08:02 -- common/autotest_common.sh@650 -- # local es=0 00:18:06.850 21:08:02 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.850 21:08:02 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:06.850 21:08:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.850 21:08:02 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:06.850 21:08:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.850 21:08:02 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.850 21:08:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:06.850 21:08:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:06.850 21:08:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:06.850 21:08:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:06.850 21:08:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:06.850 21:08:02 -- target/tls.sh@28 -- # bdevperf_pid=4004700 00:18:06.850 21:08:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:06.850 21:08:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:06.850 21:08:02 -- target/tls.sh@31 -- # waitforlisten 4004700 /var/tmp/bdevperf.sock 00:18:06.850 21:08:02 -- common/autotest_common.sh@829 -- # '[' -z 4004700 ']' 00:18:06.850 21:08:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:06.850 21:08:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.850 21:08:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:06.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:06.850 21:08:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.850 21:08:02 -- common/autotest_common.sh@10 -- # set +x 00:18:06.850 [2024-11-27 21:08:02.951392] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.850 [2024-11-27 21:08:02.951470] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4004700 ] 00:18:06.850 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.850 [2024-11-27 21:08:03.007356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.109 [2024-11-27 21:08:03.112396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:08.043 21:08:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:08.043 21:08:03 -- common/autotest_common.sh@862 -- # return 0 00:18:08.043 21:08:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:08.043 [2024-11-27 21:08:04.151460] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:08.043 [2024-11-27 21:08:04.151532] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:08.043 request: 00:18:08.043 { 00:18:08.043 "name": "TLSTEST", 00:18:08.043 "trtype": "tcp", 00:18:08.043 "traddr": "10.0.0.2", 00:18:08.043 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:08.043 "adrfam": "ipv4", 00:18:08.043 "trsvcid": "4420", 00:18:08.043 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.043 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:08.043 "method": "bdev_nvme_attach_controller", 00:18:08.043 "req_id": 1 00:18:08.043 } 00:18:08.043 Got JSON-RPC error response 00:18:08.043 response: 00:18:08.043 { 00:18:08.043 "code": -22, 00:18:08.043 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:08.043 } 00:18:08.043 21:08:04 -- target/tls.sh@36 -- # killprocess 4004700 00:18:08.043 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 4004700 ']' 00:18:08.043 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 4004700 00:18:08.043 21:08:04 -- common/autotest_common.sh@941 -- # uname 00:18:08.043 21:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.043 21:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4004700 00:18:08.043 21:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:08.043 21:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:08.043 21:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4004700' 00:18:08.043 killing process with pid 4004700 00:18:08.043 21:08:04 -- common/autotest_common.sh@955 -- # kill 4004700 00:18:08.043 Received shutdown signal, test time was about 10.000000 seconds 00:18:08.043 00:18:08.043 Latency(us) 00:18:08.043 [2024-11-27T20:08:04.284Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.043 [2024-11-27T20:08:04.284Z] =================================================================================================================== 00:18:08.043 [2024-11-27T20:08:04.284Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:08.043 21:08:04 -- common/autotest_common.sh@960 -- # wait 4004700 00:18:08.302 21:08:04 -- target/tls.sh@37 -- # return 1 00:18:08.302 21:08:04 -- common/autotest_common.sh@653 -- # es=1 00:18:08.302 21:08:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:08.302 21:08:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:08.302 21:08:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:08.302 21:08:04 -- target/tls.sh@183 -- # killprocess 4002906 00:18:08.302 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 4002906 ']' 00:18:08.302 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 4002906 00:18:08.302 21:08:04 -- common/autotest_common.sh@941 -- # uname 00:18:08.302 21:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.302 21:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4002906 00:18:08.302 21:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:08.302 21:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:08.302 21:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4002906' 00:18:08.302 killing process with pid 4002906 00:18:08.302 21:08:04 -- common/autotest_common.sh@955 -- # kill 4002906 00:18:08.302 21:08:04 -- common/autotest_common.sh@960 -- # wait 4002906 00:18:08.561 21:08:04 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:08.561 21:08:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:08.561 21:08:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:08.561 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:18:08.561 21:08:04 -- nvmf/common.sh@469 -- # nvmfpid=4004979 00:18:08.561 21:08:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:08.561 21:08:04 -- nvmf/common.sh@470 -- # waitforlisten 4004979 00:18:08.561 21:08:04 -- common/autotest_common.sh@829 -- # '[' -z 4004979 ']' 00:18:08.561 21:08:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:08.561 21:08:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.820 21:08:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:08.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:08.820 21:08:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.820 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:18:08.820 [2024-11-27 21:08:04.842485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:08.820 [2024-11-27 21:08:04.842579] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:08.820 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.820 [2024-11-27 21:08:04.910592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.820 [2024-11-27 21:08:05.024474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.820 [2024-11-27 21:08:05.024678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.820 [2024-11-27 21:08:05.024698] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.820 [2024-11-27 21:08:05.024711] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.820 [2024-11-27 21:08:05.024741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:09.753 21:08:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.753 21:08:05 -- common/autotest_common.sh@862 -- # return 0 00:18:09.753 21:08:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.753 21:08:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.753 21:08:05 -- common/autotest_common.sh@10 -- # set +x 00:18:09.753 21:08:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.753 21:08:05 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.753 21:08:05 -- common/autotest_common.sh@650 -- # local es=0 00:18:09.753 21:08:05 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.753 21:08:05 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:09.753 21:08:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.753 21:08:05 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:09.753 21:08:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.753 21:08:05 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.753 21:08:05 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.753 21:08:05 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:10.010 [2024-11-27 21:08:06.150616] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:10.010 21:08:06 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:10.267 21:08:06 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:10.525 [2024-11-27 21:08:06.724154] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:10.525 [2024-11-27 21:08:06.724400] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:10.525 21:08:06 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:10.783 malloc0 00:18:10.783 21:08:06 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:11.041 21:08:07 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.299 [2024-11-27 21:08:07.461668] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:11.299 [2024-11-27 21:08:07.461706] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:11.299 [2024-11-27 21:08:07.461731] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:11.299 request: 00:18:11.299 { 00:18:11.299 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.299 "host": "nqn.2016-06.io.spdk:host1", 00:18:11.299 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:11.299 "method": "nvmf_subsystem_add_host", 00:18:11.299 "req_id": 1 00:18:11.299 } 00:18:11.299 Got JSON-RPC error response 00:18:11.299 response: 00:18:11.299 { 00:18:11.299 "code": -32603, 00:18:11.299 "message": "Internal error" 00:18:11.299 } 00:18:11.299 21:08:07 -- common/autotest_common.sh@653 -- # es=1 00:18:11.299 21:08:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:11.299 21:08:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:11.299 21:08:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:11.299 21:08:07 -- target/tls.sh@189 -- # killprocess 4004979 00:18:11.299 21:08:07 -- common/autotest_common.sh@936 -- # '[' -z 4004979 ']' 00:18:11.299 21:08:07 -- common/autotest_common.sh@940 -- # kill -0 4004979 00:18:11.299 21:08:07 -- common/autotest_common.sh@941 -- # uname 00:18:11.299 21:08:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.299 21:08:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4004979 00:18:11.299 21:08:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:11.299 21:08:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:11.299 21:08:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4004979' 00:18:11.299 killing process with pid 4004979 00:18:11.299 21:08:07 -- common/autotest_common.sh@955 -- # kill 4004979 00:18:11.299 21:08:07 -- common/autotest_common.sh@960 -- # wait 4004979 00:18:11.866 21:08:07 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.866 21:08:07 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:11.866 21:08:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:11.866 21:08:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:11.866 21:08:07 -- common/autotest_common.sh@10 -- # set +x 00:18:11.866 21:08:07 -- nvmf/common.sh@469 -- # nvmfpid=4005417 00:18:11.866 21:08:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:11.866 21:08:07 -- nvmf/common.sh@470 -- # waitforlisten 4005417 00:18:11.866 21:08:07 -- common/autotest_common.sh@829 -- # '[' -z 4005417 ']' 00:18:11.866 21:08:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:11.866 21:08:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.866 21:08:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:11.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:11.866 21:08:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.866 21:08:07 -- common/autotest_common.sh@10 -- # set +x 00:18:11.866 [2024-11-27 21:08:07.864162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.866 [2024-11-27 21:08:07.864235] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:11.866 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.866 [2024-11-27 21:08:07.929637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.866 [2024-11-27 21:08:08.050667] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:11.866 [2024-11-27 21:08:08.050856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:11.866 [2024-11-27 21:08:08.050876] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:11.866 [2024-11-27 21:08:08.050890] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:11.866 [2024-11-27 21:08:08.050923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:12.799 21:08:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.799 21:08:08 -- common/autotest_common.sh@862 -- # return 0 00:18:12.799 21:08:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:12.799 21:08:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:12.799 21:08:08 -- common/autotest_common.sh@10 -- # set +x 00:18:12.799 21:08:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:12.799 21:08:08 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.799 21:08:08 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.799 21:08:08 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:13.057 [2024-11-27 21:08:09.211865] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:13.057 21:08:09 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:13.314 21:08:09 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:13.571 [2024-11-27 21:08:09.741298] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:13.572 [2024-11-27 21:08:09.741558] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:13.572 21:08:09 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:13.830 malloc0 00:18:13.830 21:08:10 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:14.087 21:08:10 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.654 21:08:10 -- target/tls.sh@197 -- # bdevperf_pid=4005724 00:18:14.654 21:08:10 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:14.654 21:08:10 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:14.654 21:08:10 -- target/tls.sh@200 -- # waitforlisten 4005724 /var/tmp/bdevperf.sock 00:18:14.654 21:08:10 -- common/autotest_common.sh@829 -- # '[' -z 4005724 ']' 00:18:14.654 21:08:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:14.654 21:08:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.654 21:08:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:14.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:14.654 21:08:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.654 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:18:14.654 [2024-11-27 21:08:10.666269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:14.654 [2024-11-27 21:08:10.666341] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4005724 ] 00:18:14.654 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.654 [2024-11-27 21:08:10.726321] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.654 [2024-11-27 21:08:10.832155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:15.589 21:08:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:15.589 21:08:11 -- common/autotest_common.sh@862 -- # return 0 00:18:15.589 21:08:11 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.847 [2024-11-27 21:08:11.853298] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:15.847 TLSTESTn1 00:18:15.847 21:08:11 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:16.105 21:08:12 -- target/tls.sh@205 -- # tgtconf='{ 00:18:16.105 "subsystems": [ 00:18:16.105 { 00:18:16.105 "subsystem": "iobuf", 00:18:16.105 "config": [ 00:18:16.105 { 00:18:16.105 "method": "iobuf_set_options", 00:18:16.105 "params": { 00:18:16.105 "small_pool_count": 8192, 00:18:16.105 "large_pool_count": 1024, 00:18:16.105 "small_bufsize": 8192, 00:18:16.105 "large_bufsize": 135168 00:18:16.105 } 00:18:16.105 } 00:18:16.105 ] 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "subsystem": "sock", 00:18:16.105 "config": [ 00:18:16.105 { 00:18:16.105 "method": "sock_impl_set_options", 00:18:16.105 "params": { 00:18:16.105 "impl_name": "posix", 00:18:16.105 "recv_buf_size": 2097152, 00:18:16.105 "send_buf_size": 2097152, 00:18:16.105 "enable_recv_pipe": true, 00:18:16.105 "enable_quickack": false, 00:18:16.105 "enable_placement_id": 0, 00:18:16.105 "enable_zerocopy_send_server": true, 00:18:16.105 "enable_zerocopy_send_client": false, 00:18:16.105 "zerocopy_threshold": 0, 00:18:16.105 "tls_version": 0, 00:18:16.105 "enable_ktls": false 00:18:16.105 } 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "method": "sock_impl_set_options", 00:18:16.105 "params": { 00:18:16.105 "impl_name": "ssl", 00:18:16.105 "recv_buf_size": 4096, 00:18:16.105 "send_buf_size": 4096, 00:18:16.105 "enable_recv_pipe": true, 00:18:16.105 "enable_quickack": false, 00:18:16.105 "enable_placement_id": 0, 00:18:16.105 "enable_zerocopy_send_server": true, 00:18:16.105 "enable_zerocopy_send_client": false, 00:18:16.105 "zerocopy_threshold": 0, 00:18:16.105 "tls_version": 0, 00:18:16.105 "enable_ktls": false 00:18:16.105 } 00:18:16.105 } 00:18:16.105 ] 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "subsystem": "vmd", 00:18:16.105 "config": [] 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "subsystem": "accel", 00:18:16.105 "config": [ 00:18:16.105 { 00:18:16.105 "method": "accel_set_options", 00:18:16.105 "params": { 00:18:16.105 "small_cache_size": 128, 00:18:16.105 "large_cache_size": 16, 00:18:16.105 "task_count": 2048, 00:18:16.105 "sequence_count": 2048, 00:18:16.105 "buf_count": 2048 00:18:16.105 } 00:18:16.105 } 00:18:16.105 ] 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "subsystem": "bdev", 00:18:16.105 "config": [ 00:18:16.105 { 00:18:16.105 "method": "bdev_set_options", 00:18:16.105 "params": { 00:18:16.105 "bdev_io_pool_size": 65535, 00:18:16.105 "bdev_io_cache_size": 256, 00:18:16.105 "bdev_auto_examine": true, 00:18:16.105 "iobuf_small_cache_size": 128, 00:18:16.105 "iobuf_large_cache_size": 16 00:18:16.105 } 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "method": "bdev_raid_set_options", 00:18:16.105 "params": { 00:18:16.105 "process_window_size_kb": 1024 00:18:16.105 } 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "method": "bdev_iscsi_set_options", 00:18:16.105 "params": { 00:18:16.105 "timeout_sec": 30 00:18:16.105 } 00:18:16.105 }, 00:18:16.105 { 00:18:16.105 "method": "bdev_nvme_set_options", 00:18:16.105 "params": { 00:18:16.105 "action_on_timeout": "none", 00:18:16.105 "timeout_us": 0, 00:18:16.105 "timeout_admin_us": 0, 00:18:16.105 "keep_alive_timeout_ms": 10000, 00:18:16.105 "transport_retry_count": 4, 00:18:16.105 "arbitration_burst": 0, 00:18:16.105 "low_priority_weight": 0, 00:18:16.105 "medium_priority_weight": 0, 00:18:16.105 "high_priority_weight": 0, 00:18:16.105 "nvme_adminq_poll_period_us": 10000, 00:18:16.105 "nvme_ioq_poll_period_us": 0, 00:18:16.105 "io_queue_requests": 0, 00:18:16.105 "delay_cmd_submit": true, 00:18:16.105 "bdev_retry_count": 3, 00:18:16.105 "transport_ack_timeout": 0, 00:18:16.105 "ctrlr_loss_timeout_sec": 0, 00:18:16.106 "reconnect_delay_sec": 0, 00:18:16.106 "fast_io_fail_timeout_sec": 0, 00:18:16.106 "generate_uuids": false, 00:18:16.106 "transport_tos": 0, 00:18:16.106 "io_path_stat": false, 00:18:16.106 "allow_accel_sequence": false 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "bdev_nvme_set_hotplug", 00:18:16.106 "params": { 00:18:16.106 "period_us": 100000, 00:18:16.106 "enable": false 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "bdev_malloc_create", 00:18:16.106 "params": { 00:18:16.106 "name": "malloc0", 00:18:16.106 "num_blocks": 8192, 00:18:16.106 "block_size": 4096, 00:18:16.106 "physical_block_size": 4096, 00:18:16.106 "uuid": "015cb494-229f-4d5e-909f-9cd746ce4aaa", 00:18:16.106 "optimal_io_boundary": 0 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "bdev_wait_for_examine" 00:18:16.106 } 00:18:16.106 ] 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "subsystem": "nbd", 00:18:16.106 "config": [] 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "subsystem": "scheduler", 00:18:16.106 "config": [ 00:18:16.106 { 00:18:16.106 "method": "framework_set_scheduler", 00:18:16.106 "params": { 00:18:16.106 "name": "static" 00:18:16.106 } 00:18:16.106 } 00:18:16.106 ] 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "subsystem": "nvmf", 00:18:16.106 "config": [ 00:18:16.106 { 00:18:16.106 "method": "nvmf_set_config", 00:18:16.106 "params": { 00:18:16.106 "discovery_filter": "match_any", 00:18:16.106 "admin_cmd_passthru": { 00:18:16.106 "identify_ctrlr": false 00:18:16.106 } 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_set_max_subsystems", 00:18:16.106 "params": { 00:18:16.106 "max_subsystems": 1024 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_set_crdt", 00:18:16.106 "params": { 00:18:16.106 "crdt1": 0, 00:18:16.106 "crdt2": 0, 00:18:16.106 "crdt3": 0 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_create_transport", 00:18:16.106 "params": { 00:18:16.106 "trtype": "TCP", 00:18:16.106 "max_queue_depth": 128, 00:18:16.106 "max_io_qpairs_per_ctrlr": 127, 00:18:16.106 "in_capsule_data_size": 4096, 00:18:16.106 "max_io_size": 131072, 00:18:16.106 "io_unit_size": 131072, 00:18:16.106 "max_aq_depth": 128, 00:18:16.106 "num_shared_buffers": 511, 00:18:16.106 "buf_cache_size": 4294967295, 00:18:16.106 "dif_insert_or_strip": false, 00:18:16.106 "zcopy": false, 00:18:16.106 "c2h_success": false, 00:18:16.106 "sock_priority": 0, 00:18:16.106 "abort_timeout_sec": 1 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_create_subsystem", 00:18:16.106 "params": { 00:18:16.106 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.106 "allow_any_host": false, 00:18:16.106 "serial_number": "SPDK00000000000001", 00:18:16.106 "model_number": "SPDK bdev Controller", 00:18:16.106 "max_namespaces": 10, 00:18:16.106 "min_cntlid": 1, 00:18:16.106 "max_cntlid": 65519, 00:18:16.106 "ana_reporting": false 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_subsystem_add_host", 00:18:16.106 "params": { 00:18:16.106 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.106 "host": "nqn.2016-06.io.spdk:host1", 00:18:16.106 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_subsystem_add_ns", 00:18:16.106 "params": { 00:18:16.106 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.106 "namespace": { 00:18:16.106 "nsid": 1, 00:18:16.106 "bdev_name": "malloc0", 00:18:16.106 "nguid": "015CB494229F4D5E909F9CD746CE4AAA", 00:18:16.106 "uuid": "015cb494-229f-4d5e-909f-9cd746ce4aaa" 00:18:16.106 } 00:18:16.106 } 00:18:16.106 }, 00:18:16.106 { 00:18:16.106 "method": "nvmf_subsystem_add_listener", 00:18:16.106 "params": { 00:18:16.106 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.106 "listen_address": { 00:18:16.106 "trtype": "TCP", 00:18:16.106 "adrfam": "IPv4", 00:18:16.106 "traddr": "10.0.0.2", 00:18:16.106 "trsvcid": "4420" 00:18:16.106 }, 00:18:16.106 "secure_channel": true 00:18:16.106 } 00:18:16.106 } 00:18:16.106 ] 00:18:16.106 } 00:18:16.106 ] 00:18:16.106 }' 00:18:16.106 21:08:12 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:16.364 21:08:12 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:16.364 "subsystems": [ 00:18:16.364 { 00:18:16.364 "subsystem": "iobuf", 00:18:16.364 "config": [ 00:18:16.364 { 00:18:16.364 "method": "iobuf_set_options", 00:18:16.364 "params": { 00:18:16.364 "small_pool_count": 8192, 00:18:16.364 "large_pool_count": 1024, 00:18:16.364 "small_bufsize": 8192, 00:18:16.364 "large_bufsize": 135168 00:18:16.364 } 00:18:16.364 } 00:18:16.364 ] 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "subsystem": "sock", 00:18:16.364 "config": [ 00:18:16.364 { 00:18:16.364 "method": "sock_impl_set_options", 00:18:16.364 "params": { 00:18:16.364 "impl_name": "posix", 00:18:16.364 "recv_buf_size": 2097152, 00:18:16.364 "send_buf_size": 2097152, 00:18:16.364 "enable_recv_pipe": true, 00:18:16.364 "enable_quickack": false, 00:18:16.364 "enable_placement_id": 0, 00:18:16.364 "enable_zerocopy_send_server": true, 00:18:16.364 "enable_zerocopy_send_client": false, 00:18:16.364 "zerocopy_threshold": 0, 00:18:16.364 "tls_version": 0, 00:18:16.364 "enable_ktls": false 00:18:16.364 } 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "method": "sock_impl_set_options", 00:18:16.364 "params": { 00:18:16.364 "impl_name": "ssl", 00:18:16.364 "recv_buf_size": 4096, 00:18:16.364 "send_buf_size": 4096, 00:18:16.364 "enable_recv_pipe": true, 00:18:16.364 "enable_quickack": false, 00:18:16.364 "enable_placement_id": 0, 00:18:16.364 "enable_zerocopy_send_server": true, 00:18:16.364 "enable_zerocopy_send_client": false, 00:18:16.364 "zerocopy_threshold": 0, 00:18:16.364 "tls_version": 0, 00:18:16.364 "enable_ktls": false 00:18:16.364 } 00:18:16.364 } 00:18:16.364 ] 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "subsystem": "vmd", 00:18:16.364 "config": [] 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "subsystem": "accel", 00:18:16.364 "config": [ 00:18:16.364 { 00:18:16.364 "method": "accel_set_options", 00:18:16.364 "params": { 00:18:16.364 "small_cache_size": 128, 00:18:16.364 "large_cache_size": 16, 00:18:16.364 "task_count": 2048, 00:18:16.364 "sequence_count": 2048, 00:18:16.364 "buf_count": 2048 00:18:16.364 } 00:18:16.364 } 00:18:16.364 ] 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "subsystem": "bdev", 00:18:16.364 "config": [ 00:18:16.364 { 00:18:16.364 "method": "bdev_set_options", 00:18:16.364 "params": { 00:18:16.364 "bdev_io_pool_size": 65535, 00:18:16.364 "bdev_io_cache_size": 256, 00:18:16.364 "bdev_auto_examine": true, 00:18:16.364 "iobuf_small_cache_size": 128, 00:18:16.364 "iobuf_large_cache_size": 16 00:18:16.364 } 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "method": "bdev_raid_set_options", 00:18:16.364 "params": { 00:18:16.364 "process_window_size_kb": 1024 00:18:16.364 } 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "method": "bdev_iscsi_set_options", 00:18:16.364 "params": { 00:18:16.364 "timeout_sec": 30 00:18:16.364 } 00:18:16.364 }, 00:18:16.364 { 00:18:16.364 "method": "bdev_nvme_set_options", 00:18:16.364 "params": { 00:18:16.364 "action_on_timeout": "none", 00:18:16.364 "timeout_us": 0, 00:18:16.364 "timeout_admin_us": 0, 00:18:16.364 "keep_alive_timeout_ms": 10000, 00:18:16.364 "transport_retry_count": 4, 00:18:16.364 "arbitration_burst": 0, 00:18:16.364 "low_priority_weight": 0, 00:18:16.364 "medium_priority_weight": 0, 00:18:16.364 "high_priority_weight": 0, 00:18:16.364 "nvme_adminq_poll_period_us": 10000, 00:18:16.364 "nvme_ioq_poll_period_us": 0, 00:18:16.365 "io_queue_requests": 512, 00:18:16.365 "delay_cmd_submit": true, 00:18:16.365 "bdev_retry_count": 3, 00:18:16.365 "transport_ack_timeout": 0, 00:18:16.365 "ctrlr_loss_timeout_sec": 0, 00:18:16.365 "reconnect_delay_sec": 0, 00:18:16.365 "fast_io_fail_timeout_sec": 0, 00:18:16.365 "generate_uuids": false, 00:18:16.365 "transport_tos": 0, 00:18:16.365 "io_path_stat": false, 00:18:16.365 "allow_accel_sequence": false 00:18:16.365 } 00:18:16.365 }, 00:18:16.365 { 00:18:16.365 "method": "bdev_nvme_attach_controller", 00:18:16.365 "params": { 00:18:16.365 "name": "TLSTEST", 00:18:16.365 "trtype": "TCP", 00:18:16.365 "adrfam": "IPv4", 00:18:16.365 "traddr": "10.0.0.2", 00:18:16.365 "trsvcid": "4420", 00:18:16.365 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:16.365 "prchk_reftag": false, 00:18:16.365 "prchk_guard": false, 00:18:16.365 "ctrlr_loss_timeout_sec": 0, 00:18:16.365 "reconnect_delay_sec": 0, 00:18:16.365 "fast_io_fail_timeout_sec": 0, 00:18:16.365 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:16.365 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:16.365 "hdgst": false, 00:18:16.365 "ddgst": false 00:18:16.365 } 00:18:16.365 }, 00:18:16.365 { 00:18:16.365 "method": "bdev_nvme_set_hotplug", 00:18:16.365 "params": { 00:18:16.365 "period_us": 100000, 00:18:16.365 "enable": false 00:18:16.365 } 00:18:16.365 }, 00:18:16.365 { 00:18:16.365 "method": "bdev_wait_for_examine" 00:18:16.365 } 00:18:16.365 ] 00:18:16.365 }, 00:18:16.365 { 00:18:16.365 "subsystem": "nbd", 00:18:16.365 "config": [] 00:18:16.365 } 00:18:16.365 ] 00:18:16.365 }' 00:18:16.365 21:08:12 -- target/tls.sh@208 -- # killprocess 4005724 00:18:16.365 21:08:12 -- common/autotest_common.sh@936 -- # '[' -z 4005724 ']' 00:18:16.365 21:08:12 -- common/autotest_common.sh@940 -- # kill -0 4005724 00:18:16.365 21:08:12 -- common/autotest_common.sh@941 -- # uname 00:18:16.365 21:08:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.365 21:08:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4005724 00:18:16.365 21:08:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:16.365 21:08:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:16.365 21:08:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4005724' 00:18:16.365 killing process with pid 4005724 00:18:16.365 21:08:12 -- common/autotest_common.sh@955 -- # kill 4005724 00:18:16.365 Received shutdown signal, test time was about 10.000000 seconds 00:18:16.365 00:18:16.365 Latency(us) 00:18:16.365 [2024-11-27T20:08:12.606Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.365 [2024-11-27T20:08:12.606Z] =================================================================================================================== 00:18:16.365 [2024-11-27T20:08:12.606Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:16.365 21:08:12 -- common/autotest_common.sh@960 -- # wait 4005724 00:18:16.623 21:08:12 -- target/tls.sh@209 -- # killprocess 4005417 00:18:16.623 21:08:12 -- common/autotest_common.sh@936 -- # '[' -z 4005417 ']' 00:18:16.623 21:08:12 -- common/autotest_common.sh@940 -- # kill -0 4005417 00:18:16.623 21:08:12 -- common/autotest_common.sh@941 -- # uname 00:18:16.623 21:08:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.881 21:08:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4005417 00:18:16.881 21:08:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:16.881 21:08:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:16.881 21:08:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4005417' 00:18:16.881 killing process with pid 4005417 00:18:16.881 21:08:12 -- common/autotest_common.sh@955 -- # kill 4005417 00:18:16.881 21:08:12 -- common/autotest_common.sh@960 -- # wait 4005417 00:18:17.139 21:08:13 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:17.140 21:08:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:17.140 21:08:13 -- target/tls.sh@212 -- # echo '{ 00:18:17.140 "subsystems": [ 00:18:17.140 { 00:18:17.140 "subsystem": "iobuf", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "iobuf_set_options", 00:18:17.140 "params": { 00:18:17.140 "small_pool_count": 8192, 00:18:17.140 "large_pool_count": 1024, 00:18:17.140 "small_bufsize": 8192, 00:18:17.140 "large_bufsize": 135168 00:18:17.140 } 00:18:17.140 } 00:18:17.140 ] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "sock", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "sock_impl_set_options", 00:18:17.140 "params": { 00:18:17.140 "impl_name": "posix", 00:18:17.140 "recv_buf_size": 2097152, 00:18:17.140 "send_buf_size": 2097152, 00:18:17.140 "enable_recv_pipe": true, 00:18:17.140 "enable_quickack": false, 00:18:17.140 "enable_placement_id": 0, 00:18:17.140 "enable_zerocopy_send_server": true, 00:18:17.140 "enable_zerocopy_send_client": false, 00:18:17.140 "zerocopy_threshold": 0, 00:18:17.140 "tls_version": 0, 00:18:17.140 "enable_ktls": false 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "sock_impl_set_options", 00:18:17.140 "params": { 00:18:17.140 "impl_name": "ssl", 00:18:17.140 "recv_buf_size": 4096, 00:18:17.140 "send_buf_size": 4096, 00:18:17.140 "enable_recv_pipe": true, 00:18:17.140 "enable_quickack": false, 00:18:17.140 "enable_placement_id": 0, 00:18:17.140 "enable_zerocopy_send_server": true, 00:18:17.140 "enable_zerocopy_send_client": false, 00:18:17.140 "zerocopy_threshold": 0, 00:18:17.140 "tls_version": 0, 00:18:17.140 "enable_ktls": false 00:18:17.140 } 00:18:17.140 } 00:18:17.140 ] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "vmd", 00:18:17.140 "config": [] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "accel", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "accel_set_options", 00:18:17.140 "params": { 00:18:17.140 "small_cache_size": 128, 00:18:17.140 "large_cache_size": 16, 00:18:17.140 "task_count": 2048, 00:18:17.140 "sequence_count": 2048, 00:18:17.140 "buf_count": 2048 00:18:17.140 } 00:18:17.140 } 00:18:17.140 ] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "bdev", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "bdev_set_options", 00:18:17.140 "params": { 00:18:17.140 "bdev_io_pool_size": 65535, 00:18:17.140 "bdev_io_cache_size": 256, 00:18:17.140 "bdev_auto_examine": true, 00:18:17.140 "iobuf_small_cache_size": 128, 00:18:17.140 "iobuf_large_cache_size": 16 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_raid_set_options", 00:18:17.140 "params": { 00:18:17.140 "process_window_size_kb": 1024 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_iscsi_set_options", 00:18:17.140 "params": { 00:18:17.140 "timeout_sec": 30 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_nvme_set_options", 00:18:17.140 "params": { 00:18:17.140 "action_on_timeout": "none", 00:18:17.140 "timeout_us": 0, 00:18:17.140 "timeout_admin_us": 0, 00:18:17.140 "keep_alive_timeout_ms": 10000, 00:18:17.140 "transport_retry_count": 4, 00:18:17.140 "arbitration_burst": 0, 00:18:17.140 "low_priority_weight": 0, 00:18:17.140 "medium_priority_weight": 0, 00:18:17.140 "high_priority_weight": 0, 00:18:17.140 "nvme_adminq_poll_period_us": 10000, 00:18:17.140 "nvme_ioq_poll_period_us": 0, 00:18:17.140 "io_queue_requests": 0, 00:18:17.140 "delay_cmd_submit": true, 00:18:17.140 "bdev_retry_count": 3, 00:18:17.140 "transport_ack_timeout": 0, 00:18:17.140 "ctrlr_loss_timeout_sec": 0, 00:18:17.140 "reconnect_delay_sec": 0, 00:18:17.140 "fast_io_fail_timeout_sec": 0, 00:18:17.140 "generate_uuids": false, 00:18:17.140 "transport_tos": 0, 00:18:17.140 "io_path_stat": false, 00:18:17.140 "allow_accel_sequence": false 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_nvme_set_hotplug", 00:18:17.140 "params": { 00:18:17.140 "period_us": 100000, 00:18:17.140 "enable": false 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_malloc_create", 00:18:17.140 "params": { 00:18:17.140 "name": "malloc0", 00:18:17.140 "num_blocks": 8192, 00:18:17.140 "block_size": 4096, 00:18:17.140 "physical_block_size": 4096, 00:18:17.140 "uuid": "015cb494-229f-4d5e-909f-9cd746ce4aaa", 00:18:17.140 "optimal_io_boundary": 0 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "bdev_wait_for_examine" 00:18:17.140 } 00:18:17.140 ] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "nbd", 00:18:17.140 "config": [] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "scheduler", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "framework_set_scheduler", 00:18:17.140 "params": { 00:18:17.140 "name": "static" 00:18:17.140 } 00:18:17.140 } 00:18:17.140 ] 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "subsystem": "nvmf", 00:18:17.140 "config": [ 00:18:17.140 { 00:18:17.140 "method": "nvmf_set_config", 00:18:17.140 "params": { 00:18:17.140 "discovery_filter": "match_any", 00:18:17.140 "admin_cmd_passthru": { 00:18:17.140 "identify_ctrlr": false 00:18:17.140 } 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_set_max_subsystems", 00:18:17.140 "params": { 00:18:17.140 "max_subsystems": 1024 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_set_crdt", 00:18:17.140 "params": { 00:18:17.140 "crdt1": 0, 00:18:17.140 "crdt2": 0, 00:18:17.140 "crdt3": 0 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_create_transport", 00:18:17.140 "params": { 00:18:17.140 "trtype": "TCP", 00:18:17.140 "max_queue_depth": 128, 00:18:17.140 "max_io_qpairs_per_ctrlr": 127, 00:18:17.140 "in_capsule_data_size": 4096, 00:18:17.140 "max_io_size": 131072, 00:18:17.140 "io_unit_size": 131072, 00:18:17.140 "max_aq_depth": 128, 00:18:17.140 "num_shared_buffers": 511, 00:18:17.140 "buf_cache_size": 4294967295, 00:18:17.140 "dif_insert_or_strip": false, 00:18:17.140 "zcopy": false, 00:18:17.140 "c2h_success": false, 00:18:17.140 "sock_priority": 0, 00:18:17.140 "abort_timeout_sec": 1 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_create_subsystem", 00:18:17.140 "params": { 00:18:17.140 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.140 "allow_any_host": false, 00:18:17.140 "serial_number": "SPDK00000000000001", 00:18:17.140 "model_number": "SPDK bdev Controller", 00:18:17.140 "max_namespaces": 10, 00:18:17.140 "min_cntlid": 1, 00:18:17.140 "max_cntlid": 65519, 00:18:17.140 "ana_reporting": false 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_subsystem_add_host", 00:18:17.140 "params": { 00:18:17.140 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.140 "host": "nqn.2016-06.io.spdk:host1", 00:18:17.140 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:17.140 } 00:18:17.140 }, 00:18:17.140 { 00:18:17.140 "method": "nvmf_subsystem_add_ns", 00:18:17.140 "params": { 00:18:17.141 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.141 "namespace": { 00:18:17.141 "nsid": 1, 00:18:17.141 "bdev_name": "malloc0", 00:18:17.141 "nguid": "015CB494229F4D5E909F9CD746CE4AAA", 00:18:17.141 "uuid": "015cb494-229f-4d5e-909f-9cd746ce4aaa" 00:18:17.141 } 00:18:17.141 } 00:18:17.141 }, 00:18:17.141 { 00:18:17.141 "method": "nvmf_subsystem_add_listener", 00:18:17.141 "params": { 00:18:17.141 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.141 "listen_address": { 00:18:17.141 "trtype": "TCP", 00:18:17.141 "adrfam": "IPv4", 00:18:17.141 "traddr": "10.0.0.2", 00:18:17.141 "trsvcid": "4420" 00:18:17.141 }, 00:18:17.141 "secure_channel": true 00:18:17.141 } 00:18:17.141 } 00:18:17.141 ] 00:18:17.141 } 00:18:17.141 ] 00:18:17.141 }' 00:18:17.141 21:08:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:17.141 21:08:13 -- common/autotest_common.sh@10 -- # set +x 00:18:17.141 21:08:13 -- nvmf/common.sh@469 -- # nvmfpid=4006021 00:18:17.141 21:08:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:17.141 21:08:13 -- nvmf/common.sh@470 -- # waitforlisten 4006021 00:18:17.141 21:08:13 -- common/autotest_common.sh@829 -- # '[' -z 4006021 ']' 00:18:17.141 21:08:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.141 21:08:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.141 21:08:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.141 21:08:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.141 21:08:13 -- common/autotest_common.sh@10 -- # set +x 00:18:17.141 [2024-11-27 21:08:13.214892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.141 [2024-11-27 21:08:13.214959] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.141 [2024-11-27 21:08:13.281690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.399 [2024-11-27 21:08:13.399375] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:17.399 [2024-11-27 21:08:13.399543] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.399 [2024-11-27 21:08:13.399564] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.399 [2024-11-27 21:08:13.399578] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.400 [2024-11-27 21:08:13.399615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.400 [2024-11-27 21:08:13.631396] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.658 [2024-11-27 21:08:13.663414] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:17.658 [2024-11-27 21:08:13.663692] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.225 21:08:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:18.225 21:08:14 -- common/autotest_common.sh@862 -- # return 0 00:18:18.225 21:08:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:18.225 21:08:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:18.225 21:08:14 -- common/autotest_common.sh@10 -- # set +x 00:18:18.225 21:08:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:18.225 21:08:14 -- target/tls.sh@216 -- # bdevperf_pid=4006179 00:18:18.225 21:08:14 -- target/tls.sh@217 -- # waitforlisten 4006179 /var/tmp/bdevperf.sock 00:18:18.225 21:08:14 -- common/autotest_common.sh@829 -- # '[' -z 4006179 ']' 00:18:18.225 21:08:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.225 21:08:14 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:18.225 21:08:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.225 21:08:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.225 21:08:14 -- target/tls.sh@213 -- # echo '{ 00:18:18.225 "subsystems": [ 00:18:18.225 { 00:18:18.225 "subsystem": "iobuf", 00:18:18.225 "config": [ 00:18:18.225 { 00:18:18.225 "method": "iobuf_set_options", 00:18:18.225 "params": { 00:18:18.225 "small_pool_count": 8192, 00:18:18.225 "large_pool_count": 1024, 00:18:18.225 "small_bufsize": 8192, 00:18:18.225 "large_bufsize": 135168 00:18:18.225 } 00:18:18.225 } 00:18:18.225 ] 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "subsystem": "sock", 00:18:18.225 "config": [ 00:18:18.225 { 00:18:18.225 "method": "sock_impl_set_options", 00:18:18.225 "params": { 00:18:18.225 "impl_name": "posix", 00:18:18.225 "recv_buf_size": 2097152, 00:18:18.225 "send_buf_size": 2097152, 00:18:18.225 "enable_recv_pipe": true, 00:18:18.225 "enable_quickack": false, 00:18:18.225 "enable_placement_id": 0, 00:18:18.225 "enable_zerocopy_send_server": true, 00:18:18.225 "enable_zerocopy_send_client": false, 00:18:18.225 "zerocopy_threshold": 0, 00:18:18.225 "tls_version": 0, 00:18:18.225 "enable_ktls": false 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "sock_impl_set_options", 00:18:18.225 "params": { 00:18:18.225 "impl_name": "ssl", 00:18:18.225 "recv_buf_size": 4096, 00:18:18.225 "send_buf_size": 4096, 00:18:18.225 "enable_recv_pipe": true, 00:18:18.225 "enable_quickack": false, 00:18:18.225 "enable_placement_id": 0, 00:18:18.225 "enable_zerocopy_send_server": true, 00:18:18.225 "enable_zerocopy_send_client": false, 00:18:18.225 "zerocopy_threshold": 0, 00:18:18.225 "tls_version": 0, 00:18:18.225 "enable_ktls": false 00:18:18.225 } 00:18:18.225 } 00:18:18.225 ] 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "subsystem": "vmd", 00:18:18.225 "config": [] 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "subsystem": "accel", 00:18:18.225 "config": [ 00:18:18.225 { 00:18:18.225 "method": "accel_set_options", 00:18:18.225 "params": { 00:18:18.225 "small_cache_size": 128, 00:18:18.225 "large_cache_size": 16, 00:18:18.225 "task_count": 2048, 00:18:18.225 "sequence_count": 2048, 00:18:18.225 "buf_count": 2048 00:18:18.225 } 00:18:18.225 } 00:18:18.225 ] 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "subsystem": "bdev", 00:18:18.225 "config": [ 00:18:18.225 { 00:18:18.225 "method": "bdev_set_options", 00:18:18.225 "params": { 00:18:18.225 "bdev_io_pool_size": 65535, 00:18:18.225 "bdev_io_cache_size": 256, 00:18:18.225 "bdev_auto_examine": true, 00:18:18.225 "iobuf_small_cache_size": 128, 00:18:18.225 "iobuf_large_cache_size": 16 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_raid_set_options", 00:18:18.225 "params": { 00:18:18.225 "process_window_size_kb": 1024 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_iscsi_set_options", 00:18:18.225 "params": { 00:18:18.225 "timeout_sec": 30 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_nvme_set_options", 00:18:18.225 "params": { 00:18:18.225 "action_on_timeout": "none", 00:18:18.225 "timeout_us": 0, 00:18:18.225 "timeout_admin_us": 0, 00:18:18.225 "keep_alive_timeout_ms": 10000, 00:18:18.225 "transport_retry_count": 4, 00:18:18.225 "arbitration_burst": 0, 00:18:18.225 "low_priority_weight": 0, 00:18:18.225 "medium_priority_weight": 0, 00:18:18.225 "high_priority_weight": 0, 00:18:18.225 "nvme_adminq_poll_period_us": 10000, 00:18:18.225 "nvme_ioq_poll_period_us": 0, 00:18:18.225 "io_queue_requests": 512, 00:18:18.225 "delay_cmd_submit": true, 00:18:18.225 "bdev_retry_count": 3, 00:18:18.225 "transport_ack_timeout": 0, 00:18:18.225 "ctrlr_loss_timeout_sec": 0, 00:18:18.225 "reconnect_delay_sec": 0, 00:18:18.225 "fast_io_fail_timeout_sec": 0, 00:18:18.225 "generate_uuids": false, 00:18:18.225 "transport_tos": 0, 00:18:18.225 "io_path_stat": false, 00:18:18.225 "allow_accel_sequence": false 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_nvme_attach_controller", 00:18:18.225 "params": { 00:18:18.225 "name": "TLSTEST", 00:18:18.225 "trtype": "TCP", 00:18:18.225 "adrfam": "IPv4", 00:18:18.225 "traddr": "10.0.0.2", 00:18:18.225 "trsvcid": "4420", 00:18:18.225 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.225 "prchk_reftag": false, 00:18:18.225 "prchk_guard": false, 00:18:18.225 "ctrlr_loss_timeout_sec": 0, 00:18:18.225 "reconnect_delay_sec": 0, 00:18:18.225 "fast_io_fail_timeout_sec": 0, 00:18:18.225 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:18.225 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.225 "hdgst": false, 00:18:18.225 "ddgst": false 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_nvme_set_hotplug", 00:18:18.225 "params": { 00:18:18.225 "period_us": 100000, 00:18:18.225 "enable": false 00:18:18.225 } 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "method": "bdev_wait_for_examine" 00:18:18.225 } 00:18:18.225 ] 00:18:18.225 }, 00:18:18.225 { 00:18:18.225 "subsystem": "nbd", 00:18:18.225 "config": [] 00:18:18.225 } 00:18:18.225 ] 00:18:18.225 }' 00:18:18.225 21:08:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.225 21:08:14 -- common/autotest_common.sh@10 -- # set +x 00:18:18.225 [2024-11-27 21:08:14.247101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.225 [2024-11-27 21:08:14.247175] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4006179 ] 00:18:18.225 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.225 [2024-11-27 21:08:14.302788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.225 [2024-11-27 21:08:14.412087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.484 [2024-11-27 21:08:14.577367] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:19.051 21:08:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:19.051 21:08:15 -- common/autotest_common.sh@862 -- # return 0 00:18:19.051 21:08:15 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:19.309 Running I/O for 10 seconds... 00:18:29.273 00:18:29.273 Latency(us) 00:18:29.273 [2024-11-27T20:08:25.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.273 [2024-11-27T20:08:25.514Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:29.273 Verification LBA range: start 0x0 length 0x2000 00:18:29.273 TLSTESTn1 : 10.01 3983.85 15.56 0.00 0.00 32087.30 5339.97 41943.04 00:18:29.273 [2024-11-27T20:08:25.514Z] =================================================================================================================== 00:18:29.273 [2024-11-27T20:08:25.514Z] Total : 3983.85 15.56 0.00 0.00 32087.30 5339.97 41943.04 00:18:29.273 0 00:18:29.273 21:08:25 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:29.273 21:08:25 -- target/tls.sh@223 -- # killprocess 4006179 00:18:29.273 21:08:25 -- common/autotest_common.sh@936 -- # '[' -z 4006179 ']' 00:18:29.273 21:08:25 -- common/autotest_common.sh@940 -- # kill -0 4006179 00:18:29.273 21:08:25 -- common/autotest_common.sh@941 -- # uname 00:18:29.273 21:08:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:29.273 21:08:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4006179 00:18:29.273 21:08:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:29.273 21:08:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:29.273 21:08:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4006179' 00:18:29.273 killing process with pid 4006179 00:18:29.273 21:08:25 -- common/autotest_common.sh@955 -- # kill 4006179 00:18:29.273 Received shutdown signal, test time was about 10.000000 seconds 00:18:29.273 00:18:29.273 Latency(us) 00:18:29.273 [2024-11-27T20:08:25.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:29.273 [2024-11-27T20:08:25.514Z] =================================================================================================================== 00:18:29.273 [2024-11-27T20:08:25.514Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:29.273 21:08:25 -- common/autotest_common.sh@960 -- # wait 4006179 00:18:29.532 21:08:25 -- target/tls.sh@224 -- # killprocess 4006021 00:18:29.532 21:08:25 -- common/autotest_common.sh@936 -- # '[' -z 4006021 ']' 00:18:29.532 21:08:25 -- common/autotest_common.sh@940 -- # kill -0 4006021 00:18:29.532 21:08:25 -- common/autotest_common.sh@941 -- # uname 00:18:29.532 21:08:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:29.532 21:08:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4006021 00:18:29.532 21:08:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:29.532 21:08:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:29.532 21:08:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4006021' 00:18:29.532 killing process with pid 4006021 00:18:29.532 21:08:25 -- common/autotest_common.sh@955 -- # kill 4006021 00:18:29.532 21:08:25 -- common/autotest_common.sh@960 -- # wait 4006021 00:18:29.790 21:08:26 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:29.790 21:08:26 -- target/tls.sh@227 -- # cleanup 00:18:29.790 21:08:26 -- target/tls.sh@15 -- # process_shm --id 0 00:18:29.790 21:08:26 -- common/autotest_common.sh@806 -- # type=--id 00:18:29.790 21:08:26 -- common/autotest_common.sh@807 -- # id=0 00:18:29.790 21:08:26 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:29.790 21:08:26 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:29.790 21:08:26 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:29.790 21:08:26 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:29.790 21:08:26 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:29.790 21:08:26 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:29.790 nvmf_trace.0 00:18:30.049 21:08:26 -- common/autotest_common.sh@821 -- # return 0 00:18:30.049 21:08:26 -- target/tls.sh@16 -- # killprocess 4006179 00:18:30.049 21:08:26 -- common/autotest_common.sh@936 -- # '[' -z 4006179 ']' 00:18:30.049 21:08:26 -- common/autotest_common.sh@940 -- # kill -0 4006179 00:18:30.049 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4006179) - No such process 00:18:30.049 21:08:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4006179 is not found' 00:18:30.049 Process with pid 4006179 is not found 00:18:30.049 21:08:26 -- target/tls.sh@17 -- # nvmftestfini 00:18:30.049 21:08:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:30.049 21:08:26 -- nvmf/common.sh@116 -- # sync 00:18:30.049 21:08:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:30.049 21:08:26 -- nvmf/common.sh@119 -- # set +e 00:18:30.049 21:08:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:30.049 21:08:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:30.049 rmmod nvme_tcp 00:18:30.049 rmmod nvme_fabrics 00:18:30.049 rmmod nvme_keyring 00:18:30.049 21:08:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:30.049 21:08:26 -- nvmf/common.sh@123 -- # set -e 00:18:30.049 21:08:26 -- nvmf/common.sh@124 -- # return 0 00:18:30.049 21:08:26 -- nvmf/common.sh@477 -- # '[' -n 4006021 ']' 00:18:30.049 21:08:26 -- nvmf/common.sh@478 -- # killprocess 4006021 00:18:30.049 21:08:26 -- common/autotest_common.sh@936 -- # '[' -z 4006021 ']' 00:18:30.049 21:08:26 -- common/autotest_common.sh@940 -- # kill -0 4006021 00:18:30.049 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4006021) - No such process 00:18:30.049 21:08:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4006021 is not found' 00:18:30.049 Process with pid 4006021 is not found 00:18:30.049 21:08:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:30.049 21:08:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:30.049 21:08:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:30.049 21:08:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:30.049 21:08:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:30.049 21:08:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.049 21:08:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.049 21:08:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:31.954 21:08:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:31.955 21:08:28 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:31.955 00:18:31.955 real 1m16.511s 00:18:31.955 user 1m56.972s 00:18:31.955 sys 0m25.447s 00:18:31.955 21:08:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:31.955 21:08:28 -- common/autotest_common.sh@10 -- # set +x 00:18:31.955 ************************************ 00:18:31.955 END TEST nvmf_tls 00:18:31.955 ************************************ 00:18:31.955 21:08:28 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:31.955 21:08:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:31.955 21:08:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:31.955 21:08:28 -- common/autotest_common.sh@10 -- # set +x 00:18:31.955 ************************************ 00:18:31.955 START TEST nvmf_fips 00:18:31.955 ************************************ 00:18:31.955 21:08:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:32.213 * Looking for test storage... 00:18:32.213 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:32.213 21:08:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:32.213 21:08:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:32.213 21:08:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:32.213 21:08:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:32.213 21:08:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:32.213 21:08:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:32.213 21:08:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:32.213 21:08:28 -- scripts/common.sh@335 -- # IFS=.-: 00:18:32.213 21:08:28 -- scripts/common.sh@335 -- # read -ra ver1 00:18:32.213 21:08:28 -- scripts/common.sh@336 -- # IFS=.-: 00:18:32.213 21:08:28 -- scripts/common.sh@336 -- # read -ra ver2 00:18:32.213 21:08:28 -- scripts/common.sh@337 -- # local 'op=<' 00:18:32.213 21:08:28 -- scripts/common.sh@339 -- # ver1_l=2 00:18:32.213 21:08:28 -- scripts/common.sh@340 -- # ver2_l=1 00:18:32.213 21:08:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:32.213 21:08:28 -- scripts/common.sh@343 -- # case "$op" in 00:18:32.213 21:08:28 -- scripts/common.sh@344 -- # : 1 00:18:32.213 21:08:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:32.213 21:08:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:32.213 21:08:28 -- scripts/common.sh@364 -- # decimal 1 00:18:32.213 21:08:28 -- scripts/common.sh@352 -- # local d=1 00:18:32.213 21:08:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:32.213 21:08:28 -- scripts/common.sh@354 -- # echo 1 00:18:32.213 21:08:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:32.213 21:08:28 -- scripts/common.sh@365 -- # decimal 2 00:18:32.213 21:08:28 -- scripts/common.sh@352 -- # local d=2 00:18:32.213 21:08:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:32.213 21:08:28 -- scripts/common.sh@354 -- # echo 2 00:18:32.213 21:08:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:32.213 21:08:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:32.213 21:08:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:32.213 21:08:28 -- scripts/common.sh@367 -- # return 0 00:18:32.213 21:08:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:32.213 21:08:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:32.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.213 --rc genhtml_branch_coverage=1 00:18:32.213 --rc genhtml_function_coverage=1 00:18:32.213 --rc genhtml_legend=1 00:18:32.213 --rc geninfo_all_blocks=1 00:18:32.213 --rc geninfo_unexecuted_blocks=1 00:18:32.213 00:18:32.213 ' 00:18:32.213 21:08:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:32.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.213 --rc genhtml_branch_coverage=1 00:18:32.213 --rc genhtml_function_coverage=1 00:18:32.213 --rc genhtml_legend=1 00:18:32.213 --rc geninfo_all_blocks=1 00:18:32.213 --rc geninfo_unexecuted_blocks=1 00:18:32.213 00:18:32.213 ' 00:18:32.213 21:08:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:32.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.213 --rc genhtml_branch_coverage=1 00:18:32.213 --rc genhtml_function_coverage=1 00:18:32.213 --rc genhtml_legend=1 00:18:32.213 --rc geninfo_all_blocks=1 00:18:32.213 --rc geninfo_unexecuted_blocks=1 00:18:32.213 00:18:32.213 ' 00:18:32.213 21:08:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:32.213 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:32.213 --rc genhtml_branch_coverage=1 00:18:32.213 --rc genhtml_function_coverage=1 00:18:32.213 --rc genhtml_legend=1 00:18:32.213 --rc geninfo_all_blocks=1 00:18:32.213 --rc geninfo_unexecuted_blocks=1 00:18:32.213 00:18:32.213 ' 00:18:32.213 21:08:28 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:32.213 21:08:28 -- nvmf/common.sh@7 -- # uname -s 00:18:32.213 21:08:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:32.213 21:08:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:32.213 21:08:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:32.213 21:08:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:32.213 21:08:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:32.213 21:08:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:32.213 21:08:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:32.213 21:08:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:32.213 21:08:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:32.213 21:08:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:32.213 21:08:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.213 21:08:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:32.213 21:08:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:32.213 21:08:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:32.213 21:08:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:32.213 21:08:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:32.213 21:08:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:32.213 21:08:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:32.213 21:08:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:32.213 21:08:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.214 21:08:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.214 21:08:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.214 21:08:28 -- paths/export.sh@5 -- # export PATH 00:18:32.214 21:08:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:32.214 21:08:28 -- nvmf/common.sh@46 -- # : 0 00:18:32.214 21:08:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:32.214 21:08:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:32.214 21:08:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:32.214 21:08:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:32.214 21:08:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:32.214 21:08:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:32.214 21:08:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:32.214 21:08:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:32.214 21:08:28 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:32.214 21:08:28 -- fips/fips.sh@89 -- # check_openssl_version 00:18:32.214 21:08:28 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:32.214 21:08:28 -- fips/fips.sh@85 -- # openssl version 00:18:32.214 21:08:28 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:32.214 21:08:28 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:32.214 21:08:28 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:32.214 21:08:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:32.214 21:08:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:32.214 21:08:28 -- scripts/common.sh@335 -- # IFS=.-: 00:18:32.214 21:08:28 -- scripts/common.sh@335 -- # read -ra ver1 00:18:32.214 21:08:28 -- scripts/common.sh@336 -- # IFS=.-: 00:18:32.214 21:08:28 -- scripts/common.sh@336 -- # read -ra ver2 00:18:32.214 21:08:28 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:32.214 21:08:28 -- scripts/common.sh@339 -- # ver1_l=3 00:18:32.214 21:08:28 -- scripts/common.sh@340 -- # ver2_l=3 00:18:32.214 21:08:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:32.214 21:08:28 -- scripts/common.sh@343 -- # case "$op" in 00:18:32.214 21:08:28 -- scripts/common.sh@347 -- # : 1 00:18:32.214 21:08:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:32.214 21:08:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:32.214 21:08:28 -- scripts/common.sh@364 -- # decimal 3 00:18:32.214 21:08:28 -- scripts/common.sh@352 -- # local d=3 00:18:32.214 21:08:28 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:32.214 21:08:28 -- scripts/common.sh@354 -- # echo 3 00:18:32.214 21:08:28 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:32.214 21:08:28 -- scripts/common.sh@365 -- # decimal 3 00:18:32.214 21:08:28 -- scripts/common.sh@352 -- # local d=3 00:18:32.214 21:08:28 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:32.214 21:08:28 -- scripts/common.sh@354 -- # echo 3 00:18:32.214 21:08:28 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:32.214 21:08:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:32.214 21:08:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:32.214 21:08:28 -- scripts/common.sh@363 -- # (( v++ )) 00:18:32.214 21:08:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:32.214 21:08:28 -- scripts/common.sh@364 -- # decimal 1 00:18:32.214 21:08:28 -- scripts/common.sh@352 -- # local d=1 00:18:32.214 21:08:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:32.214 21:08:28 -- scripts/common.sh@354 -- # echo 1 00:18:32.214 21:08:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:32.214 21:08:28 -- scripts/common.sh@365 -- # decimal 0 00:18:32.214 21:08:28 -- scripts/common.sh@352 -- # local d=0 00:18:32.214 21:08:28 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:32.214 21:08:28 -- scripts/common.sh@354 -- # echo 0 00:18:32.214 21:08:28 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:32.214 21:08:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:32.214 21:08:28 -- scripts/common.sh@366 -- # return 0 00:18:32.214 21:08:28 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:32.214 21:08:28 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:32.214 21:08:28 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:32.214 21:08:28 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:32.214 21:08:28 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:32.214 21:08:28 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:32.214 21:08:28 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:32.214 21:08:28 -- fips/fips.sh@113 -- # build_openssl_config 00:18:32.214 21:08:28 -- fips/fips.sh@37 -- # cat 00:18:32.214 21:08:28 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:32.214 21:08:28 -- fips/fips.sh@58 -- # cat - 00:18:32.214 21:08:28 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:32.214 21:08:28 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:32.214 21:08:28 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:32.214 21:08:28 -- fips/fips.sh@116 -- # openssl list -providers 00:18:32.214 21:08:28 -- fips/fips.sh@116 -- # grep name 00:18:32.214 21:08:28 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:32.214 21:08:28 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:32.214 21:08:28 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:32.214 21:08:28 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:32.214 21:08:28 -- fips/fips.sh@127 -- # : 00:18:32.214 21:08:28 -- common/autotest_common.sh@650 -- # local es=0 00:18:32.214 21:08:28 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:32.214 21:08:28 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:32.214 21:08:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:32.214 21:08:28 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:32.214 21:08:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:32.214 21:08:28 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:32.214 21:08:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:32.214 21:08:28 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:32.473 21:08:28 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:32.473 21:08:28 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:32.473 Error setting digest 00:18:32.473 40629260647F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:32.473 40629260647F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:32.473 21:08:28 -- common/autotest_common.sh@653 -- # es=1 00:18:32.473 21:08:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:32.473 21:08:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:32.473 21:08:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:32.473 21:08:28 -- fips/fips.sh@130 -- # nvmftestinit 00:18:32.473 21:08:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:32.473 21:08:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:32.473 21:08:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:32.473 21:08:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:32.473 21:08:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:32.473 21:08:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:32.473 21:08:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:32.473 21:08:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:32.473 21:08:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:32.473 21:08:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:32.473 21:08:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:32.473 21:08:28 -- common/autotest_common.sh@10 -- # set +x 00:18:34.375 21:08:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:34.375 21:08:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:34.375 21:08:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:34.375 21:08:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:34.375 21:08:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:34.375 21:08:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:34.375 21:08:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:34.375 21:08:30 -- nvmf/common.sh@294 -- # net_devs=() 00:18:34.375 21:08:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:34.375 21:08:30 -- nvmf/common.sh@295 -- # e810=() 00:18:34.375 21:08:30 -- nvmf/common.sh@295 -- # local -ga e810 00:18:34.375 21:08:30 -- nvmf/common.sh@296 -- # x722=() 00:18:34.375 21:08:30 -- nvmf/common.sh@296 -- # local -ga x722 00:18:34.375 21:08:30 -- nvmf/common.sh@297 -- # mlx=() 00:18:34.375 21:08:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:34.375 21:08:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:34.375 21:08:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:34.375 21:08:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:34.375 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:34.375 21:08:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:34.375 21:08:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:34.375 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:34.375 21:08:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:34.375 21:08:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:34.375 21:08:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:34.375 21:08:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:34.375 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:34.375 21:08:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:34.375 21:08:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:34.375 21:08:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:34.375 21:08:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:34.375 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:34.375 21:08:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:34.375 21:08:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:34.375 21:08:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:34.375 21:08:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:34.375 21:08:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:34.375 21:08:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:34.375 21:08:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:34.375 21:08:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:34.375 21:08:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:34.375 21:08:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:34.375 21:08:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:34.375 21:08:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:34.375 21:08:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:34.375 21:08:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:34.375 21:08:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:34.375 21:08:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:34.375 21:08:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:34.375 21:08:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:34.375 21:08:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:34.375 21:08:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:34.375 21:08:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:34.375 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:34.375 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:18:34.375 00:18:34.375 --- 10.0.0.2 ping statistics --- 00:18:34.375 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:34.375 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:18:34.375 21:08:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:34.375 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:34.375 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:18:34.375 00:18:34.375 --- 10.0.0.1 ping statistics --- 00:18:34.375 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:34.375 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:18:34.375 21:08:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:34.375 21:08:30 -- nvmf/common.sh@410 -- # return 0 00:18:34.375 21:08:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:34.375 21:08:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:34.375 21:08:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:34.375 21:08:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:34.375 21:08:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:34.375 21:08:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:34.376 21:08:30 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:34.376 21:08:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:34.376 21:08:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:34.376 21:08:30 -- common/autotest_common.sh@10 -- # set +x 00:18:34.376 21:08:30 -- nvmf/common.sh@469 -- # nvmfpid=4009652 00:18:34.376 21:08:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:34.376 21:08:30 -- nvmf/common.sh@470 -- # waitforlisten 4009652 00:18:34.376 21:08:30 -- common/autotest_common.sh@829 -- # '[' -z 4009652 ']' 00:18:34.376 21:08:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:34.376 21:08:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:34.376 21:08:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:34.376 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:34.376 21:08:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:34.376 21:08:30 -- common/autotest_common.sh@10 -- # set +x 00:18:34.634 [2024-11-27 21:08:30.635369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:34.634 [2024-11-27 21:08:30.635459] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:34.634 EAL: No free 2048 kB hugepages reported on node 1 00:18:34.634 [2024-11-27 21:08:30.703456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:34.634 [2024-11-27 21:08:30.819995] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:34.634 [2024-11-27 21:08:30.820171] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:34.634 [2024-11-27 21:08:30.820193] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:34.634 [2024-11-27 21:08:30.820207] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:34.634 [2024-11-27 21:08:30.820247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:35.569 21:08:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:35.569 21:08:31 -- common/autotest_common.sh@862 -- # return 0 00:18:35.569 21:08:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:35.569 21:08:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:35.569 21:08:31 -- common/autotest_common.sh@10 -- # set +x 00:18:35.569 21:08:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:35.569 21:08:31 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:35.569 21:08:31 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:35.569 21:08:31 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:35.569 21:08:31 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:35.569 21:08:31 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:35.569 21:08:31 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:35.569 21:08:31 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:35.569 21:08:31 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:35.827 [2024-11-27 21:08:31.930017] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:35.827 [2024-11-27 21:08:31.945986] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:35.827 [2024-11-27 21:08:31.946208] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:35.827 malloc0 00:18:35.827 21:08:31 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:35.827 21:08:31 -- fips/fips.sh@147 -- # bdevperf_pid=4009814 00:18:35.827 21:08:31 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:35.827 21:08:31 -- fips/fips.sh@148 -- # waitforlisten 4009814 /var/tmp/bdevperf.sock 00:18:35.827 21:08:31 -- common/autotest_common.sh@829 -- # '[' -z 4009814 ']' 00:18:35.827 21:08:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:35.827 21:08:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:35.827 21:08:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:35.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:35.827 21:08:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:35.827 21:08:31 -- common/autotest_common.sh@10 -- # set +x 00:18:35.827 [2024-11-27 21:08:32.065164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:35.827 [2024-11-27 21:08:32.065272] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4009814 ] 00:18:36.086 EAL: No free 2048 kB hugepages reported on node 1 00:18:36.086 [2024-11-27 21:08:32.123213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:36.087 [2024-11-27 21:08:32.230745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:37.081 21:08:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:37.081 21:08:33 -- common/autotest_common.sh@862 -- # return 0 00:18:37.081 21:08:33 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:37.340 [2024-11-27 21:08:33.321744] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:37.340 TLSTESTn1 00:18:37.340 21:08:33 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:37.340 Running I/O for 10 seconds... 00:18:49.533 00:18:49.533 Latency(us) 00:18:49.533 [2024-11-27T20:08:45.774Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:49.533 [2024-11-27T20:08:45.774Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:49.533 Verification LBA range: start 0x0 length 0x2000 00:18:49.533 TLSTESTn1 : 10.04 4463.02 17.43 0.00 0.00 28629.54 7573.05 46409.20 00:18:49.533 [2024-11-27T20:08:45.774Z] =================================================================================================================== 00:18:49.533 [2024-11-27T20:08:45.774Z] Total : 4463.02 17.43 0.00 0.00 28629.54 7573.05 46409.20 00:18:49.533 0 00:18:49.533 21:08:43 -- fips/fips.sh@1 -- # cleanup 00:18:49.533 21:08:43 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:49.533 21:08:43 -- common/autotest_common.sh@806 -- # type=--id 00:18:49.533 21:08:43 -- common/autotest_common.sh@807 -- # id=0 00:18:49.533 21:08:43 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:49.533 21:08:43 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:49.533 21:08:43 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:49.533 21:08:43 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:49.533 21:08:43 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:49.533 21:08:43 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:49.533 nvmf_trace.0 00:18:49.533 21:08:43 -- common/autotest_common.sh@821 -- # return 0 00:18:49.533 21:08:43 -- fips/fips.sh@16 -- # killprocess 4009814 00:18:49.533 21:08:43 -- common/autotest_common.sh@936 -- # '[' -z 4009814 ']' 00:18:49.533 21:08:43 -- common/autotest_common.sh@940 -- # kill -0 4009814 00:18:49.533 21:08:43 -- common/autotest_common.sh@941 -- # uname 00:18:49.533 21:08:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:49.533 21:08:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4009814 00:18:49.533 21:08:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:49.533 21:08:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:49.533 21:08:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4009814' 00:18:49.533 killing process with pid 4009814 00:18:49.533 21:08:43 -- common/autotest_common.sh@955 -- # kill 4009814 00:18:49.533 Received shutdown signal, test time was about 10.000000 seconds 00:18:49.533 00:18:49.533 Latency(us) 00:18:49.534 [2024-11-27T20:08:45.775Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:49.534 [2024-11-27T20:08:45.775Z] =================================================================================================================== 00:18:49.534 [2024-11-27T20:08:45.775Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:49.534 21:08:43 -- common/autotest_common.sh@960 -- # wait 4009814 00:18:49.534 21:08:43 -- fips/fips.sh@17 -- # nvmftestfini 00:18:49.534 21:08:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:49.534 21:08:43 -- nvmf/common.sh@116 -- # sync 00:18:49.534 21:08:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:49.534 21:08:43 -- nvmf/common.sh@119 -- # set +e 00:18:49.534 21:08:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:49.534 21:08:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:49.534 rmmod nvme_tcp 00:18:49.534 rmmod nvme_fabrics 00:18:49.534 rmmod nvme_keyring 00:18:49.534 21:08:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:49.534 21:08:44 -- nvmf/common.sh@123 -- # set -e 00:18:49.534 21:08:44 -- nvmf/common.sh@124 -- # return 0 00:18:49.534 21:08:44 -- nvmf/common.sh@477 -- # '[' -n 4009652 ']' 00:18:49.534 21:08:44 -- nvmf/common.sh@478 -- # killprocess 4009652 00:18:49.534 21:08:44 -- common/autotest_common.sh@936 -- # '[' -z 4009652 ']' 00:18:49.534 21:08:44 -- common/autotest_common.sh@940 -- # kill -0 4009652 00:18:49.534 21:08:44 -- common/autotest_common.sh@941 -- # uname 00:18:49.534 21:08:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:49.534 21:08:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4009652 00:18:49.534 21:08:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:49.534 21:08:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:49.534 21:08:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4009652' 00:18:49.534 killing process with pid 4009652 00:18:49.534 21:08:44 -- common/autotest_common.sh@955 -- # kill 4009652 00:18:49.534 21:08:44 -- common/autotest_common.sh@960 -- # wait 4009652 00:18:49.534 21:08:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:49.534 21:08:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:49.534 21:08:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:49.534 21:08:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:49.534 21:08:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:49.534 21:08:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:49.534 21:08:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:49.534 21:08:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:50.471 21:08:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:50.471 21:08:46 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:50.471 00:18:50.471 real 0m18.203s 00:18:50.471 user 0m24.060s 00:18:50.471 sys 0m5.896s 00:18:50.471 21:08:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:50.471 21:08:46 -- common/autotest_common.sh@10 -- # set +x 00:18:50.471 ************************************ 00:18:50.471 END TEST nvmf_fips 00:18:50.471 ************************************ 00:18:50.471 21:08:46 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:50.471 21:08:46 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:50.471 21:08:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:50.471 21:08:46 -- common/autotest_common.sh@10 -- # set +x 00:18:50.471 ************************************ 00:18:50.471 START TEST nvmf_fuzz 00:18:50.471 ************************************ 00:18:50.471 21:08:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:50.471 * Looking for test storage... 00:18:50.471 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:50.471 21:08:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:50.471 21:08:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:50.471 21:08:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:50.471 21:08:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:50.471 21:08:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:50.471 21:08:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:50.471 21:08:46 -- scripts/common.sh@335 -- # IFS=.-: 00:18:50.471 21:08:46 -- scripts/common.sh@335 -- # read -ra ver1 00:18:50.471 21:08:46 -- scripts/common.sh@336 -- # IFS=.-: 00:18:50.471 21:08:46 -- scripts/common.sh@336 -- # read -ra ver2 00:18:50.471 21:08:46 -- scripts/common.sh@337 -- # local 'op=<' 00:18:50.471 21:08:46 -- scripts/common.sh@339 -- # ver1_l=2 00:18:50.471 21:08:46 -- scripts/common.sh@340 -- # ver2_l=1 00:18:50.471 21:08:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:50.471 21:08:46 -- scripts/common.sh@343 -- # case "$op" in 00:18:50.471 21:08:46 -- scripts/common.sh@344 -- # : 1 00:18:50.471 21:08:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:50.471 21:08:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:50.471 21:08:46 -- scripts/common.sh@364 -- # decimal 1 00:18:50.471 21:08:46 -- scripts/common.sh@352 -- # local d=1 00:18:50.471 21:08:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:50.471 21:08:46 -- scripts/common.sh@354 -- # echo 1 00:18:50.471 21:08:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:50.471 21:08:46 -- scripts/common.sh@365 -- # decimal 2 00:18:50.471 21:08:46 -- scripts/common.sh@352 -- # local d=2 00:18:50.471 21:08:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:50.471 21:08:46 -- scripts/common.sh@354 -- # echo 2 00:18:50.471 21:08:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:50.471 21:08:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:50.471 21:08:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:50.471 21:08:46 -- scripts/common.sh@367 -- # return 0 00:18:50.471 21:08:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:50.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:50.471 --rc genhtml_branch_coverage=1 00:18:50.471 --rc genhtml_function_coverage=1 00:18:50.471 --rc genhtml_legend=1 00:18:50.471 --rc geninfo_all_blocks=1 00:18:50.471 --rc geninfo_unexecuted_blocks=1 00:18:50.471 00:18:50.471 ' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:50.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:50.471 --rc genhtml_branch_coverage=1 00:18:50.471 --rc genhtml_function_coverage=1 00:18:50.471 --rc genhtml_legend=1 00:18:50.471 --rc geninfo_all_blocks=1 00:18:50.471 --rc geninfo_unexecuted_blocks=1 00:18:50.471 00:18:50.471 ' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:50.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:50.471 --rc genhtml_branch_coverage=1 00:18:50.471 --rc genhtml_function_coverage=1 00:18:50.471 --rc genhtml_legend=1 00:18:50.471 --rc geninfo_all_blocks=1 00:18:50.471 --rc geninfo_unexecuted_blocks=1 00:18:50.471 00:18:50.471 ' 00:18:50.471 21:08:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:50.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:50.471 --rc genhtml_branch_coverage=1 00:18:50.471 --rc genhtml_function_coverage=1 00:18:50.471 --rc genhtml_legend=1 00:18:50.471 --rc geninfo_all_blocks=1 00:18:50.471 --rc geninfo_unexecuted_blocks=1 00:18:50.471 00:18:50.471 ' 00:18:50.471 21:08:46 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:50.471 21:08:46 -- nvmf/common.sh@7 -- # uname -s 00:18:50.471 21:08:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:50.471 21:08:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:50.471 21:08:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:50.471 21:08:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:50.471 21:08:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:50.471 21:08:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:50.471 21:08:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:50.471 21:08:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:50.471 21:08:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:50.471 21:08:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:50.471 21:08:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:50.472 21:08:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:50.472 21:08:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:50.472 21:08:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:50.472 21:08:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:50.472 21:08:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:50.472 21:08:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:50.472 21:08:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:50.472 21:08:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:50.472 21:08:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:50.472 21:08:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:50.472 21:08:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:50.472 21:08:46 -- paths/export.sh@5 -- # export PATH 00:18:50.472 21:08:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:50.472 21:08:46 -- nvmf/common.sh@46 -- # : 0 00:18:50.472 21:08:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:50.472 21:08:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:50.472 21:08:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:50.472 21:08:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:50.472 21:08:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:50.472 21:08:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:50.472 21:08:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:50.472 21:08:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:50.472 21:08:46 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:50.472 21:08:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:50.472 21:08:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:50.472 21:08:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:50.472 21:08:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:50.472 21:08:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:50.472 21:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:50.472 21:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:50.472 21:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:50.472 21:08:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:50.472 21:08:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:50.472 21:08:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:50.472 21:08:46 -- common/autotest_common.sh@10 -- # set +x 00:18:52.375 21:08:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:52.375 21:08:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:52.375 21:08:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:52.375 21:08:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:52.375 21:08:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:52.375 21:08:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:52.375 21:08:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:52.375 21:08:48 -- nvmf/common.sh@294 -- # net_devs=() 00:18:52.375 21:08:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:52.375 21:08:48 -- nvmf/common.sh@295 -- # e810=() 00:18:52.375 21:08:48 -- nvmf/common.sh@295 -- # local -ga e810 00:18:52.375 21:08:48 -- nvmf/common.sh@296 -- # x722=() 00:18:52.375 21:08:48 -- nvmf/common.sh@296 -- # local -ga x722 00:18:52.375 21:08:48 -- nvmf/common.sh@297 -- # mlx=() 00:18:52.375 21:08:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:52.375 21:08:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:52.375 21:08:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:52.375 21:08:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:52.375 21:08:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:52.375 21:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:52.375 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:52.375 21:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:52.375 21:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:52.375 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:52.375 21:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:52.375 21:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:52.375 21:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:52.375 21:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:52.375 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:52.375 21:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:52.375 21:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:52.375 21:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:52.375 21:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:52.375 21:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:52.375 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:52.375 21:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:52.375 21:08:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:52.375 21:08:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:52.375 21:08:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:52.375 21:08:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:52.375 21:08:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:52.375 21:08:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:52.375 21:08:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:52.375 21:08:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:52.375 21:08:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:52.375 21:08:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:52.375 21:08:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:52.375 21:08:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:52.375 21:08:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:52.375 21:08:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:52.375 21:08:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:52.375 21:08:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:52.375 21:08:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:52.375 21:08:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:52.375 21:08:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:52.375 21:08:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:52.634 21:08:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:52.634 21:08:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:52.634 21:08:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:52.634 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:52.634 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:18:52.634 00:18:52.634 --- 10.0.0.2 ping statistics --- 00:18:52.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:52.634 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:18:52.634 21:08:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:52.634 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:52.634 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:18:52.634 00:18:52.634 --- 10.0.0.1 ping statistics --- 00:18:52.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:52.634 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:18:52.634 21:08:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:52.634 21:08:48 -- nvmf/common.sh@410 -- # return 0 00:18:52.634 21:08:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:52.634 21:08:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:52.634 21:08:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:52.634 21:08:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:52.634 21:08:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:52.634 21:08:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:52.634 21:08:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:52.634 21:08:48 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=4013261 00:18:52.634 21:08:48 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:52.634 21:08:48 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 4013261 00:18:52.634 21:08:48 -- common/autotest_common.sh@829 -- # '[' -z 4013261 ']' 00:18:52.634 21:08:48 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:52.634 21:08:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:52.634 21:08:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:52.634 21:08:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:52.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:52.634 21:08:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:52.634 21:08:48 -- common/autotest_common.sh@10 -- # set +x 00:18:53.568 21:08:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:53.568 21:08:49 -- common/autotest_common.sh@862 -- # return 0 00:18:53.568 21:08:49 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:53.568 21:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.568 21:08:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.568 21:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.568 21:08:49 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:53.568 21:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.568 21:08:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.568 Malloc0 00:18:53.568 21:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.568 21:08:49 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:53.568 21:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.568 21:08:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.568 21:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.568 21:08:49 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:53.568 21:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.568 21:08:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.569 21:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.569 21:08:49 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:53.569 21:08:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.569 21:08:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.569 21:08:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.569 21:08:49 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:53.569 21:08:49 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:25.629 Fuzzing completed. Shutting down the fuzz application 00:19:25.629 00:19:25.629 Dumping successful admin opcodes: 00:19:25.629 8, 9, 10, 24, 00:19:25.629 Dumping successful io opcodes: 00:19:25.629 0, 9, 00:19:25.629 NS: 0x200003aeff00 I/O qp, Total commands completed: 464286, total successful commands: 2684, random_seed: 1579367872 00:19:25.630 NS: 0x200003aeff00 admin qp, Total commands completed: 57520, total successful commands: 461, random_seed: 1244505664 00:19:25.630 21:09:20 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:25.888 Fuzzing completed. Shutting down the fuzz application 00:19:25.888 00:19:25.888 Dumping successful admin opcodes: 00:19:25.888 24, 00:19:25.888 Dumping successful io opcodes: 00:19:25.888 00:19:25.888 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1008251184 00:19:25.888 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1008399832 00:19:25.888 21:09:21 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:25.888 21:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.888 21:09:21 -- common/autotest_common.sh@10 -- # set +x 00:19:25.888 21:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.888 21:09:21 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:25.888 21:09:21 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:25.888 21:09:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:25.888 21:09:21 -- nvmf/common.sh@116 -- # sync 00:19:25.888 21:09:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:25.888 21:09:21 -- nvmf/common.sh@119 -- # set +e 00:19:25.888 21:09:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:25.888 21:09:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:25.888 rmmod nvme_tcp 00:19:25.888 rmmod nvme_fabrics 00:19:25.888 rmmod nvme_keyring 00:19:25.888 21:09:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:25.888 21:09:21 -- nvmf/common.sh@123 -- # set -e 00:19:25.888 21:09:21 -- nvmf/common.sh@124 -- # return 0 00:19:25.888 21:09:21 -- nvmf/common.sh@477 -- # '[' -n 4013261 ']' 00:19:25.888 21:09:21 -- nvmf/common.sh@478 -- # killprocess 4013261 00:19:25.888 21:09:21 -- common/autotest_common.sh@936 -- # '[' -z 4013261 ']' 00:19:25.888 21:09:21 -- common/autotest_common.sh@940 -- # kill -0 4013261 00:19:25.888 21:09:21 -- common/autotest_common.sh@941 -- # uname 00:19:25.888 21:09:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:25.888 21:09:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4013261 00:19:25.888 21:09:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:25.888 21:09:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:25.888 21:09:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4013261' 00:19:25.888 killing process with pid 4013261 00:19:25.888 21:09:21 -- common/autotest_common.sh@955 -- # kill 4013261 00:19:25.888 21:09:21 -- common/autotest_common.sh@960 -- # wait 4013261 00:19:26.146 21:09:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:26.146 21:09:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:26.146 21:09:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:26.146 21:09:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:26.146 21:09:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:26.146 21:09:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.146 21:09:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.146 21:09:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.683 21:09:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:28.683 21:09:24 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:28.683 00:19:28.683 real 0m37.938s 00:19:28.683 user 0m52.859s 00:19:28.683 sys 0m15.102s 00:19:28.683 21:09:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:28.683 21:09:24 -- common/autotest_common.sh@10 -- # set +x 00:19:28.683 ************************************ 00:19:28.683 END TEST nvmf_fuzz 00:19:28.683 ************************************ 00:19:28.683 21:09:24 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:28.683 21:09:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:28.683 21:09:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:28.683 21:09:24 -- common/autotest_common.sh@10 -- # set +x 00:19:28.683 ************************************ 00:19:28.683 START TEST nvmf_multiconnection 00:19:28.684 ************************************ 00:19:28.684 21:09:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:28.684 * Looking for test storage... 00:19:28.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:28.684 21:09:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:28.684 21:09:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:28.684 21:09:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:28.684 21:09:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:28.684 21:09:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:28.684 21:09:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:28.684 21:09:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:28.684 21:09:24 -- scripts/common.sh@335 -- # IFS=.-: 00:19:28.684 21:09:24 -- scripts/common.sh@335 -- # read -ra ver1 00:19:28.684 21:09:24 -- scripts/common.sh@336 -- # IFS=.-: 00:19:28.684 21:09:24 -- scripts/common.sh@336 -- # read -ra ver2 00:19:28.684 21:09:24 -- scripts/common.sh@337 -- # local 'op=<' 00:19:28.684 21:09:24 -- scripts/common.sh@339 -- # ver1_l=2 00:19:28.684 21:09:24 -- scripts/common.sh@340 -- # ver2_l=1 00:19:28.684 21:09:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:28.684 21:09:24 -- scripts/common.sh@343 -- # case "$op" in 00:19:28.684 21:09:24 -- scripts/common.sh@344 -- # : 1 00:19:28.684 21:09:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:28.684 21:09:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:28.684 21:09:24 -- scripts/common.sh@364 -- # decimal 1 00:19:28.684 21:09:24 -- scripts/common.sh@352 -- # local d=1 00:19:28.684 21:09:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:28.684 21:09:24 -- scripts/common.sh@354 -- # echo 1 00:19:28.684 21:09:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:28.684 21:09:24 -- scripts/common.sh@365 -- # decimal 2 00:19:28.684 21:09:24 -- scripts/common.sh@352 -- # local d=2 00:19:28.684 21:09:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:28.684 21:09:24 -- scripts/common.sh@354 -- # echo 2 00:19:28.684 21:09:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:28.684 21:09:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:28.684 21:09:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:28.684 21:09:24 -- scripts/common.sh@367 -- # return 0 00:19:28.684 21:09:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:28.684 21:09:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:28.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.684 --rc genhtml_branch_coverage=1 00:19:28.684 --rc genhtml_function_coverage=1 00:19:28.684 --rc genhtml_legend=1 00:19:28.684 --rc geninfo_all_blocks=1 00:19:28.684 --rc geninfo_unexecuted_blocks=1 00:19:28.684 00:19:28.684 ' 00:19:28.684 21:09:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:28.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.684 --rc genhtml_branch_coverage=1 00:19:28.684 --rc genhtml_function_coverage=1 00:19:28.684 --rc genhtml_legend=1 00:19:28.684 --rc geninfo_all_blocks=1 00:19:28.684 --rc geninfo_unexecuted_blocks=1 00:19:28.684 00:19:28.684 ' 00:19:28.684 21:09:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:28.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.684 --rc genhtml_branch_coverage=1 00:19:28.684 --rc genhtml_function_coverage=1 00:19:28.684 --rc genhtml_legend=1 00:19:28.684 --rc geninfo_all_blocks=1 00:19:28.684 --rc geninfo_unexecuted_blocks=1 00:19:28.684 00:19:28.684 ' 00:19:28.684 21:09:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:28.684 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.684 --rc genhtml_branch_coverage=1 00:19:28.684 --rc genhtml_function_coverage=1 00:19:28.684 --rc genhtml_legend=1 00:19:28.684 --rc geninfo_all_blocks=1 00:19:28.684 --rc geninfo_unexecuted_blocks=1 00:19:28.684 00:19:28.684 ' 00:19:28.684 21:09:24 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:28.684 21:09:24 -- nvmf/common.sh@7 -- # uname -s 00:19:28.684 21:09:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:28.684 21:09:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:28.684 21:09:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:28.684 21:09:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:28.684 21:09:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:28.684 21:09:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:28.684 21:09:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:28.684 21:09:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:28.684 21:09:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:28.684 21:09:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:28.684 21:09:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.684 21:09:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.684 21:09:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:28.684 21:09:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:28.684 21:09:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:28.684 21:09:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:28.684 21:09:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:28.684 21:09:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:28.684 21:09:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:28.684 21:09:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.684 21:09:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.684 21:09:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.684 21:09:24 -- paths/export.sh@5 -- # export PATH 00:19:28.684 21:09:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.684 21:09:24 -- nvmf/common.sh@46 -- # : 0 00:19:28.684 21:09:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:28.684 21:09:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:28.684 21:09:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:28.684 21:09:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:28.684 21:09:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:28.684 21:09:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:28.684 21:09:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:28.684 21:09:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:28.684 21:09:24 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:28.684 21:09:24 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:28.684 21:09:24 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:28.684 21:09:24 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:28.684 21:09:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:28.684 21:09:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:28.684 21:09:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:28.684 21:09:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:28.684 21:09:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:28.684 21:09:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:28.684 21:09:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:28.684 21:09:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.684 21:09:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:28.684 21:09:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:28.684 21:09:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:28.684 21:09:24 -- common/autotest_common.sh@10 -- # set +x 00:19:30.587 21:09:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:30.587 21:09:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:30.587 21:09:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:30.587 21:09:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:30.587 21:09:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:30.587 21:09:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:30.587 21:09:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:30.587 21:09:26 -- nvmf/common.sh@294 -- # net_devs=() 00:19:30.587 21:09:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:30.587 21:09:26 -- nvmf/common.sh@295 -- # e810=() 00:19:30.587 21:09:26 -- nvmf/common.sh@295 -- # local -ga e810 00:19:30.587 21:09:26 -- nvmf/common.sh@296 -- # x722=() 00:19:30.587 21:09:26 -- nvmf/common.sh@296 -- # local -ga x722 00:19:30.587 21:09:26 -- nvmf/common.sh@297 -- # mlx=() 00:19:30.587 21:09:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:30.587 21:09:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:30.587 21:09:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:30.587 21:09:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:30.587 21:09:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:30.587 21:09:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.587 21:09:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:30.587 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:30.587 21:09:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.587 21:09:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.588 21:09:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:30.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:30.588 21:09:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:30.588 21:09:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.588 21:09:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.588 21:09:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.588 21:09:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.588 21:09:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:30.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:30.588 21:09:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.588 21:09:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.588 21:09:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.588 21:09:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.588 21:09:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.588 21:09:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:30.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:30.588 21:09:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.588 21:09:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:30.588 21:09:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:30.588 21:09:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:30.588 21:09:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:30.588 21:09:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:30.588 21:09:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:30.588 21:09:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:30.588 21:09:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:30.588 21:09:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:30.588 21:09:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:30.588 21:09:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:30.588 21:09:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:30.588 21:09:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:30.588 21:09:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:30.588 21:09:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:30.588 21:09:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:30.588 21:09:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:30.588 21:09:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:30.588 21:09:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:30.588 21:09:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:30.588 21:09:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:30.588 21:09:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:30.588 21:09:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:30.588 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:30.588 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:19:30.588 00:19:30.588 --- 10.0.0.2 ping statistics --- 00:19:30.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.588 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:19:30.588 21:09:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:30.588 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:30.588 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.059 ms 00:19:30.588 00:19:30.588 --- 10.0.0.1 ping statistics --- 00:19:30.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.588 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:19:30.588 21:09:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:30.588 21:09:26 -- nvmf/common.sh@410 -- # return 0 00:19:30.588 21:09:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:30.588 21:09:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:30.588 21:09:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:30.588 21:09:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:30.588 21:09:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:30.588 21:09:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:30.588 21:09:26 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:30.588 21:09:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:30.588 21:09:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:30.588 21:09:26 -- common/autotest_common.sh@10 -- # set +x 00:19:30.588 21:09:26 -- nvmf/common.sh@469 -- # nvmfpid=4019759 00:19:30.588 21:09:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:30.588 21:09:26 -- nvmf/common.sh@470 -- # waitforlisten 4019759 00:19:30.588 21:09:26 -- common/autotest_common.sh@829 -- # '[' -z 4019759 ']' 00:19:30.588 21:09:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:30.588 21:09:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:30.588 21:09:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:30.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:30.588 21:09:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:30.588 21:09:26 -- common/autotest_common.sh@10 -- # set +x 00:19:30.588 [2024-11-27 21:09:26.801312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:30.588 [2024-11-27 21:09:26.801387] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:30.846 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.846 [2024-11-27 21:09:26.872875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:30.846 [2024-11-27 21:09:26.994050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:30.846 [2024-11-27 21:09:26.994229] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:30.846 [2024-11-27 21:09:26.994250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:30.846 [2024-11-27 21:09:26.994264] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:30.846 [2024-11-27 21:09:26.994336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:30.846 [2024-11-27 21:09:26.994366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:30.846 [2024-11-27 21:09:26.994392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:30.846 [2024-11-27 21:09:26.994396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:31.780 21:09:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:31.780 21:09:27 -- common/autotest_common.sh@862 -- # return 0 00:19:31.780 21:09:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:31.780 21:09:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:31.780 21:09:27 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 [2024-11-27 21:09:27.827164] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:31.780 21:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.780 21:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 Malloc1 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 [2024-11-27 21:09:27.882955] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.780 21:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 Malloc2 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.780 21:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 Malloc3 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:27 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.780 21:09:27 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:31.780 21:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:27 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 Malloc4 00:19:31.780 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:31.780 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:31.780 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.780 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:31.780 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.780 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.039 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 Malloc5 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.039 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 Malloc6 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.039 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 Malloc7 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.039 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 Malloc8 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.039 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 Malloc9 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.039 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:32.039 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.039 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.039 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.040 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:32.040 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.040 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.298 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.298 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:32.298 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.298 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.298 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.298 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.298 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:32.298 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.298 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.298 Malloc10 00:19:32.298 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.298 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:32.298 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.298 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.298 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.298 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:32.298 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.298 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.298 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.298 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:32.299 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.299 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.299 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.299 21:09:28 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.299 21:09:28 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:32.299 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.299 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.299 Malloc11 00:19:32.299 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.299 21:09:28 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:32.299 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.299 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.299 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.299 21:09:28 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:32.299 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.299 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.299 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.299 21:09:28 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:32.299 21:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.299 21:09:28 -- common/autotest_common.sh@10 -- # set +x 00:19:32.299 21:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.299 21:09:28 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:32.299 21:09:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.299 21:09:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:32.864 21:09:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:32.864 21:09:29 -- common/autotest_common.sh@1187 -- # local i=0 00:19:32.864 21:09:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.864 21:09:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:32.864 21:09:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.397 21:09:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.397 21:09:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.397 21:09:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:35.397 21:09:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:35.397 21:09:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.397 21:09:31 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.397 21:09:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.397 21:09:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:35.655 21:09:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:35.655 21:09:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.655 21:09:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.655 21:09:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.655 21:09:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.554 21:09:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.554 21:09:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.554 21:09:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:37.554 21:09:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.554 21:09:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.554 21:09:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.554 21:09:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.554 21:09:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:38.484 21:09:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:38.484 21:09:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:38.484 21:09:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.484 21:09:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:38.484 21:09:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:40.380 21:09:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:40.380 21:09:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:40.380 21:09:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:40.380 21:09:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:40.380 21:09:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.380 21:09:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:40.380 21:09:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.380 21:09:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:41.366 21:09:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:41.366 21:09:37 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.366 21:09:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.366 21:09:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.366 21:09:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:43.262 21:09:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:43.262 21:09:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:43.262 21:09:39 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:43.262 21:09:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:43.262 21:09:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:43.262 21:09:39 -- common/autotest_common.sh@1197 -- # return 0 00:19:43.262 21:09:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:43.262 21:09:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:43.827 21:09:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:43.827 21:09:40 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.827 21:09:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.827 21:09:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.827 21:09:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.351 21:09:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.351 21:09:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.351 21:09:42 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:46.351 21:09:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:46.351 21:09:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.351 21:09:42 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.351 21:09:42 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:46.351 21:09:42 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:46.917 21:09:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:46.917 21:09:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.917 21:09:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.917 21:09:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.917 21:09:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.816 21:09:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.816 21:09:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.816 21:09:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:48.816 21:09:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.816 21:09:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.816 21:09:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.816 21:09:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.816 21:09:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:49.749 21:09:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:49.749 21:09:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.749 21:09:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.749 21:09:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.749 21:09:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.646 21:09:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.647 21:09:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.647 21:09:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:51.647 21:09:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.647 21:09:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.647 21:09:47 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.647 21:09:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.647 21:09:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:52.212 21:09:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:52.212 21:09:48 -- common/autotest_common.sh@1187 -- # local i=0 00:19:52.212 21:09:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.212 21:09:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:52.212 21:09:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:54.745 21:09:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:54.745 21:09:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:54.745 21:09:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:54.745 21:09:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:54.745 21:09:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.745 21:09:50 -- common/autotest_common.sh@1197 -- # return 0 00:19:54.745 21:09:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.746 21:09:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:55.310 21:09:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:55.310 21:09:51 -- common/autotest_common.sh@1187 -- # local i=0 00:19:55.310 21:09:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.310 21:09:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:55.310 21:09:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:57.207 21:09:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:57.207 21:09:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:57.207 21:09:53 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:57.207 21:09:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:57.207 21:09:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.207 21:09:53 -- common/autotest_common.sh@1197 -- # return 0 00:19:57.207 21:09:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.207 21:09:53 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:58.140 21:09:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:58.140 21:09:54 -- common/autotest_common.sh@1187 -- # local i=0 00:19:58.140 21:09:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:58.140 21:09:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:58.140 21:09:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:00.034 21:09:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:00.034 21:09:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:00.034 21:09:56 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:00.034 21:09:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:00.034 21:09:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:00.034 21:09:56 -- common/autotest_common.sh@1197 -- # return 0 00:20:00.034 21:09:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:00.034 21:09:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:00.965 21:09:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:00.965 21:09:57 -- common/autotest_common.sh@1187 -- # local i=0 00:20:00.965 21:09:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:00.965 21:09:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:00.965 21:09:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:02.861 21:09:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:02.861 21:09:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:02.861 21:09:59 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:02.861 21:09:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:02.861 21:09:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:02.861 21:09:59 -- common/autotest_common.sh@1197 -- # return 0 00:20:02.861 21:09:59 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:02.861 [global] 00:20:02.861 thread=1 00:20:02.861 invalidate=1 00:20:02.861 rw=read 00:20:02.861 time_based=1 00:20:02.861 runtime=10 00:20:02.861 ioengine=libaio 00:20:02.861 direct=1 00:20:02.861 bs=262144 00:20:02.861 iodepth=64 00:20:02.861 norandommap=1 00:20:02.861 numjobs=1 00:20:02.861 00:20:02.861 [job0] 00:20:02.861 filename=/dev/nvme0n1 00:20:02.861 [job1] 00:20:02.861 filename=/dev/nvme10n1 00:20:02.861 [job2] 00:20:02.861 filename=/dev/nvme1n1 00:20:02.861 [job3] 00:20:02.861 filename=/dev/nvme2n1 00:20:02.861 [job4] 00:20:02.861 filename=/dev/nvme3n1 00:20:02.861 [job5] 00:20:02.861 filename=/dev/nvme4n1 00:20:02.861 [job6] 00:20:02.861 filename=/dev/nvme5n1 00:20:02.861 [job7] 00:20:02.861 filename=/dev/nvme6n1 00:20:02.861 [job8] 00:20:02.861 filename=/dev/nvme7n1 00:20:02.861 [job9] 00:20:02.861 filename=/dev/nvme8n1 00:20:02.861 [job10] 00:20:02.861 filename=/dev/nvme9n1 00:20:03.118 Could not set queue depth (nvme0n1) 00:20:03.118 Could not set queue depth (nvme10n1) 00:20:03.118 Could not set queue depth (nvme1n1) 00:20:03.118 Could not set queue depth (nvme2n1) 00:20:03.118 Could not set queue depth (nvme3n1) 00:20:03.118 Could not set queue depth (nvme4n1) 00:20:03.118 Could not set queue depth (nvme5n1) 00:20:03.118 Could not set queue depth (nvme6n1) 00:20:03.118 Could not set queue depth (nvme7n1) 00:20:03.118 Could not set queue depth (nvme8n1) 00:20:03.118 Could not set queue depth (nvme9n1) 00:20:03.118 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.118 fio-3.35 00:20:03.118 Starting 11 threads 00:20:15.318 00:20:15.318 job0: (groupid=0, jobs=1): err= 0: pid=4024270: Wed Nov 27 21:10:09 2024 00:20:15.318 read: IOPS=596, BW=149MiB/s (156MB/s)(1510MiB/10126msec) 00:20:15.318 slat (usec): min=10, max=86875, avg=1476.32, stdev=4731.40 00:20:15.318 clat (usec): min=671, max=279914, avg=105674.06, stdev=44807.93 00:20:15.318 lat (usec): min=695, max=279927, avg=107150.38, stdev=45458.95 00:20:15.318 clat percentiles (msec): 00:20:15.318 | 1.00th=[ 6], 5.00th=[ 39], 10.00th=[ 54], 20.00th=[ 66], 00:20:15.319 | 30.00th=[ 78], 40.00th=[ 89], 50.00th=[ 104], 60.00th=[ 118], 00:20:15.319 | 70.00th=[ 136], 80.00th=[ 148], 90.00th=[ 161], 95.00th=[ 174], 00:20:15.319 | 99.00th=[ 220], 99.50th=[ 243], 99.90th=[ 264], 99.95th=[ 271], 00:20:15.319 | 99.99th=[ 279] 00:20:15.319 bw ( KiB/s): min=90624, max=287232, per=7.77%, avg=152991.55, stdev=56481.70, samples=20 00:20:15.319 iops : min= 354, max= 1122, avg=597.60, stdev=220.63, samples=20 00:20:15.319 lat (usec) : 750=0.03%, 1000=0.03% 00:20:15.319 lat (msec) : 2=0.41%, 4=0.23%, 10=0.96%, 20=0.94%, 50=5.78% 00:20:15.319 lat (msec) : 100=39.58%, 250=51.60%, 500=0.43% 00:20:15.319 cpu : usr=0.26%, sys=2.10%, ctx=1307, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=6041,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job1: (groupid=0, jobs=1): err= 0: pid=4024271: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=480, BW=120MiB/s (126MB/s)(1217MiB/10120msec) 00:20:15.319 slat (usec): min=13, max=87370, avg=1715.27, stdev=5579.49 00:20:15.319 clat (msec): min=7, max=257, avg=131.25, stdev=35.45 00:20:15.319 lat (msec): min=7, max=264, avg=132.96, stdev=36.31 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 25], 5.00th=[ 64], 10.00th=[ 85], 20.00th=[ 109], 00:20:15.319 | 30.00th=[ 120], 40.00th=[ 126], 50.00th=[ 134], 60.00th=[ 144], 00:20:15.319 | 70.00th=[ 150], 80.00th=[ 159], 90.00th=[ 174], 95.00th=[ 182], 00:20:15.319 | 99.00th=[ 199], 99.50th=[ 211], 99.90th=[ 257], 99.95th=[ 257], 00:20:15.319 | 99.99th=[ 257] 00:20:15.319 bw ( KiB/s): min=89088, max=167936, per=6.24%, avg=122929.75, stdev=19247.32, samples=20 00:20:15.319 iops : min= 348, max= 656, avg=480.10, stdev=75.18, samples=20 00:20:15.319 lat (msec) : 10=0.06%, 20=0.76%, 50=2.05%, 100=13.27%, 250=83.67% 00:20:15.319 lat (msec) : 500=0.18% 00:20:15.319 cpu : usr=0.24%, sys=1.80%, ctx=1037, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=4867,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job2: (groupid=0, jobs=1): err= 0: pid=4024272: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=580, BW=145MiB/s (152MB/s)(1476MiB/10167msec) 00:20:15.319 slat (usec): min=13, max=84193, avg=1488.77, stdev=4845.99 00:20:15.319 clat (msec): min=4, max=313, avg=108.66, stdev=44.43 00:20:15.319 lat (msec): min=4, max=313, avg=110.15, stdev=45.15 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 14], 5.00th=[ 39], 10.00th=[ 53], 20.00th=[ 68], 00:20:15.319 | 30.00th=[ 83], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 124], 00:20:15.319 | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 167], 95.00th=[ 178], 00:20:15.319 | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 292], 99.95th=[ 292], 00:20:15.319 | 99.99th=[ 313] 00:20:15.319 bw ( KiB/s): min=97474, max=240128, per=7.58%, avg=149413.80, stdev=46344.54, samples=20 00:20:15.319 iops : min= 380, max= 938, avg=583.60, stdev=181.07, samples=20 00:20:15.319 lat (msec) : 10=0.49%, 20=1.61%, 50=6.10%, 100=38.02%, 250=53.52% 00:20:15.319 lat (msec) : 500=0.25% 00:20:15.319 cpu : usr=0.50%, sys=1.89%, ctx=1251, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=5902,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job3: (groupid=0, jobs=1): err= 0: pid=4024273: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=616, BW=154MiB/s (162MB/s)(1554MiB/10083msec) 00:20:15.319 slat (usec): min=9, max=63936, avg=1357.74, stdev=4403.50 00:20:15.319 clat (msec): min=2, max=226, avg=102.40, stdev=46.21 00:20:15.319 lat (msec): min=2, max=232, avg=103.76, stdev=46.97 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 7], 5.00th=[ 32], 10.00th=[ 48], 20.00th=[ 57], 00:20:15.319 | 30.00th=[ 69], 40.00th=[ 85], 50.00th=[ 102], 60.00th=[ 116], 00:20:15.319 | 70.00th=[ 132], 80.00th=[ 150], 90.00th=[ 165], 95.00th=[ 176], 00:20:15.319 | 99.00th=[ 190], 99.50th=[ 197], 99.90th=[ 213], 99.95th=[ 220], 00:20:15.319 | 99.99th=[ 228] 00:20:15.319 bw ( KiB/s): min=91976, max=274944, per=7.99%, avg=157423.40, stdev=58034.83, samples=20 00:20:15.319 iops : min= 359, max= 1074, avg=614.90, stdev=226.70, samples=20 00:20:15.319 lat (msec) : 4=0.14%, 10=1.64%, 20=1.71%, 50=8.24%, 100=37.82% 00:20:15.319 lat (msec) : 250=50.45% 00:20:15.319 cpu : usr=0.31%, sys=2.12%, ctx=1232, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=6214,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job4: (groupid=0, jobs=1): err= 0: pid=4024274: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=829, BW=207MiB/s (218MB/s)(2092MiB/10082msec) 00:20:15.319 slat (usec): min=11, max=63364, avg=1109.28, stdev=3559.51 00:20:15.319 clat (msec): min=4, max=210, avg=75.93, stdev=35.73 00:20:15.319 lat (msec): min=4, max=210, avg=77.04, stdev=36.27 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 49], 00:20:15.319 | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 69], 60.00th=[ 75], 00:20:15.319 | 70.00th=[ 84], 80.00th=[ 101], 90.00th=[ 133], 95.00th=[ 155], 00:20:15.319 | 99.00th=[ 171], 99.50th=[ 180], 99.90th=[ 194], 99.95th=[ 203], 00:20:15.319 | 99.99th=[ 211] 00:20:15.319 bw ( KiB/s): min=100864, max=494080, per=10.79%, avg=212512.05, stdev=86937.41, samples=20 00:20:15.319 iops : min= 394, max= 1930, avg=830.05, stdev=339.57, samples=20 00:20:15.319 lat (msec) : 10=0.13%, 20=0.42%, 50=20.82%, 100=58.60%, 250=20.03% 00:20:15.319 cpu : usr=0.47%, sys=2.82%, ctx=1577, majf=0, minf=4098 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=8368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job5: (groupid=0, jobs=1): err= 0: pid=4024275: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=824, BW=206MiB/s (216MB/s)(2064MiB/10010msec) 00:20:15.319 slat (usec): min=9, max=137784, avg=974.53, stdev=4345.17 00:20:15.319 clat (usec): min=1419, max=272406, avg=76554.60, stdev=43104.38 00:20:15.319 lat (usec): min=1476, max=322885, avg=77529.12, stdev=43685.14 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 14], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 47], 00:20:15.319 | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 71], 00:20:15.319 | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 155], 95.00th=[ 167], 00:20:15.319 | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 222], 99.95th=[ 224], 00:20:15.319 | 99.99th=[ 271] 00:20:15.319 bw ( KiB/s): min=90443, max=313344, per=10.22%, avg=201287.74, stdev=80237.53, samples=19 00:20:15.319 iops : min= 353, max= 1224, avg=786.26, stdev=313.45, samples=19 00:20:15.319 lat (msec) : 2=0.04%, 10=0.31%, 20=1.41%, 50=25.68%, 100=51.94% 00:20:15.319 lat (msec) : 250=20.62%, 500=0.01% 00:20:15.319 cpu : usr=0.41%, sys=2.70%, ctx=1630, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=8256,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job6: (groupid=0, jobs=1): err= 0: pid=4024276: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=657, BW=164MiB/s (172MB/s)(1665MiB/10128msec) 00:20:15.319 slat (usec): min=10, max=66890, avg=1387.86, stdev=4433.58 00:20:15.319 clat (msec): min=7, max=261, avg=95.88, stdev=48.87 00:20:15.319 lat (msec): min=7, max=261, avg=97.26, stdev=49.66 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 26], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 56], 00:20:15.319 | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 97], 00:20:15.319 | 70.00th=[ 121], 80.00th=[ 148], 90.00th=[ 171], 95.00th=[ 184], 00:20:15.319 | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 251], 99.95th=[ 251], 00:20:15.319 | 99.99th=[ 262] 00:20:15.319 bw ( KiB/s): min=87377, max=367104, per=8.57%, avg=168765.85, stdev=81222.75, samples=20 00:20:15.319 iops : min= 341, max= 1434, avg=659.20, stdev=317.29, samples=20 00:20:15.319 lat (msec) : 10=0.02%, 20=0.42%, 50=16.78%, 100=44.34%, 250=38.33% 00:20:15.319 lat (msec) : 500=0.12% 00:20:15.319 cpu : usr=0.35%, sys=2.15%, ctx=1234, majf=0, minf=4097 00:20:15.319 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:15.319 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.319 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.319 issued rwts: total=6658,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.319 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.319 job7: (groupid=0, jobs=1): err= 0: pid=4024277: Wed Nov 27 21:10:09 2024 00:20:15.319 read: IOPS=918, BW=230MiB/s (241MB/s)(2315MiB/10085msec) 00:20:15.319 slat (usec): min=13, max=106010, avg=999.31, stdev=3812.30 00:20:15.319 clat (msec): min=2, max=266, avg=68.65, stdev=40.37 00:20:15.319 lat (msec): min=2, max=299, avg=69.65, stdev=40.98 00:20:15.319 clat percentiles (msec): 00:20:15.319 | 1.00th=[ 7], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 32], 00:20:15.319 | 30.00th=[ 39], 40.00th=[ 54], 50.00th=[ 64], 60.00th=[ 71], 00:20:15.319 | 70.00th=[ 81], 80.00th=[ 95], 90.00th=[ 126], 95.00th=[ 157], 00:20:15.319 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 222], 99.95th=[ 241], 00:20:15.319 | 99.99th=[ 268] 00:20:15.319 bw ( KiB/s): min=84311, max=536576, per=11.95%, avg=235341.80, stdev=100102.10, samples=20 00:20:15.319 iops : min= 329, max= 2096, avg=919.25, stdev=391.07, samples=20 00:20:15.319 lat (msec) : 4=0.22%, 10=1.56%, 20=1.86%, 50=33.69%, 100=44.97% 00:20:15.319 lat (msec) : 250=17.68%, 500=0.03% 00:20:15.320 cpu : usr=0.48%, sys=3.09%, ctx=1779, majf=0, minf=3724 00:20:15.320 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:15.320 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.320 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.320 issued rwts: total=9259,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.320 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.320 job8: (groupid=0, jobs=1): err= 0: pid=4024278: Wed Nov 27 21:10:09 2024 00:20:15.320 read: IOPS=618, BW=155MiB/s (162MB/s)(1564MiB/10121msec) 00:20:15.320 slat (usec): min=9, max=109351, avg=1048.88, stdev=4733.29 00:20:15.320 clat (usec): min=712, max=256848, avg=102429.72, stdev=48467.30 00:20:15.320 lat (usec): min=738, max=279627, avg=103478.60, stdev=49077.85 00:20:15.320 clat percentiles (msec): 00:20:15.320 | 1.00th=[ 6], 5.00th=[ 30], 10.00th=[ 48], 20.00th=[ 60], 00:20:15.320 | 30.00th=[ 72], 40.00th=[ 83], 50.00th=[ 92], 60.00th=[ 112], 00:20:15.320 | 70.00th=[ 131], 80.00th=[ 157], 90.00th=[ 171], 95.00th=[ 184], 00:20:15.320 | 99.00th=[ 203], 99.50th=[ 218], 99.90th=[ 239], 99.95th=[ 253], 00:20:15.320 | 99.99th=[ 257] 00:20:15.320 bw ( KiB/s): min=95232, max=254976, per=8.04%, avg=158449.50, stdev=48285.12, samples=20 00:20:15.320 iops : min= 372, max= 996, avg=618.90, stdev=188.59, samples=20 00:20:15.320 lat (usec) : 750=0.03%, 1000=0.03% 00:20:15.320 lat (msec) : 2=0.14%, 4=0.54%, 10=1.71%, 20=1.07%, 50=7.31% 00:20:15.320 lat (msec) : 100=43.79%, 250=45.28%, 500=0.10% 00:20:15.320 cpu : usr=0.18%, sys=1.52%, ctx=1423, majf=0, minf=4097 00:20:15.320 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.320 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.320 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.320 issued rwts: total=6255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.320 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.320 job9: (groupid=0, jobs=1): err= 0: pid=4024279: Wed Nov 27 21:10:09 2024 00:20:15.320 read: IOPS=613, BW=153MiB/s (161MB/s)(1554MiB/10124msec) 00:20:15.320 slat (usec): min=9, max=120182, avg=1255.88, stdev=4956.99 00:20:15.320 clat (usec): min=1146, max=305879, avg=102927.08, stdev=43947.86 00:20:15.320 lat (usec): min=1176, max=305894, avg=104182.96, stdev=44572.64 00:20:15.320 clat percentiles (msec): 00:20:15.320 | 1.00th=[ 10], 5.00th=[ 37], 10.00th=[ 53], 20.00th=[ 69], 00:20:15.320 | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 108], 00:20:15.320 | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 169], 95.00th=[ 184], 00:20:15.320 | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 255], 99.95th=[ 271], 00:20:15.320 | 99.99th=[ 305] 00:20:15.320 bw ( KiB/s): min=96574, max=278016, per=7.99%, avg=157397.50, stdev=53689.56, samples=20 00:20:15.320 iops : min= 377, max= 1086, avg=614.75, stdev=209.73, samples=20 00:20:15.320 lat (msec) : 2=0.13%, 4=0.45%, 10=0.43%, 20=1.13%, 50=7.05% 00:20:15.320 lat (msec) : 100=44.19%, 250=46.51%, 500=0.11% 00:20:15.320 cpu : usr=0.30%, sys=1.71%, ctx=1388, majf=0, minf=4097 00:20:15.320 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.320 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.320 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.320 issued rwts: total=6214,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.320 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.320 job10: (groupid=0, jobs=1): err= 0: pid=4024280: Wed Nov 27 21:10:09 2024 00:20:15.320 read: IOPS=1012, BW=253MiB/s (266MB/s)(2553MiB/10081msec) 00:20:15.320 slat (usec): min=13, max=103513, avg=919.39, stdev=2923.38 00:20:15.320 clat (msec): min=2, max=218, avg=62.20, stdev=25.58 00:20:15.320 lat (msec): min=2, max=218, avg=63.12, stdev=25.89 00:20:15.320 clat percentiles (msec): 00:20:15.320 | 1.00th=[ 12], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 38], 00:20:15.320 | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 62], 60.00th=[ 67], 00:20:15.320 | 70.00th=[ 74], 80.00th=[ 83], 90.00th=[ 95], 95.00th=[ 105], 00:20:15.320 | 99.00th=[ 126], 99.50th=[ 169], 99.90th=[ 199], 99.95th=[ 207], 00:20:15.320 | 99.99th=[ 207] 00:20:15.320 bw ( KiB/s): min=176128, max=417792, per=13.18%, avg=259724.50, stdev=62112.44, samples=20 00:20:15.320 iops : min= 688, max= 1632, avg=1014.50, stdev=242.63, samples=20 00:20:15.320 lat (msec) : 4=0.11%, 10=0.73%, 20=1.18%, 50=30.54%, 100=60.72% 00:20:15.320 lat (msec) : 250=6.73% 00:20:15.320 cpu : usr=0.46%, sys=3.28%, ctx=1791, majf=0, minf=4097 00:20:15.320 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:15.320 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.320 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.320 issued rwts: total=10211,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.320 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.320 00:20:15.320 Run status group 0 (all jobs): 00:20:15.320 READ: bw=1924MiB/s (2017MB/s), 120MiB/s-253MiB/s (126MB/s-266MB/s), io=19.1GiB (20.5GB), run=10010-10167msec 00:20:15.320 00:20:15.320 Disk stats (read/write): 00:20:15.320 nvme0n1: ios=11954/0, merge=0/0, ticks=1231443/0, in_queue=1231443, util=97.31% 00:20:15.320 nvme10n1: ios=9543/0, merge=0/0, ticks=1231679/0, in_queue=1231679, util=97.52% 00:20:15.320 nvme1n1: ios=11609/0, merge=0/0, ticks=1228273/0, in_queue=1228273, util=97.77% 00:20:15.320 nvme2n1: ios=12215/0, merge=0/0, ticks=1236068/0, in_queue=1236068, util=97.91% 00:20:15.320 nvme3n1: ios=16529/0, merge=0/0, ticks=1232254/0, in_queue=1232254, util=98.01% 00:20:15.320 nvme4n1: ios=16161/0, merge=0/0, ticks=1243228/0, in_queue=1243228, util=98.31% 00:20:15.320 nvme5n1: ios=13120/0, merge=0/0, ticks=1227633/0, in_queue=1227633, util=98.46% 00:20:15.320 nvme6n1: ios=18329/0, merge=0/0, ticks=1232841/0, in_queue=1232841, util=98.59% 00:20:15.320 nvme7n1: ios=12340/0, merge=0/0, ticks=1238983/0, in_queue=1238983, util=98.95% 00:20:15.320 nvme8n1: ios=12254/0, merge=0/0, ticks=1234017/0, in_queue=1234017, util=99.12% 00:20:15.320 nvme9n1: ios=20232/0, merge=0/0, ticks=1237080/0, in_queue=1237080, util=99.21% 00:20:15.320 21:10:09 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:15.320 [global] 00:20:15.320 thread=1 00:20:15.320 invalidate=1 00:20:15.320 rw=randwrite 00:20:15.320 time_based=1 00:20:15.320 runtime=10 00:20:15.320 ioengine=libaio 00:20:15.320 direct=1 00:20:15.320 bs=262144 00:20:15.320 iodepth=64 00:20:15.320 norandommap=1 00:20:15.320 numjobs=1 00:20:15.320 00:20:15.320 [job0] 00:20:15.320 filename=/dev/nvme0n1 00:20:15.320 [job1] 00:20:15.320 filename=/dev/nvme10n1 00:20:15.320 [job2] 00:20:15.320 filename=/dev/nvme1n1 00:20:15.320 [job3] 00:20:15.320 filename=/dev/nvme2n1 00:20:15.320 [job4] 00:20:15.320 filename=/dev/nvme3n1 00:20:15.320 [job5] 00:20:15.320 filename=/dev/nvme4n1 00:20:15.320 [job6] 00:20:15.320 filename=/dev/nvme5n1 00:20:15.320 [job7] 00:20:15.320 filename=/dev/nvme6n1 00:20:15.320 [job8] 00:20:15.320 filename=/dev/nvme7n1 00:20:15.320 [job9] 00:20:15.320 filename=/dev/nvme8n1 00:20:15.320 [job10] 00:20:15.320 filename=/dev/nvme9n1 00:20:15.320 Could not set queue depth (nvme0n1) 00:20:15.320 Could not set queue depth (nvme10n1) 00:20:15.320 Could not set queue depth (nvme1n1) 00:20:15.320 Could not set queue depth (nvme2n1) 00:20:15.320 Could not set queue depth (nvme3n1) 00:20:15.320 Could not set queue depth (nvme4n1) 00:20:15.320 Could not set queue depth (nvme5n1) 00:20:15.320 Could not set queue depth (nvme6n1) 00:20:15.320 Could not set queue depth (nvme7n1) 00:20:15.320 Could not set queue depth (nvme8n1) 00:20:15.320 Could not set queue depth (nvme9n1) 00:20:15.320 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.320 fio-3.35 00:20:15.320 Starting 11 threads 00:20:25.290 00:20:25.290 job0: (groupid=0, jobs=1): err= 0: pid=4025405: Wed Nov 27 21:10:20 2024 00:20:25.290 write: IOPS=616, BW=154MiB/s (162MB/s)(1565MiB/10146msec); 0 zone resets 00:20:25.290 slat (usec): min=24, max=137011, avg=1529.10, stdev=3931.74 00:20:25.290 clat (msec): min=2, max=313, avg=102.14, stdev=53.67 00:20:25.290 lat (msec): min=2, max=313, avg=103.66, stdev=54.30 00:20:25.290 clat percentiles (msec): 00:20:25.290 | 1.00th=[ 14], 5.00th=[ 45], 10.00th=[ 47], 20.00th=[ 48], 00:20:25.290 | 30.00th=[ 51], 40.00th=[ 81], 50.00th=[ 104], 60.00th=[ 114], 00:20:25.290 | 70.00th=[ 128], 80.00th=[ 150], 90.00th=[ 182], 95.00th=[ 197], 00:20:25.290 | 99.00th=[ 232], 99.50th=[ 245], 99.90th=[ 288], 99.95th=[ 305], 00:20:25.290 | 99.99th=[ 313] 00:20:25.290 bw ( KiB/s): min=77312, max=342016, per=10.69%, avg=158597.90, stdev=75566.46, samples=20 00:20:25.290 iops : min= 302, max= 1336, avg=619.45, stdev=295.22, samples=20 00:20:25.290 lat (msec) : 4=0.05%, 10=0.30%, 20=1.81%, 50=27.96%, 100=17.81% 00:20:25.290 lat (msec) : 250=51.78%, 500=0.29% 00:20:25.290 cpu : usr=1.80%, sys=1.97%, ctx=1793, majf=0, minf=1 00:20:25.290 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:25.290 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.290 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.290 issued rwts: total=0,6259,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.290 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.290 job1: (groupid=0, jobs=1): err= 0: pid=4025437: Wed Nov 27 21:10:20 2024 00:20:25.290 write: IOPS=637, BW=159MiB/s (167MB/s)(1616MiB/10135msec); 0 zone resets 00:20:25.290 slat (usec): min=19, max=50146, avg=1372.56, stdev=3140.23 00:20:25.290 clat (usec): min=1638, max=338364, avg=98927.90, stdev=60337.31 00:20:25.290 lat (usec): min=1730, max=342159, avg=100300.46, stdev=61068.78 00:20:25.290 clat percentiles (msec): 00:20:25.290 | 1.00th=[ 8], 5.00th=[ 42], 10.00th=[ 44], 20.00th=[ 48], 00:20:25.290 | 30.00th=[ 59], 40.00th=[ 68], 50.00th=[ 86], 60.00th=[ 100], 00:20:25.290 | 70.00th=[ 117], 80.00th=[ 136], 90.00th=[ 192], 95.00th=[ 234], 00:20:25.290 | 99.00th=[ 288], 99.50th=[ 309], 99.90th=[ 330], 99.95th=[ 334], 00:20:25.290 | 99.99th=[ 338] 00:20:25.290 bw ( KiB/s): min=71536, max=307712, per=11.04%, avg=163819.80, stdev=72300.62, samples=20 00:20:25.290 iops : min= 279, max= 1202, avg=639.85, stdev=282.48, samples=20 00:20:25.290 lat (msec) : 2=0.03%, 4=0.29%, 10=1.30%, 20=1.11%, 50=19.26% 00:20:25.290 lat (msec) : 100=38.45%, 250=36.41%, 500=3.14% 00:20:25.290 cpu : usr=2.08%, sys=2.16%, ctx=2223, majf=0, minf=1 00:20:25.290 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:25.290 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.290 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.290 issued rwts: total=0,6463,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.290 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.290 job2: (groupid=0, jobs=1): err= 0: pid=4025476: Wed Nov 27 21:10:20 2024 00:20:25.290 write: IOPS=608, BW=152MiB/s (159MB/s)(1542MiB/10140msec); 0 zone resets 00:20:25.290 slat (usec): min=19, max=37514, avg=1337.27, stdev=3174.27 00:20:25.290 clat (usec): min=1598, max=298463, avg=103864.30, stdev=55996.05 00:20:25.290 lat (usec): min=1637, max=298557, avg=105201.57, stdev=56729.77 00:20:25.290 clat percentiles (msec): 00:20:25.290 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 42], 20.00th=[ 51], 00:20:25.290 | 30.00th=[ 78], 40.00th=[ 92], 50.00th=[ 99], 60.00th=[ 109], 00:20:25.290 | 70.00th=[ 116], 80.00th=[ 140], 90.00th=[ 180], 95.00th=[ 218], 00:20:25.290 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], 00:20:25.290 | 99.99th=[ 300] 00:20:25.290 bw ( KiB/s): min=55296, max=345600, per=10.53%, avg=156205.45, stdev=61865.79, samples=20 00:20:25.290 iops : min= 216, max= 1350, avg=610.15, stdev=241.65, samples=20 00:20:25.290 lat (msec) : 2=0.02%, 4=0.21%, 10=1.01%, 20=2.29%, 50=16.33% 00:20:25.290 lat (msec) : 100=33.36%, 250=44.23%, 500=2.56% 00:20:25.290 cpu : usr=1.86%, sys=1.90%, ctx=2610, majf=0, minf=1 00:20:25.290 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:25.290 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.290 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.290 issued rwts: total=0,6166,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.290 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.290 job3: (groupid=0, jobs=1): err= 0: pid=4025488: Wed Nov 27 21:10:20 2024 00:20:25.290 write: IOPS=522, BW=131MiB/s (137MB/s)(1315MiB/10077msec); 0 zone resets 00:20:25.290 slat (usec): min=14, max=129239, avg=1360.48, stdev=4449.84 00:20:25.291 clat (usec): min=1315, max=375969, avg=121098.48, stdev=75205.65 00:20:25.291 lat (usec): min=1400, max=376054, avg=122458.96, stdev=76202.67 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 31], 20.00th=[ 54], 00:20:25.291 | 30.00th=[ 74], 40.00th=[ 86], 50.00th=[ 100], 60.00th=[ 132], 00:20:25.291 | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 262], 00:20:25.291 | 99.00th=[ 317], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 376], 00:20:25.291 | 99.99th=[ 376] 00:20:25.291 bw ( KiB/s): min=57344, max=287232, per=8.97%, avg=133071.60, stdev=58653.21, samples=20 00:20:25.291 iops : min= 224, max= 1122, avg=519.75, stdev=229.13, samples=20 00:20:25.291 lat (msec) : 2=0.13%, 4=0.70%, 10=2.05%, 20=3.21%, 50=12.28% 00:20:25.291 lat (msec) : 100=31.91%, 250=43.51%, 500=6.20% 00:20:25.291 cpu : usr=1.58%, sys=1.55%, ctx=2944, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,5261,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job4: (groupid=0, jobs=1): err= 0: pid=4025494: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=570, BW=143MiB/s (150MB/s)(1447MiB/10140msec); 0 zone resets 00:20:25.291 slat (usec): min=22, max=32405, avg=1374.18, stdev=3351.80 00:20:25.291 clat (usec): min=1354, max=323516, avg=110695.05, stdev=64451.07 00:20:25.291 lat (usec): min=1894, max=323558, avg=112069.23, stdev=65282.73 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 9], 5.00th=[ 17], 10.00th=[ 35], 20.00th=[ 45], 00:20:25.291 | 30.00th=[ 77], 40.00th=[ 81], 50.00th=[ 97], 60.00th=[ 117], 00:20:25.291 | 70.00th=[ 142], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 234], 00:20:25.291 | 99.00th=[ 268], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 321], 00:20:25.291 | 99.99th=[ 326] 00:20:25.291 bw ( KiB/s): min=71536, max=397824, per=9.88%, avg=146554.10, stdev=80660.77, samples=20 00:20:25.291 iops : min= 279, max= 1554, avg=572.40, stdev=315.11, samples=20 00:20:25.291 lat (msec) : 2=0.03%, 4=0.17%, 10=1.26%, 20=4.99%, 50=14.75% 00:20:25.291 lat (msec) : 100=30.37%, 250=45.91%, 500=2.51% 00:20:25.291 cpu : usr=1.91%, sys=2.04%, ctx=2577, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,5788,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job5: (groupid=0, jobs=1): err= 0: pid=4025495: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=453, BW=113MiB/s (119MB/s)(1151MiB/10148msec); 0 zone resets 00:20:25.291 slat (usec): min=18, max=98001, avg=1576.71, stdev=4587.41 00:20:25.291 clat (usec): min=1092, max=396041, avg=138981.70, stdev=72327.30 00:20:25.291 lat (usec): min=1116, max=396085, avg=140558.41, stdev=73199.57 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 36], 20.00th=[ 72], 00:20:25.291 | 30.00th=[ 110], 40.00th=[ 118], 50.00th=[ 131], 60.00th=[ 163], 00:20:25.291 | 70.00th=[ 180], 80.00th=[ 199], 90.00th=[ 228], 95.00th=[ 264], 00:20:25.291 | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 393], 00:20:25.291 | 99.99th=[ 397] 00:20:25.291 bw ( KiB/s): min=51200, max=197120, per=7.84%, avg=116262.85, stdev=41410.95, samples=20 00:20:25.291 iops : min= 200, max= 770, avg=454.10, stdev=161.81, samples=20 00:20:25.291 lat (msec) : 2=0.11%, 4=0.52%, 10=2.26%, 20=3.13%, 50=7.97% 00:20:25.291 lat (msec) : 100=12.10%, 250=67.54%, 500=6.38% 00:20:25.291 cpu : usr=1.30%, sys=1.66%, ctx=2391, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,4605,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job6: (groupid=0, jobs=1): err= 0: pid=4025496: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=469, BW=117MiB/s (123MB/s)(1192MiB/10144msec); 0 zone resets 00:20:25.291 slat (usec): min=22, max=29592, avg=1642.93, stdev=3839.96 00:20:25.291 clat (msec): min=3, max=277, avg=134.52, stdev=59.09 00:20:25.291 lat (msec): min=3, max=277, avg=136.16, stdev=59.90 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 12], 5.00th=[ 34], 10.00th=[ 56], 20.00th=[ 89], 00:20:25.291 | 30.00th=[ 96], 40.00th=[ 114], 50.00th=[ 133], 60.00th=[ 153], 00:20:25.291 | 70.00th=[ 169], 80.00th=[ 184], 90.00th=[ 215], 95.00th=[ 239], 00:20:25.291 | 99.00th=[ 266], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], 00:20:25.291 | 99.99th=[ 279] 00:20:25.291 bw ( KiB/s): min=63488, max=167936, per=8.11%, avg=120367.85, stdev=32775.01, samples=20 00:20:25.291 iops : min= 248, max= 656, avg=470.10, stdev=127.96, samples=20 00:20:25.291 lat (msec) : 4=0.02%, 10=0.36%, 20=1.74%, 50=6.88%, 100=23.58% 00:20:25.291 lat (msec) : 250=65.19%, 500=2.22% 00:20:25.291 cpu : usr=1.39%, sys=1.67%, ctx=2233, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,4766,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job7: (groupid=0, jobs=1): err= 0: pid=4025497: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=482, BW=121MiB/s (127MB/s)(1225MiB/10150msec); 0 zone resets 00:20:25.291 slat (usec): min=15, max=66207, avg=1486.17, stdev=3957.60 00:20:25.291 clat (usec): min=946, max=294682, avg=131072.77, stdev=67149.40 00:20:25.291 lat (usec): min=982, max=294744, avg=132558.95, stdev=68123.01 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 24], 20.00th=[ 64], 00:20:25.291 | 30.00th=[ 102], 40.00th=[ 120], 50.00th=[ 140], 60.00th=[ 163], 00:20:25.291 | 70.00th=[ 174], 80.00th=[ 190], 90.00th=[ 213], 95.00th=[ 234], 00:20:25.291 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], 00:20:25.291 | 99.99th=[ 296] 00:20:25.291 bw ( KiB/s): min=63488, max=201836, per=8.34%, avg=123754.15, stdev=38511.56, samples=20 00:20:25.291 iops : min= 248, max= 788, avg=483.35, stdev=150.36, samples=20 00:20:25.291 lat (usec) : 1000=0.02% 00:20:25.291 lat (msec) : 2=0.35%, 4=0.69%, 10=3.23%, 20=4.21%, 50=8.39% 00:20:25.291 lat (msec) : 100=12.64%, 250=68.23%, 500=2.25% 00:20:25.291 cpu : usr=1.47%, sys=1.57%, ctx=2725, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,4898,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job8: (groupid=0, jobs=1): err= 0: pid=4025498: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=471, BW=118MiB/s (124MB/s)(1184MiB/10047msec); 0 zone resets 00:20:25.291 slat (usec): min=23, max=44187, avg=1838.52, stdev=4025.20 00:20:25.291 clat (msec): min=3, max=305, avg=133.94, stdev=59.31 00:20:25.291 lat (msec): min=3, max=305, avg=135.78, stdev=60.20 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 18], 5.00th=[ 40], 10.00th=[ 59], 20.00th=[ 91], 00:20:25.291 | 30.00th=[ 97], 40.00th=[ 105], 50.00th=[ 126], 60.00th=[ 150], 00:20:25.291 | 70.00th=[ 167], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 241], 00:20:25.291 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 305], 99.95th=[ 305], 00:20:25.291 | 99.99th=[ 305] 00:20:25.291 bw ( KiB/s): min=59392, max=179200, per=8.06%, avg=119570.10, stdev=38502.80, samples=20 00:20:25.291 iops : min= 232, max= 700, avg=467.05, stdev=150.40, samples=20 00:20:25.291 lat (msec) : 4=0.06%, 10=0.25%, 20=0.99%, 50=5.91%, 100=31.16% 00:20:25.291 lat (msec) : 250=57.92%, 500=3.70% 00:20:25.291 cpu : usr=1.38%, sys=1.51%, ctx=1761, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,4734,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job9: (groupid=0, jobs=1): err= 0: pid=4025499: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=478, BW=120MiB/s (125MB/s)(1213MiB/10138msec); 0 zone resets 00:20:25.291 slat (usec): min=18, max=65461, avg=1630.30, stdev=4158.32 00:20:25.291 clat (usec): min=1439, max=309862, avg=131914.58, stdev=68641.75 00:20:25.291 lat (usec): min=1489, max=309921, avg=133544.88, stdev=69594.02 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 7], 5.00th=[ 27], 10.00th=[ 52], 20.00th=[ 77], 00:20:25.291 | 30.00th=[ 85], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 144], 00:20:25.291 | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 234], 95.00th=[ 264], 00:20:25.291 | 99.00th=[ 296], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 309], 00:20:25.291 | 99.99th=[ 309] 00:20:25.291 bw ( KiB/s): min=57344, max=207360, per=8.26%, avg=122621.85, stdev=44775.99, samples=20 00:20:25.291 iops : min= 224, max= 810, avg=478.95, stdev=174.90, samples=20 00:20:25.291 lat (msec) : 2=0.06%, 4=0.37%, 10=1.79%, 20=1.65%, 50=5.96% 00:20:25.291 lat (msec) : 100=26.27%, 250=56.54%, 500=7.36% 00:20:25.291 cpu : usr=1.49%, sys=1.63%, ctx=2341, majf=0, minf=1 00:20:25.291 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:25.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.291 issued rwts: total=0,4853,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.291 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.291 job10: (groupid=0, jobs=1): err= 0: pid=4025500: Wed Nov 27 21:10:20 2024 00:20:25.291 write: IOPS=499, BW=125MiB/s (131MB/s)(1259MiB/10078msec); 0 zone resets 00:20:25.291 slat (usec): min=15, max=47170, avg=1417.13, stdev=3564.24 00:20:25.291 clat (usec): min=793, max=279834, avg=126606.74, stdev=60675.29 00:20:25.291 lat (usec): min=823, max=282357, avg=128023.86, stdev=61396.20 00:20:25.291 clat percentiles (msec): 00:20:25.291 | 1.00th=[ 3], 5.00th=[ 16], 10.00th=[ 39], 20.00th=[ 74], 00:20:25.292 | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 144], 00:20:25.292 | 70.00th=[ 163], 80.00th=[ 182], 90.00th=[ 199], 95.00th=[ 224], 00:20:25.292 | 99.00th=[ 262], 99.50th=[ 268], 99.90th=[ 275], 99.95th=[ 279], 00:20:25.292 | 99.99th=[ 279] 00:20:25.292 bw ( KiB/s): min=68982, max=232960, per=8.58%, avg=127295.60, stdev=37331.58, samples=20 00:20:25.292 iops : min= 269, max= 910, avg=497.15, stdev=145.86, samples=20 00:20:25.292 lat (usec) : 1000=0.10% 00:20:25.292 lat (msec) : 2=0.60%, 4=1.11%, 10=1.53%, 20=2.44%, 50=7.49% 00:20:25.292 lat (msec) : 100=15.71%, 250=68.80%, 500=2.22% 00:20:25.292 cpu : usr=1.41%, sys=1.63%, ctx=2731, majf=0, minf=1 00:20:25.292 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:25.292 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.292 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.292 issued rwts: total=0,5036,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.292 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.292 00:20:25.292 Run status group 0 (all jobs): 00:20:25.292 WRITE: bw=1449MiB/s (1519MB/s), 113MiB/s-159MiB/s (119MB/s-167MB/s), io=14.4GiB (15.4GB), run=10047-10150msec 00:20:25.292 00:20:25.292 Disk stats (read/write): 00:20:25.292 nvme0n1: ios=48/12319, merge=0/0, ticks=2754/1182810, in_queue=1185564, util=99.94% 00:20:25.292 nvme10n1: ios=44/12744, merge=0/0, ticks=1025/1205900, in_queue=1206925, util=100.00% 00:20:25.292 nvme1n1: ios=48/12153, merge=0/0, ticks=70/1213089, in_queue=1213159, util=97.88% 00:20:25.292 nvme2n1: ios=36/10324, merge=0/0, ticks=703/1214074, in_queue=1214777, util=100.00% 00:20:25.292 nvme3n1: ios=46/11397, merge=0/0, ticks=195/1213043, in_queue=1213238, util=99.50% 00:20:25.292 nvme4n1: ios=48/9037, merge=0/0, ticks=1366/1213455, in_queue=1214821, util=100.00% 00:20:25.292 nvme5n1: ios=0/9351, merge=0/0, ticks=0/1217210, in_queue=1217210, util=98.32% 00:20:25.292 nvme6n1: ios=0/9582, merge=0/0, ticks=0/1219588, in_queue=1219588, util=98.48% 00:20:25.292 nvme7n1: ios=0/9182, merge=0/0, ticks=0/1216617, in_queue=1216617, util=98.85% 00:20:25.292 nvme8n1: ios=25/9530, merge=0/0, ticks=429/1212960, in_queue=1213389, util=100.00% 00:20:25.292 nvme9n1: ios=0/9874, merge=0/0, ticks=0/1218049, in_queue=1218049, util=99.14% 00:20:25.292 21:10:20 -- target/multiconnection.sh@36 -- # sync 00:20:25.292 21:10:20 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:25.292 21:10:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.292 21:10:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:25.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:25.292 21:10:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:25.292 21:10:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:25.292 21:10:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:25.292 21:10:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:25.292 21:10:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:25.292 21:10:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:25.292 21:10:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:25.292 21:10:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:25.292 21:10:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:25.292 21:10:21 -- common/autotest_common.sh@10 -- # set +x 00:20:25.292 21:10:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:25.292 21:10:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.292 21:10:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:25.292 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:25.292 21:10:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:25.292 21:10:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:25.292 21:10:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:25.292 21:10:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:25.292 21:10:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:25.292 21:10:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:25.292 21:10:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:25.292 21:10:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:25.292 21:10:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:25.292 21:10:21 -- common/autotest_common.sh@10 -- # set +x 00:20:25.292 21:10:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:25.292 21:10:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.292 21:10:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:25.550 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:25.550 21:10:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:25.550 21:10:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:25.550 21:10:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:25.550 21:10:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:25.550 21:10:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:25.550 21:10:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:25.550 21:10:21 -- common/autotest_common.sh@1220 -- # return 0 00:20:25.550 21:10:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:25.550 21:10:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:25.550 21:10:21 -- common/autotest_common.sh@10 -- # set +x 00:20:25.550 21:10:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:25.550 21:10:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.550 21:10:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:25.808 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:25.808 21:10:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:25.808 21:10:21 -- common/autotest_common.sh@1208 -- # local i=0 00:20:25.808 21:10:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:25.808 21:10:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:25.808 21:10:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:25.808 21:10:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:25.808 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:25.808 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:25.808 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:25.808 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:25.808 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:25.808 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.808 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:26.066 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:26.066 21:10:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:26.066 21:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.066 21:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.066 21:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:26.066 21:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.066 21:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:26.373 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.373 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:26.373 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.373 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:26.373 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.373 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.373 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:26.373 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:26.373 21:10:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:26.373 21:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.373 21:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.373 21:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:26.373 21:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.373 21:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:26.373 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.373 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:26.373 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.373 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:26.373 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.373 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.373 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:26.660 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:26.660 21:10:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:26.660 21:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.660 21:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.660 21:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:26.660 21:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.660 21:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:26.660 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.660 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:26.660 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.660 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:26.660 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.660 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.660 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:26.660 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:26.660 21:10:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:26.660 21:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.660 21:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.660 21:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:26.660 21:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.660 21:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:26.660 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.660 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:26.660 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.660 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:26.660 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.660 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.660 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:26.917 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:26.918 21:10:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:26.918 21:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.918 21:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.918 21:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:26.918 21:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.918 21:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:26.918 21:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.918 21:10:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:26.918 21:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.918 21:10:22 -- common/autotest_common.sh@10 -- # set +x 00:20:26.918 21:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.918 21:10:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.918 21:10:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:26.918 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:26.918 21:10:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:26.918 21:10:23 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.918 21:10:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.918 21:10:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:26.918 21:10:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:26.918 21:10:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:26.918 21:10:23 -- common/autotest_common.sh@1220 -- # return 0 00:20:26.918 21:10:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:26.918 21:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:26.918 21:10:23 -- common/autotest_common.sh@10 -- # set +x 00:20:26.918 21:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:26.918 21:10:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.918 21:10:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:26.918 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:26.918 21:10:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:26.918 21:10:23 -- common/autotest_common.sh@1208 -- # local i=0 00:20:26.918 21:10:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:26.918 21:10:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:27.176 21:10:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:27.176 21:10:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:27.176 21:10:23 -- common/autotest_common.sh@1220 -- # return 0 00:20:27.176 21:10:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:27.176 21:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.176 21:10:23 -- common/autotest_common.sh@10 -- # set +x 00:20:27.176 21:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.176 21:10:23 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:27.176 21:10:23 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:27.176 21:10:23 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:27.176 21:10:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:27.176 21:10:23 -- nvmf/common.sh@116 -- # sync 00:20:27.176 21:10:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:27.176 21:10:23 -- nvmf/common.sh@119 -- # set +e 00:20:27.176 21:10:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:27.176 21:10:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:27.176 rmmod nvme_tcp 00:20:27.176 rmmod nvme_fabrics 00:20:27.176 rmmod nvme_keyring 00:20:27.176 21:10:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:27.176 21:10:23 -- nvmf/common.sh@123 -- # set -e 00:20:27.176 21:10:23 -- nvmf/common.sh@124 -- # return 0 00:20:27.176 21:10:23 -- nvmf/common.sh@477 -- # '[' -n 4019759 ']' 00:20:27.176 21:10:23 -- nvmf/common.sh@478 -- # killprocess 4019759 00:20:27.176 21:10:23 -- common/autotest_common.sh@936 -- # '[' -z 4019759 ']' 00:20:27.176 21:10:23 -- common/autotest_common.sh@940 -- # kill -0 4019759 00:20:27.176 21:10:23 -- common/autotest_common.sh@941 -- # uname 00:20:27.176 21:10:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:27.176 21:10:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4019759 00:20:27.176 21:10:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:27.176 21:10:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:27.176 21:10:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4019759' 00:20:27.176 killing process with pid 4019759 00:20:27.176 21:10:23 -- common/autotest_common.sh@955 -- # kill 4019759 00:20:27.176 21:10:23 -- common/autotest_common.sh@960 -- # wait 4019759 00:20:27.742 21:10:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:27.742 21:10:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:27.742 21:10:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:27.742 21:10:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:27.742 21:10:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:27.742 21:10:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:27.742 21:10:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:27.742 21:10:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.271 21:10:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:30.271 00:20:30.271 real 1m1.525s 00:20:30.271 user 3m24.407s 00:20:30.271 sys 0m26.644s 00:20:30.271 21:10:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:30.271 21:10:25 -- common/autotest_common.sh@10 -- # set +x 00:20:30.271 ************************************ 00:20:30.271 END TEST nvmf_multiconnection 00:20:30.271 ************************************ 00:20:30.271 21:10:25 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:30.271 21:10:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:30.271 21:10:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:30.271 21:10:25 -- common/autotest_common.sh@10 -- # set +x 00:20:30.271 ************************************ 00:20:30.271 START TEST nvmf_initiator_timeout 00:20:30.271 ************************************ 00:20:30.271 21:10:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:30.271 * Looking for test storage... 00:20:30.271 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:30.271 21:10:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:30.271 21:10:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:30.271 21:10:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:30.271 21:10:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:30.271 21:10:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:30.271 21:10:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:30.271 21:10:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:30.271 21:10:26 -- scripts/common.sh@335 -- # IFS=.-: 00:20:30.271 21:10:26 -- scripts/common.sh@335 -- # read -ra ver1 00:20:30.271 21:10:26 -- scripts/common.sh@336 -- # IFS=.-: 00:20:30.271 21:10:26 -- scripts/common.sh@336 -- # read -ra ver2 00:20:30.271 21:10:26 -- scripts/common.sh@337 -- # local 'op=<' 00:20:30.271 21:10:26 -- scripts/common.sh@339 -- # ver1_l=2 00:20:30.271 21:10:26 -- scripts/common.sh@340 -- # ver2_l=1 00:20:30.271 21:10:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:30.271 21:10:26 -- scripts/common.sh@343 -- # case "$op" in 00:20:30.271 21:10:26 -- scripts/common.sh@344 -- # : 1 00:20:30.271 21:10:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:30.271 21:10:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:30.271 21:10:26 -- scripts/common.sh@364 -- # decimal 1 00:20:30.271 21:10:26 -- scripts/common.sh@352 -- # local d=1 00:20:30.271 21:10:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:30.271 21:10:26 -- scripts/common.sh@354 -- # echo 1 00:20:30.271 21:10:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:30.271 21:10:26 -- scripts/common.sh@365 -- # decimal 2 00:20:30.271 21:10:26 -- scripts/common.sh@352 -- # local d=2 00:20:30.271 21:10:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:30.271 21:10:26 -- scripts/common.sh@354 -- # echo 2 00:20:30.271 21:10:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:30.271 21:10:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:30.271 21:10:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:30.271 21:10:26 -- scripts/common.sh@367 -- # return 0 00:20:30.271 21:10:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:30.271 21:10:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:30.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.271 --rc genhtml_branch_coverage=1 00:20:30.271 --rc genhtml_function_coverage=1 00:20:30.271 --rc genhtml_legend=1 00:20:30.271 --rc geninfo_all_blocks=1 00:20:30.271 --rc geninfo_unexecuted_blocks=1 00:20:30.271 00:20:30.271 ' 00:20:30.271 21:10:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:30.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.271 --rc genhtml_branch_coverage=1 00:20:30.271 --rc genhtml_function_coverage=1 00:20:30.271 --rc genhtml_legend=1 00:20:30.271 --rc geninfo_all_blocks=1 00:20:30.271 --rc geninfo_unexecuted_blocks=1 00:20:30.271 00:20:30.271 ' 00:20:30.271 21:10:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:30.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.271 --rc genhtml_branch_coverage=1 00:20:30.271 --rc genhtml_function_coverage=1 00:20:30.271 --rc genhtml_legend=1 00:20:30.271 --rc geninfo_all_blocks=1 00:20:30.271 --rc geninfo_unexecuted_blocks=1 00:20:30.271 00:20:30.271 ' 00:20:30.271 21:10:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:30.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:30.271 --rc genhtml_branch_coverage=1 00:20:30.272 --rc genhtml_function_coverage=1 00:20:30.272 --rc genhtml_legend=1 00:20:30.272 --rc geninfo_all_blocks=1 00:20:30.272 --rc geninfo_unexecuted_blocks=1 00:20:30.272 00:20:30.272 ' 00:20:30.272 21:10:26 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:30.272 21:10:26 -- nvmf/common.sh@7 -- # uname -s 00:20:30.272 21:10:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:30.272 21:10:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:30.272 21:10:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:30.272 21:10:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:30.272 21:10:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:30.272 21:10:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:30.272 21:10:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:30.272 21:10:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:30.272 21:10:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:30.272 21:10:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:30.272 21:10:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:30.272 21:10:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:30.272 21:10:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:30.272 21:10:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:30.272 21:10:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:30.272 21:10:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:30.272 21:10:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:30.272 21:10:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:30.272 21:10:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:30.272 21:10:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.272 21:10:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.272 21:10:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.272 21:10:26 -- paths/export.sh@5 -- # export PATH 00:20:30.272 21:10:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:30.272 21:10:26 -- nvmf/common.sh@46 -- # : 0 00:20:30.272 21:10:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:30.272 21:10:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:30.272 21:10:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:30.272 21:10:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:30.272 21:10:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:30.272 21:10:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:30.272 21:10:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:30.272 21:10:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:30.272 21:10:26 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:30.272 21:10:26 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:30.272 21:10:26 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:30.272 21:10:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:30.272 21:10:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:30.272 21:10:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:30.272 21:10:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:30.272 21:10:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:30.272 21:10:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:30.272 21:10:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:30.272 21:10:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:30.272 21:10:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:30.272 21:10:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:30.272 21:10:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:30.272 21:10:26 -- common/autotest_common.sh@10 -- # set +x 00:20:32.175 21:10:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:32.175 21:10:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:32.175 21:10:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:32.175 21:10:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:32.175 21:10:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:32.175 21:10:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:32.175 21:10:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:32.175 21:10:28 -- nvmf/common.sh@294 -- # net_devs=() 00:20:32.175 21:10:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:32.175 21:10:28 -- nvmf/common.sh@295 -- # e810=() 00:20:32.175 21:10:28 -- nvmf/common.sh@295 -- # local -ga e810 00:20:32.175 21:10:28 -- nvmf/common.sh@296 -- # x722=() 00:20:32.175 21:10:28 -- nvmf/common.sh@296 -- # local -ga x722 00:20:32.175 21:10:28 -- nvmf/common.sh@297 -- # mlx=() 00:20:32.175 21:10:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:32.175 21:10:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:32.175 21:10:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:32.175 21:10:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:32.175 21:10:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:32.176 21:10:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:32.176 21:10:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:32.176 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:32.176 21:10:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:32.176 21:10:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:32.176 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:32.176 21:10:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:32.176 21:10:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:32.176 21:10:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:32.176 21:10:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:32.176 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:32.176 21:10:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:32.176 21:10:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:32.176 21:10:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:32.176 21:10:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:32.176 21:10:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:32.176 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:32.176 21:10:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:32.176 21:10:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:32.176 21:10:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:32.176 21:10:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:32.176 21:10:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:32.176 21:10:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:32.176 21:10:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:32.176 21:10:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:32.176 21:10:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:32.176 21:10:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:32.176 21:10:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:32.176 21:10:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:32.176 21:10:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:32.176 21:10:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:32.176 21:10:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:32.176 21:10:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:32.176 21:10:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:32.176 21:10:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:32.176 21:10:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:32.176 21:10:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:32.176 21:10:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:32.176 21:10:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:32.176 21:10:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:32.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:32.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:20:32.176 00:20:32.176 --- 10.0.0.2 ping statistics --- 00:20:32.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:32.176 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:20:32.176 21:10:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:32.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:32.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:20:32.176 00:20:32.176 --- 10.0.0.1 ping statistics --- 00:20:32.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:32.176 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:20:32.176 21:10:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:32.176 21:10:28 -- nvmf/common.sh@410 -- # return 0 00:20:32.176 21:10:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:32.176 21:10:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:32.176 21:10:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:32.176 21:10:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:32.176 21:10:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:32.176 21:10:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:32.176 21:10:28 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:32.176 21:10:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:32.176 21:10:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:32.176 21:10:28 -- common/autotest_common.sh@10 -- # set +x 00:20:32.176 21:10:28 -- nvmf/common.sh@469 -- # nvmfpid=4028894 00:20:32.176 21:10:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:32.176 21:10:28 -- nvmf/common.sh@470 -- # waitforlisten 4028894 00:20:32.176 21:10:28 -- common/autotest_common.sh@829 -- # '[' -z 4028894 ']' 00:20:32.176 21:10:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:32.176 21:10:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:32.176 21:10:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:32.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:32.176 21:10:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:32.176 21:10:28 -- common/autotest_common.sh@10 -- # set +x 00:20:32.176 [2024-11-27 21:10:28.334396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:32.176 [2024-11-27 21:10:28.334482] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:32.176 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.176 [2024-11-27 21:10:28.399849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:32.435 [2024-11-27 21:10:28.506477] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:32.435 [2024-11-27 21:10:28.506645] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:32.435 [2024-11-27 21:10:28.506664] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:32.436 [2024-11-27 21:10:28.506676] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:32.436 [2024-11-27 21:10:28.506733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.436 [2024-11-27 21:10:28.506817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:32.436 [2024-11-27 21:10:28.506820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:32.436 [2024-11-27 21:10:28.506758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:33.367 21:10:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:33.367 21:10:29 -- common/autotest_common.sh@862 -- # return 0 00:20:33.367 21:10:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:33.367 21:10:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 21:10:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 Malloc0 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 Delay0 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 [2024-11-27 21:10:29.422214] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:33.367 21:10:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.367 21:10:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.367 [2024-11-27 21:10:29.450476] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:33.367 21:10:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.367 21:10:29 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:33.933 21:10:30 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:33.933 21:10:30 -- common/autotest_common.sh@1187 -- # local i=0 00:20:33.933 21:10:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:33.933 21:10:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:33.933 21:10:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:36.459 21:10:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:36.459 21:10:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:36.459 21:10:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:36.459 21:10:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:36.459 21:10:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:36.459 21:10:32 -- common/autotest_common.sh@1197 -- # return 0 00:20:36.459 21:10:32 -- target/initiator_timeout.sh@35 -- # fio_pid=4029340 00:20:36.459 21:10:32 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:36.459 21:10:32 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:36.459 [global] 00:20:36.459 thread=1 00:20:36.459 invalidate=1 00:20:36.459 rw=write 00:20:36.459 time_based=1 00:20:36.459 runtime=60 00:20:36.459 ioengine=libaio 00:20:36.459 direct=1 00:20:36.459 bs=4096 00:20:36.459 iodepth=1 00:20:36.459 norandommap=0 00:20:36.459 numjobs=1 00:20:36.459 00:20:36.459 verify_dump=1 00:20:36.459 verify_backlog=512 00:20:36.459 verify_state_save=0 00:20:36.459 do_verify=1 00:20:36.459 verify=crc32c-intel 00:20:36.459 [job0] 00:20:36.459 filename=/dev/nvme0n1 00:20:36.459 Could not set queue depth (nvme0n1) 00:20:36.459 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:36.459 fio-3.35 00:20:36.459 Starting 1 thread 00:20:38.987 21:10:35 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:38.987 21:10:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:38.987 21:10:35 -- common/autotest_common.sh@10 -- # set +x 00:20:38.987 true 00:20:38.987 21:10:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:38.987 21:10:35 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:38.987 21:10:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:38.987 21:10:35 -- common/autotest_common.sh@10 -- # set +x 00:20:38.987 true 00:20:38.987 21:10:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:38.987 21:10:35 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:38.987 21:10:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:38.987 21:10:35 -- common/autotest_common.sh@10 -- # set +x 00:20:38.987 true 00:20:38.987 21:10:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:38.987 21:10:35 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:38.987 21:10:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:38.987 21:10:35 -- common/autotest_common.sh@10 -- # set +x 00:20:38.987 true 00:20:38.987 21:10:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:38.987 21:10:35 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:42.266 21:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.266 21:10:38 -- common/autotest_common.sh@10 -- # set +x 00:20:42.266 true 00:20:42.266 21:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:42.266 21:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.266 21:10:38 -- common/autotest_common.sh@10 -- # set +x 00:20:42.266 true 00:20:42.266 21:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:42.266 21:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.266 21:10:38 -- common/autotest_common.sh@10 -- # set +x 00:20:42.266 true 00:20:42.266 21:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:42.266 21:10:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:42.266 21:10:38 -- common/autotest_common.sh@10 -- # set +x 00:20:42.266 true 00:20:42.266 21:10:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:42.266 21:10:38 -- target/initiator_timeout.sh@54 -- # wait 4029340 00:21:38.473 00:21:38.473 job0: (groupid=0, jobs=1): err= 0: pid=4029533: Wed Nov 27 21:11:32 2024 00:21:38.474 read: IOPS=184, BW=736KiB/s (754kB/s)(43.2MiB/60020msec) 00:21:38.474 slat (nsec): min=6153, max=32743, avg=7167.06, stdev=1418.65 00:21:38.474 clat (usec): min=231, max=41236k, avg=5198.64, stdev=392348.33 00:21:38.474 lat (usec): min=237, max=41236k, avg=5205.80, stdev=392348.35 00:21:38.474 clat percentiles (usec): 00:21:38.474 | 1.00th=[ 243], 5.00th=[ 249], 10.00th=[ 253], 20.00th=[ 258], 00:21:38.474 | 30.00th=[ 260], 40.00th=[ 265], 50.00th=[ 265], 60.00th=[ 269], 00:21:38.474 | 70.00th=[ 273], 80.00th=[ 277], 90.00th=[ 285], 95.00th=[ 293], 00:21:38.474 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:21:38.474 | 99.99th=[42206] 00:21:38.474 write: IOPS=187, BW=751KiB/s (769kB/s)(44.0MiB/60020msec); 0 zone resets 00:21:38.474 slat (usec): min=7, max=29842, avg=13.19, stdev=302.19 00:21:38.474 clat (usec): min=172, max=900, avg=204.16, stdev=19.19 00:21:38.474 lat (usec): min=180, max=30201, avg=217.35, stdev=304.42 00:21:38.474 clat percentiles (usec): 00:21:38.474 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 188], 20.00th=[ 192], 00:21:38.474 | 30.00th=[ 196], 40.00th=[ 198], 50.00th=[ 200], 60.00th=[ 204], 00:21:38.474 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 227], 95.00th=[ 241], 00:21:38.474 | 99.00th=[ 255], 99.50th=[ 265], 99.90th=[ 343], 99.95th=[ 408], 00:21:38.474 | 99.99th=[ 709] 00:21:38.474 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6931.69, stdev=1967.65, samples=13 00:21:38.474 iops : min= 1024, max= 2048, avg=1732.92, stdev=491.91, samples=13 00:21:38.474 lat (usec) : 250=52.68%, 500=45.73%, 750=0.14%, 1000=0.01% 00:21:38.474 lat (msec) : 50=1.44%, >=2000=0.01% 00:21:38.474 cpu : usr=0.23%, sys=0.40%, ctx=22317, majf=0, minf=1 00:21:38.474 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:38.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.474 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.474 issued rwts: total=11049,11264,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.474 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:38.474 00:21:38.474 Run status group 0 (all jobs): 00:21:38.474 READ: bw=736KiB/s (754kB/s), 736KiB/s-736KiB/s (754kB/s-754kB/s), io=43.2MiB (45.3MB), run=60020-60020msec 00:21:38.474 WRITE: bw=751KiB/s (769kB/s), 751KiB/s-751KiB/s (769kB/s-769kB/s), io=44.0MiB (46.1MB), run=60020-60020msec 00:21:38.474 00:21:38.474 Disk stats (read/write): 00:21:38.474 nvme0n1: ios=11098/11264, merge=0/0, ticks=17558/2245, in_queue=19803, util=99.62% 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:38.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:38.474 21:11:32 -- common/autotest_common.sh@1208 -- # local i=0 00:21:38.474 21:11:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:38.474 21:11:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:38.474 21:11:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:38.474 21:11:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:38.474 21:11:32 -- common/autotest_common.sh@1220 -- # return 0 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:38.474 nvmf hotplug test: fio successful as expected 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:38.474 21:11:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:38.474 21:11:32 -- common/autotest_common.sh@10 -- # set +x 00:21:38.474 21:11:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:38.474 21:11:32 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:38.474 21:11:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:38.474 21:11:32 -- nvmf/common.sh@116 -- # sync 00:21:38.474 21:11:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:38.474 21:11:32 -- nvmf/common.sh@119 -- # set +e 00:21:38.474 21:11:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:38.474 21:11:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:38.474 rmmod nvme_tcp 00:21:38.474 rmmod nvme_fabrics 00:21:38.474 rmmod nvme_keyring 00:21:38.474 21:11:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:38.474 21:11:32 -- nvmf/common.sh@123 -- # set -e 00:21:38.474 21:11:32 -- nvmf/common.sh@124 -- # return 0 00:21:38.474 21:11:32 -- nvmf/common.sh@477 -- # '[' -n 4028894 ']' 00:21:38.474 21:11:32 -- nvmf/common.sh@478 -- # killprocess 4028894 00:21:38.474 21:11:32 -- common/autotest_common.sh@936 -- # '[' -z 4028894 ']' 00:21:38.474 21:11:32 -- common/autotest_common.sh@940 -- # kill -0 4028894 00:21:38.474 21:11:32 -- common/autotest_common.sh@941 -- # uname 00:21:38.474 21:11:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:38.474 21:11:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4028894 00:21:38.474 21:11:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:38.474 21:11:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:38.474 21:11:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4028894' 00:21:38.474 killing process with pid 4028894 00:21:38.474 21:11:32 -- common/autotest_common.sh@955 -- # kill 4028894 00:21:38.474 21:11:32 -- common/autotest_common.sh@960 -- # wait 4028894 00:21:38.474 21:11:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:38.474 21:11:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:38.474 21:11:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:38.474 21:11:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:38.474 21:11:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:38.474 21:11:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.474 21:11:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:38.474 21:11:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:39.043 21:11:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:39.043 00:21:39.043 real 1m9.093s 00:21:39.043 user 4m13.451s 00:21:39.043 sys 0m7.075s 00:21:39.043 21:11:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:39.043 21:11:35 -- common/autotest_common.sh@10 -- # set +x 00:21:39.043 ************************************ 00:21:39.043 END TEST nvmf_initiator_timeout 00:21:39.043 ************************************ 00:21:39.043 21:11:35 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:39.043 21:11:35 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:39.043 21:11:35 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:39.043 21:11:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:39.043 21:11:35 -- common/autotest_common.sh@10 -- # set +x 00:21:40.949 21:11:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.949 21:11:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.949 21:11:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.949 21:11:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.949 21:11:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.949 21:11:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.949 21:11:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.949 21:11:37 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.949 21:11:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.949 21:11:37 -- nvmf/common.sh@295 -- # e810=() 00:21:40.949 21:11:37 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.949 21:11:37 -- nvmf/common.sh@296 -- # x722=() 00:21:40.949 21:11:37 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.949 21:11:37 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.949 21:11:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.949 21:11:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.949 21:11:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.949 21:11:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.949 21:11:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.949 21:11:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.949 21:11:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.949 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.949 21:11:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.949 21:11:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.949 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.949 21:11:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.949 21:11:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.949 21:11:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.949 21:11:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.949 21:11:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.949 21:11:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.949 21:11:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.949 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.949 21:11:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.949 21:11:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.949 21:11:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.949 21:11:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.949 21:11:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.949 21:11:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.949 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.949 21:11:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.949 21:11:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.949 21:11:37 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.949 21:11:37 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:40.949 21:11:37 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:40.949 21:11:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:40.949 21:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:40.949 21:11:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.949 ************************************ 00:21:40.949 START TEST nvmf_perf_adq 00:21:40.949 ************************************ 00:21:40.949 21:11:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:40.949 * Looking for test storage... 00:21:40.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:40.949 21:11:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:40.949 21:11:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:40.949 21:11:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:40.949 21:11:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:40.949 21:11:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:40.949 21:11:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:40.949 21:11:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:40.949 21:11:37 -- scripts/common.sh@335 -- # IFS=.-: 00:21:40.949 21:11:37 -- scripts/common.sh@335 -- # read -ra ver1 00:21:40.949 21:11:37 -- scripts/common.sh@336 -- # IFS=.-: 00:21:40.949 21:11:37 -- scripts/common.sh@336 -- # read -ra ver2 00:21:40.949 21:11:37 -- scripts/common.sh@337 -- # local 'op=<' 00:21:41.209 21:11:37 -- scripts/common.sh@339 -- # ver1_l=2 00:21:41.209 21:11:37 -- scripts/common.sh@340 -- # ver2_l=1 00:21:41.209 21:11:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:41.209 21:11:37 -- scripts/common.sh@343 -- # case "$op" in 00:21:41.209 21:11:37 -- scripts/common.sh@344 -- # : 1 00:21:41.209 21:11:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:41.209 21:11:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:41.209 21:11:37 -- scripts/common.sh@364 -- # decimal 1 00:21:41.209 21:11:37 -- scripts/common.sh@352 -- # local d=1 00:21:41.209 21:11:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:41.209 21:11:37 -- scripts/common.sh@354 -- # echo 1 00:21:41.209 21:11:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:41.209 21:11:37 -- scripts/common.sh@365 -- # decimal 2 00:21:41.209 21:11:37 -- scripts/common.sh@352 -- # local d=2 00:21:41.209 21:11:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:41.209 21:11:37 -- scripts/common.sh@354 -- # echo 2 00:21:41.209 21:11:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:41.209 21:11:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:41.209 21:11:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:41.209 21:11:37 -- scripts/common.sh@367 -- # return 0 00:21:41.209 21:11:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:41.209 21:11:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:41.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.209 --rc genhtml_branch_coverage=1 00:21:41.209 --rc genhtml_function_coverage=1 00:21:41.209 --rc genhtml_legend=1 00:21:41.209 --rc geninfo_all_blocks=1 00:21:41.209 --rc geninfo_unexecuted_blocks=1 00:21:41.209 00:21:41.209 ' 00:21:41.209 21:11:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:41.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.209 --rc genhtml_branch_coverage=1 00:21:41.209 --rc genhtml_function_coverage=1 00:21:41.209 --rc genhtml_legend=1 00:21:41.209 --rc geninfo_all_blocks=1 00:21:41.209 --rc geninfo_unexecuted_blocks=1 00:21:41.209 00:21:41.209 ' 00:21:41.209 21:11:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:41.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.209 --rc genhtml_branch_coverage=1 00:21:41.209 --rc genhtml_function_coverage=1 00:21:41.209 --rc genhtml_legend=1 00:21:41.209 --rc geninfo_all_blocks=1 00:21:41.209 --rc geninfo_unexecuted_blocks=1 00:21:41.209 00:21:41.209 ' 00:21:41.209 21:11:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:41.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.209 --rc genhtml_branch_coverage=1 00:21:41.209 --rc genhtml_function_coverage=1 00:21:41.209 --rc genhtml_legend=1 00:21:41.209 --rc geninfo_all_blocks=1 00:21:41.209 --rc geninfo_unexecuted_blocks=1 00:21:41.209 00:21:41.209 ' 00:21:41.209 21:11:37 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:41.209 21:11:37 -- nvmf/common.sh@7 -- # uname -s 00:21:41.209 21:11:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:41.209 21:11:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:41.209 21:11:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:41.209 21:11:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:41.209 21:11:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:41.209 21:11:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:41.209 21:11:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:41.209 21:11:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:41.209 21:11:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:41.209 21:11:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:41.209 21:11:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.209 21:11:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.209 21:11:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:41.209 21:11:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:41.209 21:11:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:41.209 21:11:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:41.209 21:11:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:41.209 21:11:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:41.209 21:11:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:41.209 21:11:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.209 21:11:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.209 21:11:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.209 21:11:37 -- paths/export.sh@5 -- # export PATH 00:21:41.209 21:11:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.209 21:11:37 -- nvmf/common.sh@46 -- # : 0 00:21:41.209 21:11:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:41.209 21:11:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:41.209 21:11:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:41.209 21:11:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:41.209 21:11:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:41.209 21:11:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:41.209 21:11:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:41.209 21:11:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:41.209 21:11:37 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:41.209 21:11:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.209 21:11:37 -- common/autotest_common.sh@10 -- # set +x 00:21:43.112 21:11:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.112 21:11:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.112 21:11:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.112 21:11:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.112 21:11:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.112 21:11:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.112 21:11:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.112 21:11:39 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.112 21:11:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.112 21:11:39 -- nvmf/common.sh@295 -- # e810=() 00:21:43.112 21:11:39 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.112 21:11:39 -- nvmf/common.sh@296 -- # x722=() 00:21:43.112 21:11:39 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.112 21:11:39 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.112 21:11:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.112 21:11:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.112 21:11:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.112 21:11:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.112 21:11:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.112 21:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.112 21:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.112 21:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.112 21:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.112 21:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.112 21:11:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.112 21:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.112 21:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.112 21:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.112 21:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.112 21:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.112 21:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.112 21:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.112 21:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.112 21:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.112 21:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.112 21:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.112 21:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.112 21:11:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.112 21:11:39 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.112 21:11:39 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:43.112 21:11:39 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:43.112 21:11:39 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:43.112 21:11:39 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:44.047 21:11:39 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:46.578 21:11:42 -- target/perf_adq.sh@54 -- # sleep 5 00:21:51.904 21:11:47 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:51.904 21:11:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:51.904 21:11:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:51.904 21:11:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:51.904 21:11:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:51.904 21:11:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:51.904 21:11:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.904 21:11:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.904 21:11:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:51.904 21:11:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:51.904 21:11:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:51.904 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.904 21:11:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:51.904 21:11:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:51.904 21:11:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:51.904 21:11:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:51.904 21:11:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:51.904 21:11:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:51.904 21:11:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:51.904 21:11:47 -- nvmf/common.sh@294 -- # net_devs=() 00:21:51.904 21:11:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:51.904 21:11:47 -- nvmf/common.sh@295 -- # e810=() 00:21:51.904 21:11:47 -- nvmf/common.sh@295 -- # local -ga e810 00:21:51.904 21:11:47 -- nvmf/common.sh@296 -- # x722=() 00:21:51.904 21:11:47 -- nvmf/common.sh@296 -- # local -ga x722 00:21:51.904 21:11:47 -- nvmf/common.sh@297 -- # mlx=() 00:21:51.904 21:11:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:51.904 21:11:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:51.904 21:11:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.904 21:11:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:51.904 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:51.904 21:11:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.904 21:11:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:51.904 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:51.904 21:11:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.904 21:11:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.904 21:11:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.904 21:11:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:51.904 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:51.904 21:11:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.904 21:11:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.904 21:11:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.904 21:11:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:51.904 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:51.904 21:11:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:51.904 21:11:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:51.904 21:11:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:51.904 21:11:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:51.904 21:11:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:51.904 21:11:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:51.904 21:11:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:51.904 21:11:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:51.904 21:11:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:51.904 21:11:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:51.904 21:11:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:51.904 21:11:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:51.904 21:11:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:51.904 21:11:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:51.904 21:11:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:51.904 21:11:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:51.904 21:11:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:51.904 21:11:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:51.904 21:11:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:51.904 21:11:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:51.904 21:11:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:51.904 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:51.904 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:21:51.904 00:21:51.904 --- 10.0.0.2 ping statistics --- 00:21:51.904 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:51.904 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:21:51.904 21:11:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:51.904 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:51.904 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:21:51.904 00:21:51.904 --- 10.0.0.1 ping statistics --- 00:21:51.904 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:51.904 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:21:51.904 21:11:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:51.904 21:11:47 -- nvmf/common.sh@410 -- # return 0 00:21:51.904 21:11:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:51.904 21:11:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:51.904 21:11:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:51.904 21:11:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:51.904 21:11:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:51.904 21:11:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:51.904 21:11:47 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:51.904 21:11:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:51.904 21:11:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:51.904 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.904 21:11:47 -- nvmf/common.sh@469 -- # nvmfpid=4041341 00:21:51.904 21:11:47 -- nvmf/common.sh@470 -- # waitforlisten 4041341 00:21:51.904 21:11:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:51.904 21:11:47 -- common/autotest_common.sh@829 -- # '[' -z 4041341 ']' 00:21:51.904 21:11:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:51.904 21:11:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:51.904 21:11:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:51.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:51.904 21:11:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:51.904 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.904 [2024-11-27 21:11:47.606203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:51.904 [2024-11-27 21:11:47.606269] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:51.904 EAL: No free 2048 kB hugepages reported on node 1 00:21:51.905 [2024-11-27 21:11:47.669474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:51.905 [2024-11-27 21:11:47.792056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:51.905 [2024-11-27 21:11:47.792223] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:51.905 [2024-11-27 21:11:47.792243] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:51.905 [2024-11-27 21:11:47.792265] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:51.905 [2024-11-27 21:11:47.792336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:51.905 [2024-11-27 21:11:47.792374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:51.905 [2024-11-27 21:11:47.792400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:51.905 [2024-11-27 21:11:47.792403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:51.905 21:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:51.905 21:11:47 -- common/autotest_common.sh@862 -- # return 0 00:21:51.905 21:11:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:51.905 21:11:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 21:11:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:51.905 21:11:47 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:51.905 21:11:47 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 [2024-11-27 21:11:47.954398] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 Malloc1 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:51.905 21:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:47 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 21:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:47 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:51.905 21:11:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.905 21:11:48 -- common/autotest_common.sh@10 -- # set +x 00:21:51.905 [2024-11-27 21:11:48.005424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:51.905 21:11:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.905 21:11:48 -- target/perf_adq.sh@73 -- # perfpid=4041487 00:21:51.905 21:11:48 -- target/perf_adq.sh@74 -- # sleep 2 00:21:51.905 21:11:48 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:51.905 EAL: No free 2048 kB hugepages reported on node 1 00:21:53.807 21:11:50 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:53.807 21:11:50 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:53.807 21:11:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:53.807 21:11:50 -- target/perf_adq.sh@76 -- # wc -l 00:21:53.807 21:11:50 -- common/autotest_common.sh@10 -- # set +x 00:21:53.807 21:11:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:54.065 21:11:50 -- target/perf_adq.sh@76 -- # count=4 00:21:54.065 21:11:50 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:54.065 21:11:50 -- target/perf_adq.sh@81 -- # wait 4041487 00:22:02.178 Initializing NVMe Controllers 00:22:02.178 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:02.178 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:02.178 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:02.178 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:02.178 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:02.178 Initialization complete. Launching workers. 00:22:02.178 ======================================================== 00:22:02.178 Latency(us) 00:22:02.178 Device Information : IOPS MiB/s Average min max 00:22:02.178 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10839.90 42.34 5904.30 1680.22 10065.24 00:22:02.178 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11019.50 43.04 5808.65 1574.84 9812.31 00:22:02.178 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10864.80 42.44 5891.90 1321.93 10309.73 00:22:02.178 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11390.20 44.49 5619.26 1652.92 9672.96 00:22:02.178 ======================================================== 00:22:02.178 Total : 44114.40 172.32 5803.75 1321.93 10309.73 00:22:02.178 00:22:02.178 21:11:58 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:02.178 21:11:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:02.178 21:11:58 -- nvmf/common.sh@116 -- # sync 00:22:02.178 21:11:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:02.178 21:11:58 -- nvmf/common.sh@119 -- # set +e 00:22:02.178 21:11:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:02.178 21:11:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:02.178 rmmod nvme_tcp 00:22:02.178 rmmod nvme_fabrics 00:22:02.178 rmmod nvme_keyring 00:22:02.178 21:11:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:02.178 21:11:58 -- nvmf/common.sh@123 -- # set -e 00:22:02.178 21:11:58 -- nvmf/common.sh@124 -- # return 0 00:22:02.178 21:11:58 -- nvmf/common.sh@477 -- # '[' -n 4041341 ']' 00:22:02.178 21:11:58 -- nvmf/common.sh@478 -- # killprocess 4041341 00:22:02.178 21:11:58 -- common/autotest_common.sh@936 -- # '[' -z 4041341 ']' 00:22:02.178 21:11:58 -- common/autotest_common.sh@940 -- # kill -0 4041341 00:22:02.178 21:11:58 -- common/autotest_common.sh@941 -- # uname 00:22:02.178 21:11:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:02.178 21:11:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4041341 00:22:02.178 21:11:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:02.178 21:11:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:02.178 21:11:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4041341' 00:22:02.178 killing process with pid 4041341 00:22:02.178 21:11:58 -- common/autotest_common.sh@955 -- # kill 4041341 00:22:02.178 21:11:58 -- common/autotest_common.sh@960 -- # wait 4041341 00:22:02.438 21:11:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:02.438 21:11:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:02.438 21:11:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:02.438 21:11:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:02.438 21:11:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:02.438 21:11:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:02.438 21:11:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:02.438 21:11:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:04.972 21:12:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:04.973 21:12:00 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:04.973 21:12:00 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:05.539 21:12:01 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:08.068 21:12:03 -- target/perf_adq.sh@54 -- # sleep 5 00:22:13.339 21:12:08 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:13.339 21:12:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:13.339 21:12:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:13.339 21:12:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:13.339 21:12:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:13.339 21:12:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:13.339 21:12:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.339 21:12:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.339 21:12:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:13.339 21:12:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:13.339 21:12:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:13.339 21:12:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:13.339 21:12:08 -- common/autotest_common.sh@10 -- # set +x 00:22:13.339 21:12:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:13.339 21:12:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:13.339 21:12:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:13.339 21:12:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:13.339 21:12:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:13.339 21:12:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:13.339 21:12:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:13.339 21:12:08 -- nvmf/common.sh@294 -- # net_devs=() 00:22:13.339 21:12:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:13.339 21:12:08 -- nvmf/common.sh@295 -- # e810=() 00:22:13.339 21:12:08 -- nvmf/common.sh@295 -- # local -ga e810 00:22:13.339 21:12:08 -- nvmf/common.sh@296 -- # x722=() 00:22:13.339 21:12:08 -- nvmf/common.sh@296 -- # local -ga x722 00:22:13.339 21:12:08 -- nvmf/common.sh@297 -- # mlx=() 00:22:13.339 21:12:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:13.339 21:12:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:13.339 21:12:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:13.339 21:12:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:13.339 21:12:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:13.340 21:12:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.340 21:12:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:13.340 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:13.340 21:12:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.340 21:12:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:13.340 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:13.340 21:12:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.340 21:12:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.340 21:12:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.340 21:12:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:13.340 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:13.340 21:12:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.340 21:12:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.340 21:12:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.340 21:12:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.340 21:12:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:13.340 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:13.340 21:12:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.340 21:12:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:13.340 21:12:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:13.340 21:12:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:13.340 21:12:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:13.340 21:12:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:13.340 21:12:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:13.340 21:12:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:13.340 21:12:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:13.340 21:12:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:13.340 21:12:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:13.340 21:12:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:13.340 21:12:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:13.340 21:12:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:13.340 21:12:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:13.340 21:12:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:13.340 21:12:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:13.340 21:12:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:13.340 21:12:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:13.340 21:12:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:13.340 21:12:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:13.340 21:12:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:13.340 21:12:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:13.340 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:13.340 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:22:13.340 00:22:13.340 --- 10.0.0.2 ping statistics --- 00:22:13.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.340 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:22:13.340 21:12:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:13.340 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:13.340 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:22:13.340 00:22:13.340 --- 10.0.0.1 ping statistics --- 00:22:13.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.340 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:22:13.340 21:12:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:13.340 21:12:08 -- nvmf/common.sh@410 -- # return 0 00:22:13.340 21:12:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:13.340 21:12:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:13.340 21:12:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:13.340 21:12:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:13.340 21:12:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:13.340 21:12:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:13.340 21:12:08 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:13.340 21:12:08 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:13.340 21:12:08 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:13.340 21:12:08 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:13.340 net.core.busy_poll = 1 00:22:13.340 21:12:08 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:13.340 net.core.busy_read = 1 00:22:13.340 21:12:08 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:13.340 21:12:08 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:13.340 21:12:08 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:13.340 21:12:08 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:13.340 21:12:08 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:13.340 21:12:09 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:13.340 21:12:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:13.340 21:12:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 21:12:09 -- nvmf/common.sh@469 -- # nvmfpid=4044801 00:22:13.340 21:12:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:13.340 21:12:09 -- nvmf/common.sh@470 -- # waitforlisten 4044801 00:22:13.340 21:12:09 -- common/autotest_common.sh@829 -- # '[' -z 4044801 ']' 00:22:13.340 21:12:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:13.340 21:12:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:13.340 21:12:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:13.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:13.340 21:12:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 [2024-11-27 21:12:09.071383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:13.340 [2024-11-27 21:12:09.071462] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:13.340 EAL: No free 2048 kB hugepages reported on node 1 00:22:13.340 [2024-11-27 21:12:09.135740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:13.340 [2024-11-27 21:12:09.246817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:13.340 [2024-11-27 21:12:09.246984] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:13.340 [2024-11-27 21:12:09.247001] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:13.340 [2024-11-27 21:12:09.247013] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:13.340 [2024-11-27 21:12:09.247127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:13.340 [2024-11-27 21:12:09.247191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:13.340 [2024-11-27 21:12:09.247259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:13.340 [2024-11-27 21:12:09.247262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:13.340 21:12:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:13.340 21:12:09 -- common/autotest_common.sh@862 -- # return 0 00:22:13.340 21:12:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:13.340 21:12:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 21:12:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:13.340 21:12:09 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:13.340 21:12:09 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:13.340 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.340 21:12:09 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:13.340 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.340 21:12:09 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:13.340 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.340 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.340 [2024-11-27 21:12:09.439309] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:13.340 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.340 21:12:09 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:13.341 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.341 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.341 Malloc1 00:22:13.341 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.341 21:12:09 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:13.341 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.341 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.341 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.341 21:12:09 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:13.341 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.341 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.341 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.341 21:12:09 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:13.341 21:12:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.341 21:12:09 -- common/autotest_common.sh@10 -- # set +x 00:22:13.341 [2024-11-27 21:12:09.490379] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:13.341 21:12:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.341 21:12:09 -- target/perf_adq.sh@94 -- # perfpid=4044953 00:22:13.341 21:12:09 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:13.341 21:12:09 -- target/perf_adq.sh@95 -- # sleep 2 00:22:13.341 EAL: No free 2048 kB hugepages reported on node 1 00:22:15.891 21:12:11 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:15.891 21:12:11 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:15.891 21:12:11 -- target/perf_adq.sh@97 -- # wc -l 00:22:15.891 21:12:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:15.891 21:12:11 -- common/autotest_common.sh@10 -- # set +x 00:22:15.891 21:12:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:15.891 21:12:11 -- target/perf_adq.sh@97 -- # count=2 00:22:15.891 21:12:11 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:15.891 21:12:11 -- target/perf_adq.sh@103 -- # wait 4044953 00:22:24.004 Initializing NVMe Controllers 00:22:24.004 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:24.004 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:24.004 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:24.004 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:24.004 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:24.004 Initialization complete. Launching workers. 00:22:24.004 ======================================================== 00:22:24.004 Latency(us) 00:22:24.004 Device Information : IOPS MiB/s Average min max 00:22:24.004 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4249.70 16.60 15063.64 1875.56 61471.81 00:22:24.004 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4927.10 19.25 12991.39 1703.87 61908.28 00:22:24.004 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4637.70 18.12 13802.36 1814.61 61174.35 00:22:24.004 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 13632.70 53.25 4694.72 1102.30 45955.99 00:22:24.004 ======================================================== 00:22:24.004 Total : 27447.20 107.22 9328.41 1102.30 61908.28 00:22:24.004 00:22:24.004 21:12:19 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:24.004 21:12:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:24.004 21:12:19 -- nvmf/common.sh@116 -- # sync 00:22:24.004 21:12:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:24.004 21:12:19 -- nvmf/common.sh@119 -- # set +e 00:22:24.004 21:12:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:24.004 21:12:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:24.004 rmmod nvme_tcp 00:22:24.004 rmmod nvme_fabrics 00:22:24.004 rmmod nvme_keyring 00:22:24.004 21:12:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:24.004 21:12:19 -- nvmf/common.sh@123 -- # set -e 00:22:24.004 21:12:19 -- nvmf/common.sh@124 -- # return 0 00:22:24.004 21:12:19 -- nvmf/common.sh@477 -- # '[' -n 4044801 ']' 00:22:24.004 21:12:19 -- nvmf/common.sh@478 -- # killprocess 4044801 00:22:24.004 21:12:19 -- common/autotest_common.sh@936 -- # '[' -z 4044801 ']' 00:22:24.004 21:12:19 -- common/autotest_common.sh@940 -- # kill -0 4044801 00:22:24.004 21:12:19 -- common/autotest_common.sh@941 -- # uname 00:22:24.004 21:12:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:24.004 21:12:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4044801 00:22:24.004 21:12:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:24.004 21:12:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:24.004 21:12:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4044801' 00:22:24.004 killing process with pid 4044801 00:22:24.004 21:12:19 -- common/autotest_common.sh@955 -- # kill 4044801 00:22:24.004 21:12:19 -- common/autotest_common.sh@960 -- # wait 4044801 00:22:24.004 21:12:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:24.004 21:12:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:24.004 21:12:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:24.004 21:12:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:24.004 21:12:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:24.004 21:12:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:24.004 21:12:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:24.004 21:12:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:27.292 21:12:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:27.292 21:12:23 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:27.292 00:22:27.292 real 0m45.982s 00:22:27.292 user 2m35.586s 00:22:27.292 sys 0m11.085s 00:22:27.292 21:12:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:27.292 21:12:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.292 ************************************ 00:22:27.292 END TEST nvmf_perf_adq 00:22:27.292 ************************************ 00:22:27.292 21:12:23 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:27.292 21:12:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:27.292 21:12:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.292 ************************************ 00:22:27.292 START TEST nvmf_shutdown 00:22:27.292 ************************************ 00:22:27.292 21:12:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:27.292 * Looking for test storage... 00:22:27.292 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:27.292 21:12:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:27.292 21:12:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:27.292 21:12:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:27.292 21:12:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:27.292 21:12:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:27.292 21:12:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:27.292 21:12:23 -- scripts/common.sh@335 -- # IFS=.-: 00:22:27.292 21:12:23 -- scripts/common.sh@335 -- # read -ra ver1 00:22:27.292 21:12:23 -- scripts/common.sh@336 -- # IFS=.-: 00:22:27.292 21:12:23 -- scripts/common.sh@336 -- # read -ra ver2 00:22:27.292 21:12:23 -- scripts/common.sh@337 -- # local 'op=<' 00:22:27.292 21:12:23 -- scripts/common.sh@339 -- # ver1_l=2 00:22:27.292 21:12:23 -- scripts/common.sh@340 -- # ver2_l=1 00:22:27.292 21:12:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:27.292 21:12:23 -- scripts/common.sh@343 -- # case "$op" in 00:22:27.292 21:12:23 -- scripts/common.sh@344 -- # : 1 00:22:27.292 21:12:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:27.292 21:12:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:27.292 21:12:23 -- scripts/common.sh@364 -- # decimal 1 00:22:27.292 21:12:23 -- scripts/common.sh@352 -- # local d=1 00:22:27.292 21:12:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:27.292 21:12:23 -- scripts/common.sh@354 -- # echo 1 00:22:27.292 21:12:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:27.292 21:12:23 -- scripts/common.sh@365 -- # decimal 2 00:22:27.292 21:12:23 -- scripts/common.sh@352 -- # local d=2 00:22:27.292 21:12:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:27.292 21:12:23 -- scripts/common.sh@354 -- # echo 2 00:22:27.292 21:12:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:27.292 21:12:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:27.292 21:12:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:27.292 21:12:23 -- scripts/common.sh@367 -- # return 0 00:22:27.292 21:12:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:27.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.292 --rc genhtml_branch_coverage=1 00:22:27.292 --rc genhtml_function_coverage=1 00:22:27.292 --rc genhtml_legend=1 00:22:27.292 --rc geninfo_all_blocks=1 00:22:27.292 --rc geninfo_unexecuted_blocks=1 00:22:27.292 00:22:27.292 ' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:27.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.292 --rc genhtml_branch_coverage=1 00:22:27.292 --rc genhtml_function_coverage=1 00:22:27.292 --rc genhtml_legend=1 00:22:27.292 --rc geninfo_all_blocks=1 00:22:27.292 --rc geninfo_unexecuted_blocks=1 00:22:27.292 00:22:27.292 ' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:27.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.292 --rc genhtml_branch_coverage=1 00:22:27.292 --rc genhtml_function_coverage=1 00:22:27.292 --rc genhtml_legend=1 00:22:27.292 --rc geninfo_all_blocks=1 00:22:27.292 --rc geninfo_unexecuted_blocks=1 00:22:27.292 00:22:27.292 ' 00:22:27.292 21:12:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:27.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:27.292 --rc genhtml_branch_coverage=1 00:22:27.292 --rc genhtml_function_coverage=1 00:22:27.292 --rc genhtml_legend=1 00:22:27.292 --rc geninfo_all_blocks=1 00:22:27.292 --rc geninfo_unexecuted_blocks=1 00:22:27.292 00:22:27.292 ' 00:22:27.292 21:12:23 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:27.292 21:12:23 -- nvmf/common.sh@7 -- # uname -s 00:22:27.292 21:12:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:27.292 21:12:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:27.292 21:12:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:27.292 21:12:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:27.292 21:12:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:27.292 21:12:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:27.292 21:12:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:27.292 21:12:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:27.292 21:12:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:27.292 21:12:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:27.292 21:12:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.292 21:12:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.292 21:12:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:27.292 21:12:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:27.292 21:12:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:27.292 21:12:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:27.292 21:12:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:27.292 21:12:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:27.292 21:12:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:27.293 21:12:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.293 21:12:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.293 21:12:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.293 21:12:23 -- paths/export.sh@5 -- # export PATH 00:22:27.293 21:12:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.293 21:12:23 -- nvmf/common.sh@46 -- # : 0 00:22:27.293 21:12:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:27.293 21:12:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:27.293 21:12:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:27.293 21:12:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:27.293 21:12:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:27.293 21:12:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:27.293 21:12:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:27.293 21:12:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:27.293 21:12:23 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:27.293 21:12:23 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:27.293 21:12:23 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:27.293 21:12:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:27.293 21:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:27.293 21:12:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.293 ************************************ 00:22:27.293 START TEST nvmf_shutdown_tc1 00:22:27.293 ************************************ 00:22:27.293 21:12:23 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:27.293 21:12:23 -- target/shutdown.sh@74 -- # starttarget 00:22:27.293 21:12:23 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:27.293 21:12:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:27.293 21:12:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:27.293 21:12:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:27.293 21:12:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:27.293 21:12:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:27.293 21:12:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.293 21:12:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.293 21:12:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:27.293 21:12:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:27.293 21:12:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:27.293 21:12:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:27.293 21:12:23 -- common/autotest_common.sh@10 -- # set +x 00:22:29.198 21:12:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:29.198 21:12:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:29.198 21:12:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:29.198 21:12:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:29.198 21:12:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:29.198 21:12:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:29.198 21:12:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:29.198 21:12:25 -- nvmf/common.sh@294 -- # net_devs=() 00:22:29.198 21:12:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:29.198 21:12:25 -- nvmf/common.sh@295 -- # e810=() 00:22:29.198 21:12:25 -- nvmf/common.sh@295 -- # local -ga e810 00:22:29.198 21:12:25 -- nvmf/common.sh@296 -- # x722=() 00:22:29.198 21:12:25 -- nvmf/common.sh@296 -- # local -ga x722 00:22:29.198 21:12:25 -- nvmf/common.sh@297 -- # mlx=() 00:22:29.198 21:12:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:29.198 21:12:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:29.198 21:12:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:29.198 21:12:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:29.198 21:12:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:29.198 21:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.198 21:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:29.198 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:29.198 21:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.198 21:12:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:29.198 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:29.198 21:12:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.198 21:12:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:29.199 21:12:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.199 21:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.199 21:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.199 21:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.199 21:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:29.199 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:29.199 21:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.199 21:12:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.199 21:12:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.199 21:12:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.199 21:12:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.199 21:12:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:29.199 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:29.199 21:12:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.199 21:12:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:29.199 21:12:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:29.199 21:12:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:29.199 21:12:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:29.199 21:12:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:29.199 21:12:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:29.199 21:12:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:29.199 21:12:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:29.199 21:12:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:29.199 21:12:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:29.199 21:12:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:29.199 21:12:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:29.199 21:12:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:29.199 21:12:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:29.199 21:12:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:29.199 21:12:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:29.199 21:12:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:29.199 21:12:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:29.199 21:12:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:29.199 21:12:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:29.199 21:12:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:29.199 21:12:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:29.199 21:12:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:29.199 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:29.199 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:22:29.199 00:22:29.199 --- 10.0.0.2 ping statistics --- 00:22:29.199 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.199 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:22:29.199 21:12:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:29.199 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:29.199 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:29.199 00:22:29.199 --- 10.0.0.1 ping statistics --- 00:22:29.199 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.199 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:29.199 21:12:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:29.199 21:12:25 -- nvmf/common.sh@410 -- # return 0 00:22:29.199 21:12:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:29.199 21:12:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:29.199 21:12:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:29.199 21:12:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:29.199 21:12:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:29.199 21:12:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:29.199 21:12:25 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:29.199 21:12:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:29.199 21:12:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:29.199 21:12:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.199 21:12:25 -- nvmf/common.sh@469 -- # nvmfpid=4048250 00:22:29.199 21:12:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:29.199 21:12:25 -- nvmf/common.sh@470 -- # waitforlisten 4048250 00:22:29.199 21:12:25 -- common/autotest_common.sh@829 -- # '[' -z 4048250 ']' 00:22:29.199 21:12:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:29.199 21:12:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:29.199 21:12:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:29.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:29.199 21:12:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:29.199 21:12:25 -- common/autotest_common.sh@10 -- # set +x 00:22:29.199 [2024-11-27 21:12:25.353705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:29.199 [2024-11-27 21:12:25.353780] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:29.199 EAL: No free 2048 kB hugepages reported on node 1 00:22:29.199 [2024-11-27 21:12:25.418445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:29.456 [2024-11-27 21:12:25.531873] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:29.456 [2024-11-27 21:12:25.532045] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:29.456 [2024-11-27 21:12:25.532064] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:29.456 [2024-11-27 21:12:25.532077] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:29.456 [2024-11-27 21:12:25.532229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:29.456 [2024-11-27 21:12:25.532283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:29.456 [2024-11-27 21:12:25.532407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:29.456 [2024-11-27 21:12:25.532410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.386 21:12:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:30.386 21:12:26 -- common/autotest_common.sh@862 -- # return 0 00:22:30.386 21:12:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:30.386 21:12:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.386 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.386 21:12:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:30.386 21:12:26 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:30.386 21:12:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.386 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.386 [2024-11-27 21:12:26.350115] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:30.386 21:12:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.386 21:12:26 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:30.386 21:12:26 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:30.386 21:12:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.386 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.386 21:12:26 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.386 21:12:26 -- target/shutdown.sh@28 -- # cat 00:22:30.386 21:12:26 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:30.386 21:12:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.386 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.386 Malloc1 00:22:30.386 [2024-11-27 21:12:26.426179] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:30.386 Malloc2 00:22:30.386 Malloc3 00:22:30.386 Malloc4 00:22:30.386 Malloc5 00:22:30.643 Malloc6 00:22:30.643 Malloc7 00:22:30.643 Malloc8 00:22:30.643 Malloc9 00:22:30.643 Malloc10 00:22:30.643 21:12:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.643 21:12:26 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:30.643 21:12:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.643 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.900 21:12:26 -- target/shutdown.sh@78 -- # perfpid=4048490 00:22:30.900 21:12:26 -- target/shutdown.sh@79 -- # waitforlisten 4048490 /var/tmp/bdevperf.sock 00:22:30.900 21:12:26 -- common/autotest_common.sh@829 -- # '[' -z 4048490 ']' 00:22:30.900 21:12:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:30.900 21:12:26 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:30.900 21:12:26 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:30.900 21:12:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.900 21:12:26 -- nvmf/common.sh@520 -- # config=() 00:22:30.900 21:12:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:30.900 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:30.900 21:12:26 -- nvmf/common.sh@520 -- # local subsystem config 00:22:30.900 21:12:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.900 21:12:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.900 "name": "Nvme$subsystem", 00:22:30.900 "trtype": "$TEST_TRANSPORT", 00:22:30.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.900 "adrfam": "ipv4", 00:22:30.900 "trsvcid": "$NVMF_PORT", 00:22:30.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.900 "hdgst": ${hdgst:-false}, 00:22:30.900 "ddgst": ${ddgst:-false} 00:22:30.900 }, 00:22:30.900 "method": "bdev_nvme_attach_controller" 00:22:30.900 } 00:22:30.900 EOF 00:22:30.900 )") 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.900 "name": "Nvme$subsystem", 00:22:30.900 "trtype": "$TEST_TRANSPORT", 00:22:30.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.900 "adrfam": "ipv4", 00:22:30.900 "trsvcid": "$NVMF_PORT", 00:22:30.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.900 "hdgst": ${hdgst:-false}, 00:22:30.900 "ddgst": ${ddgst:-false} 00:22:30.900 }, 00:22:30.900 "method": "bdev_nvme_attach_controller" 00:22:30.900 } 00:22:30.900 EOF 00:22:30.900 )") 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.900 "name": "Nvme$subsystem", 00:22:30.900 "trtype": "$TEST_TRANSPORT", 00:22:30.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.900 "adrfam": "ipv4", 00:22:30.900 "trsvcid": "$NVMF_PORT", 00:22:30.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.900 "hdgst": ${hdgst:-false}, 00:22:30.900 "ddgst": ${ddgst:-false} 00:22:30.900 }, 00:22:30.900 "method": "bdev_nvme_attach_controller" 00:22:30.900 } 00:22:30.900 EOF 00:22:30.900 )") 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.900 "name": "Nvme$subsystem", 00:22:30.900 "trtype": "$TEST_TRANSPORT", 00:22:30.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.900 "adrfam": "ipv4", 00:22:30.900 "trsvcid": "$NVMF_PORT", 00:22:30.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.900 "hdgst": ${hdgst:-false}, 00:22:30.900 "ddgst": ${ddgst:-false} 00:22:30.900 }, 00:22:30.900 "method": "bdev_nvme_attach_controller" 00:22:30.900 } 00:22:30.900 EOF 00:22:30.900 )") 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.900 "name": "Nvme$subsystem", 00:22:30.900 "trtype": "$TEST_TRANSPORT", 00:22:30.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.900 "adrfam": "ipv4", 00:22:30.900 "trsvcid": "$NVMF_PORT", 00:22:30.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.900 "hdgst": ${hdgst:-false}, 00:22:30.900 "ddgst": ${ddgst:-false} 00:22:30.900 }, 00:22:30.900 "method": "bdev_nvme_attach_controller" 00:22:30.900 } 00:22:30.900 EOF 00:22:30.900 )") 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.900 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.900 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.900 { 00:22:30.900 "params": { 00:22:30.901 "name": "Nvme$subsystem", 00:22:30.901 "trtype": "$TEST_TRANSPORT", 00:22:30.901 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "$NVMF_PORT", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.901 "hdgst": ${hdgst:-false}, 00:22:30.901 "ddgst": ${ddgst:-false} 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 } 00:22:30.901 EOF 00:22:30.901 )") 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.901 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.901 { 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme$subsystem", 00:22:30.901 "trtype": "$TEST_TRANSPORT", 00:22:30.901 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "$NVMF_PORT", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.901 "hdgst": ${hdgst:-false}, 00:22:30.901 "ddgst": ${ddgst:-false} 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 } 00:22:30.901 EOF 00:22:30.901 )") 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.901 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.901 { 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme$subsystem", 00:22:30.901 "trtype": "$TEST_TRANSPORT", 00:22:30.901 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "$NVMF_PORT", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.901 "hdgst": ${hdgst:-false}, 00:22:30.901 "ddgst": ${ddgst:-false} 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 } 00:22:30.901 EOF 00:22:30.901 )") 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.901 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.901 { 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme$subsystem", 00:22:30.901 "trtype": "$TEST_TRANSPORT", 00:22:30.901 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "$NVMF_PORT", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.901 "hdgst": ${hdgst:-false}, 00:22:30.901 "ddgst": ${ddgst:-false} 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 } 00:22:30.901 EOF 00:22:30.901 )") 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.901 21:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.901 { 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme$subsystem", 00:22:30.901 "trtype": "$TEST_TRANSPORT", 00:22:30.901 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "$NVMF_PORT", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.901 "hdgst": ${hdgst:-false}, 00:22:30.901 "ddgst": ${ddgst:-false} 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 } 00:22:30.901 EOF 00:22:30.901 )") 00:22:30.901 21:12:26 -- nvmf/common.sh@542 -- # cat 00:22:30.901 21:12:26 -- nvmf/common.sh@544 -- # jq . 00:22:30.901 21:12:26 -- nvmf/common.sh@545 -- # IFS=, 00:22:30.901 21:12:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme1", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 },{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme2", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 },{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme3", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 },{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme4", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 },{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme5", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.901 "method": "bdev_nvme_attach_controller" 00:22:30.901 },{ 00:22:30.901 "params": { 00:22:30.901 "name": "Nvme6", 00:22:30.901 "trtype": "tcp", 00:22:30.901 "traddr": "10.0.0.2", 00:22:30.901 "adrfam": "ipv4", 00:22:30.901 "trsvcid": "4420", 00:22:30.901 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:30.901 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:30.901 "hdgst": false, 00:22:30.901 "ddgst": false 00:22:30.901 }, 00:22:30.902 "method": "bdev_nvme_attach_controller" 00:22:30.902 },{ 00:22:30.902 "params": { 00:22:30.902 "name": "Nvme7", 00:22:30.902 "trtype": "tcp", 00:22:30.902 "traddr": "10.0.0.2", 00:22:30.902 "adrfam": "ipv4", 00:22:30.902 "trsvcid": "4420", 00:22:30.902 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:30.902 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:30.902 "hdgst": false, 00:22:30.902 "ddgst": false 00:22:30.902 }, 00:22:30.902 "method": "bdev_nvme_attach_controller" 00:22:30.902 },{ 00:22:30.902 "params": { 00:22:30.902 "name": "Nvme8", 00:22:30.902 "trtype": "tcp", 00:22:30.902 "traddr": "10.0.0.2", 00:22:30.902 "adrfam": "ipv4", 00:22:30.902 "trsvcid": "4420", 00:22:30.902 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:30.902 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:30.902 "hdgst": false, 00:22:30.902 "ddgst": false 00:22:30.902 }, 00:22:30.902 "method": "bdev_nvme_attach_controller" 00:22:30.902 },{ 00:22:30.902 "params": { 00:22:30.902 "name": "Nvme9", 00:22:30.902 "trtype": "tcp", 00:22:30.902 "traddr": "10.0.0.2", 00:22:30.902 "adrfam": "ipv4", 00:22:30.902 "trsvcid": "4420", 00:22:30.902 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:30.902 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:30.902 "hdgst": false, 00:22:30.902 "ddgst": false 00:22:30.902 }, 00:22:30.902 "method": "bdev_nvme_attach_controller" 00:22:30.902 },{ 00:22:30.902 "params": { 00:22:30.902 "name": "Nvme10", 00:22:30.902 "trtype": "tcp", 00:22:30.902 "traddr": "10.0.0.2", 00:22:30.902 "adrfam": "ipv4", 00:22:30.902 "trsvcid": "4420", 00:22:30.902 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:30.902 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:30.902 "hdgst": false, 00:22:30.902 "ddgst": false 00:22:30.902 }, 00:22:30.902 "method": "bdev_nvme_attach_controller" 00:22:30.902 }' 00:22:30.902 [2024-11-27 21:12:26.933671] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.902 [2024-11-27 21:12:26.933748] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:30.902 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.902 [2024-11-27 21:12:26.996545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:30.902 [2024-11-27 21:12:27.104332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:32.796 21:12:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:32.796 21:12:28 -- common/autotest_common.sh@862 -- # return 0 00:22:32.796 21:12:28 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:32.796 21:12:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:32.796 21:12:28 -- common/autotest_common.sh@10 -- # set +x 00:22:32.796 21:12:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:32.796 21:12:28 -- target/shutdown.sh@83 -- # kill -9 4048490 00:22:32.796 21:12:28 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:32.796 21:12:28 -- target/shutdown.sh@87 -- # sleep 1 00:22:33.805 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 4048490 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:33.805 21:12:29 -- target/shutdown.sh@88 -- # kill -0 4048250 00:22:33.805 21:12:29 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:33.805 21:12:29 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:33.805 21:12:29 -- nvmf/common.sh@520 -- # config=() 00:22:33.805 21:12:29 -- nvmf/common.sh@520 -- # local subsystem config 00:22:33.805 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.805 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.805 { 00:22:33.805 "params": { 00:22:33.805 "name": "Nvme$subsystem", 00:22:33.805 "trtype": "$TEST_TRANSPORT", 00:22:33.805 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.805 "adrfam": "ipv4", 00:22:33.805 "trsvcid": "$NVMF_PORT", 00:22:33.805 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.805 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.805 "hdgst": ${hdgst:-false}, 00:22:33.805 "ddgst": ${ddgst:-false} 00:22:33.805 }, 00:22:33.805 "method": "bdev_nvme_attach_controller" 00:22:33.805 } 00:22:33.805 EOF 00:22:33.805 )") 00:22:33.805 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.805 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.805 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.805 { 00:22:33.805 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:33.806 { 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme$subsystem", 00:22:33.806 "trtype": "$TEST_TRANSPORT", 00:22:33.806 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "$NVMF_PORT", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:33.806 "hdgst": ${hdgst:-false}, 00:22:33.806 "ddgst": ${ddgst:-false} 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 } 00:22:33.806 EOF 00:22:33.806 )") 00:22:33.806 21:12:29 -- nvmf/common.sh@542 -- # cat 00:22:33.806 21:12:29 -- nvmf/common.sh@544 -- # jq . 00:22:33.806 21:12:29 -- nvmf/common.sh@545 -- # IFS=, 00:22:33.806 21:12:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme1", 00:22:33.806 "trtype": "tcp", 00:22:33.806 "traddr": "10.0.0.2", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "4420", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:33.806 "hdgst": false, 00:22:33.806 "ddgst": false 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 },{ 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme2", 00:22:33.806 "trtype": "tcp", 00:22:33.806 "traddr": "10.0.0.2", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "4420", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:33.806 "hdgst": false, 00:22:33.806 "ddgst": false 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 },{ 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme3", 00:22:33.806 "trtype": "tcp", 00:22:33.806 "traddr": "10.0.0.2", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "4420", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:33.806 "hdgst": false, 00:22:33.806 "ddgst": false 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 },{ 00:22:33.806 "params": { 00:22:33.806 "name": "Nvme4", 00:22:33.806 "trtype": "tcp", 00:22:33.806 "traddr": "10.0.0.2", 00:22:33.806 "adrfam": "ipv4", 00:22:33.806 "trsvcid": "4420", 00:22:33.806 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:33.806 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:33.806 "hdgst": false, 00:22:33.806 "ddgst": false 00:22:33.806 }, 00:22:33.806 "method": "bdev_nvme_attach_controller" 00:22:33.806 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme5", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme6", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme7", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme8", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme9", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 },{ 00:22:33.807 "params": { 00:22:33.807 "name": "Nvme10", 00:22:33.807 "trtype": "tcp", 00:22:33.807 "traddr": "10.0.0.2", 00:22:33.807 "adrfam": "ipv4", 00:22:33.807 "trsvcid": "4420", 00:22:33.807 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:33.807 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:33.807 "hdgst": false, 00:22:33.807 "ddgst": false 00:22:33.807 }, 00:22:33.807 "method": "bdev_nvme_attach_controller" 00:22:33.807 }' 00:22:33.807 [2024-11-27 21:12:29.714060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.807 [2024-11-27 21:12:29.714135] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4048809 ] 00:22:33.807 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.807 [2024-11-27 21:12:29.778354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:33.807 [2024-11-27 21:12:29.888798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:35.181 Running I/O for 1 seconds... 00:22:36.555 00:22:36.555 Latency(us) 00:22:36.555 [2024-11-27T20:12:32.796Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme1n1 : 1.10 396.15 24.76 0.00 0.00 158670.61 19126.80 119615.34 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme2n1 : 1.10 393.77 24.61 0.00 0.00 158499.02 19320.98 122722.23 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme3n1 : 1.10 394.56 24.66 0.00 0.00 157034.17 19612.25 127382.57 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme4n1 : 1.11 392.70 24.54 0.00 0.00 156621.42 20291.89 118061.89 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme5n1 : 1.11 391.16 24.45 0.00 0.00 156127.24 20486.07 118838.61 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme6n1 : 1.11 389.71 24.36 0.00 0.00 156074.90 16408.27 122722.23 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme7n1 : 1.12 388.10 24.26 0.00 0.00 156296.09 10679.94 125829.12 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme8n1 : 1.09 363.92 22.75 0.00 0.00 163619.23 32622.36 128936.01 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme9n1 : 1.12 387.43 24.21 0.00 0.00 154783.36 8107.05 127382.57 00:22:36.555 [2024-11-27T20:12:32.796Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.555 Verification LBA range: start 0x0 length 0x400 00:22:36.555 Nvme10n1 : 1.12 386.43 24.15 0.00 0.00 154383.50 6019.60 137479.96 00:22:36.555 [2024-11-27T20:12:32.796Z] =================================================================================================================== 00:22:36.555 [2024-11-27T20:12:32.797Z] Total : 3883.93 242.75 0.00 0.00 157157.35 6019.60 137479.96 00:22:36.556 21:12:32 -- target/shutdown.sh@93 -- # stoptarget 00:22:36.556 21:12:32 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:36.556 21:12:32 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:36.556 21:12:32 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:36.556 21:12:32 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:36.556 21:12:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:36.556 21:12:32 -- nvmf/common.sh@116 -- # sync 00:22:36.556 21:12:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:36.556 21:12:32 -- nvmf/common.sh@119 -- # set +e 00:22:36.556 21:12:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:36.556 21:12:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:36.556 rmmod nvme_tcp 00:22:36.556 rmmod nvme_fabrics 00:22:36.556 rmmod nvme_keyring 00:22:36.814 21:12:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:36.814 21:12:32 -- nvmf/common.sh@123 -- # set -e 00:22:36.814 21:12:32 -- nvmf/common.sh@124 -- # return 0 00:22:36.814 21:12:32 -- nvmf/common.sh@477 -- # '[' -n 4048250 ']' 00:22:36.814 21:12:32 -- nvmf/common.sh@478 -- # killprocess 4048250 00:22:36.814 21:12:32 -- common/autotest_common.sh@936 -- # '[' -z 4048250 ']' 00:22:36.814 21:12:32 -- common/autotest_common.sh@940 -- # kill -0 4048250 00:22:36.814 21:12:32 -- common/autotest_common.sh@941 -- # uname 00:22:36.814 21:12:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:36.814 21:12:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4048250 00:22:36.814 21:12:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:36.814 21:12:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:36.814 21:12:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4048250' 00:22:36.814 killing process with pid 4048250 00:22:36.814 21:12:32 -- common/autotest_common.sh@955 -- # kill 4048250 00:22:36.814 21:12:32 -- common/autotest_common.sh@960 -- # wait 4048250 00:22:37.381 21:12:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:37.381 21:12:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:37.381 21:12:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:37.381 21:12:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:37.381 21:12:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:37.381 21:12:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:37.381 21:12:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:37.381 21:12:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:39.286 21:12:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:39.286 00:22:39.286 real 0m12.174s 00:22:39.286 user 0m36.069s 00:22:39.286 sys 0m3.108s 00:22:39.286 21:12:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:39.286 21:12:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.286 ************************************ 00:22:39.286 END TEST nvmf_shutdown_tc1 00:22:39.286 ************************************ 00:22:39.286 21:12:35 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:39.286 21:12:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:39.286 21:12:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:39.286 21:12:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.286 ************************************ 00:22:39.286 START TEST nvmf_shutdown_tc2 00:22:39.286 ************************************ 00:22:39.286 21:12:35 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:39.286 21:12:35 -- target/shutdown.sh@98 -- # starttarget 00:22:39.286 21:12:35 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:39.286 21:12:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:39.286 21:12:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:39.286 21:12:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:39.286 21:12:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:39.286 21:12:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:39.286 21:12:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:39.286 21:12:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:39.286 21:12:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:39.286 21:12:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:39.286 21:12:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:39.286 21:12:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:39.286 21:12:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.286 21:12:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:39.286 21:12:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:39.286 21:12:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:39.286 21:12:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:39.286 21:12:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:39.286 21:12:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:39.286 21:12:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:39.286 21:12:35 -- nvmf/common.sh@294 -- # net_devs=() 00:22:39.286 21:12:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:39.286 21:12:35 -- nvmf/common.sh@295 -- # e810=() 00:22:39.286 21:12:35 -- nvmf/common.sh@295 -- # local -ga e810 00:22:39.286 21:12:35 -- nvmf/common.sh@296 -- # x722=() 00:22:39.286 21:12:35 -- nvmf/common.sh@296 -- # local -ga x722 00:22:39.286 21:12:35 -- nvmf/common.sh@297 -- # mlx=() 00:22:39.286 21:12:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:39.286 21:12:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:39.286 21:12:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:39.287 21:12:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:39.287 21:12:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:39.287 21:12:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:39.287 21:12:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:39.287 21:12:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.287 21:12:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:39.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:39.287 21:12:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.287 21:12:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:39.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:39.287 21:12:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.287 21:12:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.287 21:12:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.287 21:12:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:39.287 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:39.287 21:12:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.287 21:12:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.287 21:12:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.287 21:12:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.287 21:12:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:39.287 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:39.287 21:12:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.287 21:12:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:39.287 21:12:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:39.287 21:12:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:39.287 21:12:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:39.287 21:12:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:39.287 21:12:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:39.287 21:12:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:39.287 21:12:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:39.287 21:12:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:39.287 21:12:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:39.287 21:12:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:39.287 21:12:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:39.287 21:12:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:39.287 21:12:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:39.287 21:12:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:39.287 21:12:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:39.287 21:12:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:39.287 21:12:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:39.287 21:12:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:39.287 21:12:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:39.546 21:12:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:39.546 21:12:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:39.546 21:12:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:39.546 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:39.546 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:22:39.546 00:22:39.546 --- 10.0.0.2 ping statistics --- 00:22:39.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.546 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:22:39.546 21:12:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:39.546 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:39.546 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:22:39.546 00:22:39.546 --- 10.0.0.1 ping statistics --- 00:22:39.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.546 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:22:39.546 21:12:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:39.546 21:12:35 -- nvmf/common.sh@410 -- # return 0 00:22:39.546 21:12:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:39.546 21:12:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:39.546 21:12:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:39.546 21:12:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:39.546 21:12:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:39.546 21:12:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:39.546 21:12:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:39.546 21:12:35 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:39.546 21:12:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:39.546 21:12:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:39.546 21:12:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.546 21:12:35 -- nvmf/common.sh@469 -- # nvmfpid=4049703 00:22:39.546 21:12:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:39.546 21:12:35 -- nvmf/common.sh@470 -- # waitforlisten 4049703 00:22:39.546 21:12:35 -- common/autotest_common.sh@829 -- # '[' -z 4049703 ']' 00:22:39.546 21:12:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:39.546 21:12:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:39.546 21:12:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:39.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:39.546 21:12:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:39.546 21:12:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.546 [2024-11-27 21:12:35.631011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:39.546 [2024-11-27 21:12:35.631095] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:39.546 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.546 [2024-11-27 21:12:35.701072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:39.804 [2024-11-27 21:12:35.816847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:39.804 [2024-11-27 21:12:35.817003] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:39.805 [2024-11-27 21:12:35.817023] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:39.805 [2024-11-27 21:12:35.817037] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:39.805 [2024-11-27 21:12:35.817143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:39.805 [2024-11-27 21:12:35.817240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:39.805 [2024-11-27 21:12:35.817288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:39.805 [2024-11-27 21:12:35.817290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:40.371 21:12:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:40.371 21:12:36 -- common/autotest_common.sh@862 -- # return 0 00:22:40.371 21:12:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:40.371 21:12:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:40.371 21:12:36 -- common/autotest_common.sh@10 -- # set +x 00:22:40.371 21:12:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:40.371 21:12:36 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:40.371 21:12:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.371 21:12:36 -- common/autotest_common.sh@10 -- # set +x 00:22:40.629 [2024-11-27 21:12:36.614108] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:40.629 21:12:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.629 21:12:36 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:40.629 21:12:36 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:40.629 21:12:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:40.629 21:12:36 -- common/autotest_common.sh@10 -- # set +x 00:22:40.629 21:12:36 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:40.629 21:12:36 -- target/shutdown.sh@28 -- # cat 00:22:40.629 21:12:36 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:40.629 21:12:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.629 21:12:36 -- common/autotest_common.sh@10 -- # set +x 00:22:40.629 Malloc1 00:22:40.629 [2024-11-27 21:12:36.689938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:40.629 Malloc2 00:22:40.629 Malloc3 00:22:40.629 Malloc4 00:22:40.629 Malloc5 00:22:40.887 Malloc6 00:22:40.887 Malloc7 00:22:40.887 Malloc8 00:22:40.887 Malloc9 00:22:40.887 Malloc10 00:22:41.146 21:12:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.146 21:12:37 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:41.146 21:12:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:41.146 21:12:37 -- common/autotest_common.sh@10 -- # set +x 00:22:41.147 21:12:37 -- target/shutdown.sh@102 -- # perfpid=4049897 00:22:41.147 21:12:37 -- target/shutdown.sh@103 -- # waitforlisten 4049897 /var/tmp/bdevperf.sock 00:22:41.147 21:12:37 -- common/autotest_common.sh@829 -- # '[' -z 4049897 ']' 00:22:41.147 21:12:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:41.147 21:12:37 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:41.147 21:12:37 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:41.147 21:12:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:41.147 21:12:37 -- nvmf/common.sh@520 -- # config=() 00:22:41.147 21:12:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:41.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:41.147 21:12:37 -- nvmf/common.sh@520 -- # local subsystem config 00:22:41.147 21:12:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:41.147 21:12:37 -- common/autotest_common.sh@10 -- # set +x 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.147 { 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme$subsystem", 00:22:41.147 "trtype": "$TEST_TRANSPORT", 00:22:41.147 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "$NVMF_PORT", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.147 "hdgst": ${hdgst:-false}, 00:22:41.147 "ddgst": ${ddgst:-false} 00:22:41.147 }, 00:22:41.147 "method": "bdev_nvme_attach_controller" 00:22:41.147 } 00:22:41.147 EOF 00:22:41.147 )") 00:22:41.147 21:12:37 -- nvmf/common.sh@542 -- # cat 00:22:41.147 21:12:37 -- nvmf/common.sh@544 -- # jq . 00:22:41.147 21:12:37 -- nvmf/common.sh@545 -- # IFS=, 00:22:41.147 21:12:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:41.147 "params": { 00:22:41.147 "name": "Nvme1", 00:22:41.147 "trtype": "tcp", 00:22:41.147 "traddr": "10.0.0.2", 00:22:41.147 "adrfam": "ipv4", 00:22:41.147 "trsvcid": "4420", 00:22:41.147 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:41.147 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:41.147 "hdgst": false, 00:22:41.147 "ddgst": false 00:22:41.147 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme2", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme3", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme4", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme5", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme6", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme7", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme8", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme9", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 },{ 00:22:41.148 "params": { 00:22:41.148 "name": "Nvme10", 00:22:41.148 "trtype": "tcp", 00:22:41.148 "traddr": "10.0.0.2", 00:22:41.148 "adrfam": "ipv4", 00:22:41.148 "trsvcid": "4420", 00:22:41.148 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:41.148 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:41.148 "hdgst": false, 00:22:41.148 "ddgst": false 00:22:41.148 }, 00:22:41.148 "method": "bdev_nvme_attach_controller" 00:22:41.148 }' 00:22:41.148 [2024-11-27 21:12:37.198382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:41.148 [2024-11-27 21:12:37.198458] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4049897 ] 00:22:41.148 EAL: No free 2048 kB hugepages reported on node 1 00:22:41.148 [2024-11-27 21:12:37.261062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:41.148 [2024-11-27 21:12:37.369066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:43.048 Running I/O for 10 seconds... 00:22:43.048 21:12:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:43.048 21:12:38 -- common/autotest_common.sh@862 -- # return 0 00:22:43.048 21:12:38 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:43.048 21:12:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.048 21:12:38 -- common/autotest_common.sh@10 -- # set +x 00:22:43.048 21:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.048 21:12:39 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:43.048 21:12:39 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:43.048 21:12:39 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:43.048 21:12:39 -- target/shutdown.sh@57 -- # local ret=1 00:22:43.048 21:12:39 -- target/shutdown.sh@58 -- # local i 00:22:43.048 21:12:39 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:43.048 21:12:39 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:43.048 21:12:39 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:43.048 21:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.048 21:12:39 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:43.048 21:12:39 -- common/autotest_common.sh@10 -- # set +x 00:22:43.048 21:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.048 21:12:39 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:43.048 21:12:39 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:43.048 21:12:39 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:43.306 21:12:39 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:43.306 21:12:39 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:43.306 21:12:39 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:43.306 21:12:39 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:43.306 21:12:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.306 21:12:39 -- common/autotest_common.sh@10 -- # set +x 00:22:43.306 21:12:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.306 21:12:39 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:43.306 21:12:39 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:43.306 21:12:39 -- target/shutdown.sh@64 -- # ret=0 00:22:43.306 21:12:39 -- target/shutdown.sh@65 -- # break 00:22:43.306 21:12:39 -- target/shutdown.sh@69 -- # return 0 00:22:43.306 21:12:39 -- target/shutdown.sh@109 -- # killprocess 4049897 00:22:43.306 21:12:39 -- common/autotest_common.sh@936 -- # '[' -z 4049897 ']' 00:22:43.306 21:12:39 -- common/autotest_common.sh@940 -- # kill -0 4049897 00:22:43.306 21:12:39 -- common/autotest_common.sh@941 -- # uname 00:22:43.306 21:12:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:43.306 21:12:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4049897 00:22:43.306 21:12:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:43.306 21:12:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:43.306 21:12:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4049897' 00:22:43.306 killing process with pid 4049897 00:22:43.306 21:12:39 -- common/autotest_common.sh@955 -- # kill 4049897 00:22:43.306 21:12:39 -- common/autotest_common.sh@960 -- # wait 4049897 00:22:43.564 Received shutdown signal, test time was about 0.659347 seconds 00:22:43.564 00:22:43.564 Latency(us) 00:22:43.564 [2024-11-27T20:12:39.805Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme1n1 : 0.60 381.67 23.85 0.00 0.00 161036.30 27379.48 125052.40 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme2n1 : 0.60 380.82 23.80 0.00 0.00 159324.45 27379.48 124275.67 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme3n1 : 0.61 374.93 23.43 0.00 0.00 159483.71 28544.57 158451.48 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme4n1 : 0.60 379.97 23.75 0.00 0.00 155260.06 21456.97 122722.23 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme5n1 : 0.60 377.07 23.57 0.00 0.00 153820.96 30292.20 120392.06 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme6n1 : 0.61 376.24 23.52 0.00 0.00 152113.36 30098.01 119615.34 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme7n1 : 0.60 379.08 23.69 0.00 0.00 149936.91 23690.05 118061.89 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme8n1 : 0.61 372.65 23.29 0.00 0.00 149708.24 29903.83 129712.73 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme9n1 : 0.61 371.32 23.21 0.00 0.00 148498.02 28544.57 129712.73 00:22:43.564 [2024-11-27T20:12:39.805Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.564 Verification LBA range: start 0x0 length 0x400 00:22:43.564 Nvme10n1 : 0.66 346.23 21.64 0.00 0.00 150688.30 13689.74 133596.35 00:22:43.564 [2024-11-27T20:12:39.805Z] =================================================================================================================== 00:22:43.564 [2024-11-27T20:12:39.805Z] Total : 3739.98 233.75 0.00 0.00 153987.03 13689.74 158451.48 00:22:43.823 21:12:39 -- target/shutdown.sh@112 -- # sleep 1 00:22:44.753 21:12:40 -- target/shutdown.sh@113 -- # kill -0 4049703 00:22:44.753 21:12:40 -- target/shutdown.sh@115 -- # stoptarget 00:22:44.753 21:12:40 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:44.753 21:12:40 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:44.753 21:12:40 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.753 21:12:40 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:44.753 21:12:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:44.753 21:12:40 -- nvmf/common.sh@116 -- # sync 00:22:44.754 21:12:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:44.754 21:12:40 -- nvmf/common.sh@119 -- # set +e 00:22:44.754 21:12:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:44.754 21:12:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:44.754 rmmod nvme_tcp 00:22:44.754 rmmod nvme_fabrics 00:22:44.754 rmmod nvme_keyring 00:22:44.754 21:12:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:44.754 21:12:40 -- nvmf/common.sh@123 -- # set -e 00:22:44.754 21:12:40 -- nvmf/common.sh@124 -- # return 0 00:22:44.754 21:12:40 -- nvmf/common.sh@477 -- # '[' -n 4049703 ']' 00:22:44.754 21:12:40 -- nvmf/common.sh@478 -- # killprocess 4049703 00:22:44.754 21:12:40 -- common/autotest_common.sh@936 -- # '[' -z 4049703 ']' 00:22:44.754 21:12:40 -- common/autotest_common.sh@940 -- # kill -0 4049703 00:22:44.754 21:12:40 -- common/autotest_common.sh@941 -- # uname 00:22:44.754 21:12:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:44.754 21:12:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4049703 00:22:44.754 21:12:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:44.754 21:12:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:44.754 21:12:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4049703' 00:22:44.754 killing process with pid 4049703 00:22:44.754 21:12:40 -- common/autotest_common.sh@955 -- # kill 4049703 00:22:44.754 21:12:40 -- common/autotest_common.sh@960 -- # wait 4049703 00:22:45.320 21:12:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:45.320 21:12:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:45.320 21:12:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:45.320 21:12:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:45.320 21:12:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:45.320 21:12:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.320 21:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.320 21:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.851 21:12:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:47.851 00:22:47.851 real 0m8.076s 00:22:47.851 user 0m24.978s 00:22:47.851 sys 0m1.423s 00:22:47.851 21:12:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:47.851 21:12:43 -- common/autotest_common.sh@10 -- # set +x 00:22:47.851 ************************************ 00:22:47.851 END TEST nvmf_shutdown_tc2 00:22:47.851 ************************************ 00:22:47.851 21:12:43 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:47.851 21:12:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:47.851 21:12:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:47.851 21:12:43 -- common/autotest_common.sh@10 -- # set +x 00:22:47.851 ************************************ 00:22:47.851 START TEST nvmf_shutdown_tc3 00:22:47.851 ************************************ 00:22:47.851 21:12:43 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:47.851 21:12:43 -- target/shutdown.sh@120 -- # starttarget 00:22:47.851 21:12:43 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:47.851 21:12:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:47.852 21:12:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:47.852 21:12:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:47.852 21:12:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:47.852 21:12:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:47.852 21:12:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:47.852 21:12:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:47.852 21:12:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.852 21:12:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:47.852 21:12:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:47.852 21:12:43 -- common/autotest_common.sh@10 -- # set +x 00:22:47.852 21:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:47.852 21:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:47.852 21:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:47.852 21:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:47.852 21:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:47.852 21:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:47.852 21:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:47.852 21:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:22:47.852 21:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:47.852 21:12:43 -- nvmf/common.sh@295 -- # e810=() 00:22:47.852 21:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:22:47.852 21:12:43 -- nvmf/common.sh@296 -- # x722=() 00:22:47.852 21:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:22:47.852 21:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:22:47.852 21:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:47.852 21:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:47.852 21:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.852 21:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:47.852 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:47.852 21:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.852 21:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:47.852 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:47.852 21:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.852 21:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.852 21:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.852 21:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:47.852 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:47.852 21:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.852 21:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.852 21:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.852 21:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:47.852 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:47.852 21:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:47.852 21:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:47.852 21:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:47.852 21:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:47.852 21:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:47.852 21:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:47.852 21:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:47.852 21:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:47.852 21:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:47.852 21:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:47.852 21:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:47.852 21:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:47.852 21:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:47.852 21:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:47.852 21:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:47.852 21:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:47.852 21:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:47.852 21:12:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:47.852 21:12:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:47.852 21:12:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:47.852 21:12:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:47.852 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:47.852 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:22:47.852 00:22:47.852 --- 10.0.0.2 ping statistics --- 00:22:47.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.852 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:22:47.852 21:12:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:47.852 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:47.852 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:22:47.852 00:22:47.852 --- 10.0.0.1 ping statistics --- 00:22:47.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.852 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:22:47.852 21:12:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:47.852 21:12:43 -- nvmf/common.sh@410 -- # return 0 00:22:47.852 21:12:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:47.852 21:12:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:47.852 21:12:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:47.852 21:12:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:47.852 21:12:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:47.852 21:12:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:47.852 21:12:43 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:47.852 21:12:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:47.852 21:12:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:47.852 21:12:43 -- common/autotest_common.sh@10 -- # set +x 00:22:47.852 21:12:43 -- nvmf/common.sh@469 -- # nvmfpid=4050826 00:22:47.852 21:12:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:47.852 21:12:43 -- nvmf/common.sh@470 -- # waitforlisten 4050826 00:22:47.852 21:12:43 -- common/autotest_common.sh@829 -- # '[' -z 4050826 ']' 00:22:47.852 21:12:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:47.852 21:12:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.852 21:12:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:47.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:47.852 21:12:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.852 21:12:43 -- common/autotest_common.sh@10 -- # set +x 00:22:47.852 [2024-11-27 21:12:43.722626] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.852 [2024-11-27 21:12:43.722700] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:47.852 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.852 [2024-11-27 21:12:43.791587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:47.852 [2024-11-27 21:12:43.907279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:47.852 [2024-11-27 21:12:43.907440] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:47.852 [2024-11-27 21:12:43.907459] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:47.852 [2024-11-27 21:12:43.907473] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:47.852 [2024-11-27 21:12:43.907557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:47.852 [2024-11-27 21:12:43.907626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:47.853 [2024-11-27 21:12:43.907693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:47.853 [2024-11-27 21:12:43.907696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.786 21:12:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.786 21:12:44 -- common/autotest_common.sh@862 -- # return 0 00:22:48.786 21:12:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:48.786 21:12:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:48.786 21:12:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.786 21:12:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:48.786 21:12:44 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.786 21:12:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.786 21:12:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.786 [2024-11-27 21:12:44.719268] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:48.786 21:12:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.786 21:12:44 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:48.786 21:12:44 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:48.786 21:12:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:48.786 21:12:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.786 21:12:44 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:48.786 21:12:44 -- target/shutdown.sh@28 -- # cat 00:22:48.786 21:12:44 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:48.786 21:12:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.786 21:12:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.786 Malloc1 00:22:48.786 [2024-11-27 21:12:44.807153] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:48.786 Malloc2 00:22:48.786 Malloc3 00:22:48.786 Malloc4 00:22:48.786 Malloc5 00:22:48.786 Malloc6 00:22:49.045 Malloc7 00:22:49.045 Malloc8 00:22:49.045 Malloc9 00:22:49.045 Malloc10 00:22:49.045 21:12:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.045 21:12:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:49.045 21:12:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:49.045 21:12:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.045 21:12:45 -- target/shutdown.sh@124 -- # perfpid=4051019 00:22:49.045 21:12:45 -- target/shutdown.sh@125 -- # waitforlisten 4051019 /var/tmp/bdevperf.sock 00:22:49.045 21:12:45 -- common/autotest_common.sh@829 -- # '[' -z 4051019 ']' 00:22:49.045 21:12:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:49.045 21:12:45 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:49.045 21:12:45 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:49.045 21:12:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:49.045 21:12:45 -- nvmf/common.sh@520 -- # config=() 00:22:49.045 21:12:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:49.045 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:49.045 21:12:45 -- nvmf/common.sh@520 -- # local subsystem config 00:22:49.045 21:12:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.045 "hdgst": ${hdgst:-false}, 00:22:49.045 "ddgst": ${ddgst:-false} 00:22:49.045 }, 00:22:49.045 "method": "bdev_nvme_attach_controller" 00:22:49.045 } 00:22:49.045 EOF 00:22:49.045 )") 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.045 "hdgst": ${hdgst:-false}, 00:22:49.045 "ddgst": ${ddgst:-false} 00:22:49.045 }, 00:22:49.045 "method": "bdev_nvme_attach_controller" 00:22:49.045 } 00:22:49.045 EOF 00:22:49.045 )") 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.045 "hdgst": ${hdgst:-false}, 00:22:49.045 "ddgst": ${ddgst:-false} 00:22:49.045 }, 00:22:49.045 "method": "bdev_nvme_attach_controller" 00:22:49.045 } 00:22:49.045 EOF 00:22:49.045 )") 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.045 "hdgst": ${hdgst:-false}, 00:22:49.045 "ddgst": ${ddgst:-false} 00:22:49.045 }, 00:22:49.045 "method": "bdev_nvme_attach_controller" 00:22:49.045 } 00:22:49.045 EOF 00:22:49.045 )") 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.045 "hdgst": ${hdgst:-false}, 00:22:49.045 "ddgst": ${ddgst:-false} 00:22:49.045 }, 00:22:49.045 "method": "bdev_nvme_attach_controller" 00:22:49.045 } 00:22:49.045 EOF 00:22:49.045 )") 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.045 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.045 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.045 { 00:22:49.045 "params": { 00:22:49.045 "name": "Nvme$subsystem", 00:22:49.045 "trtype": "$TEST_TRANSPORT", 00:22:49.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.045 "adrfam": "ipv4", 00:22:49.045 "trsvcid": "$NVMF_PORT", 00:22:49.046 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.046 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.046 "hdgst": ${hdgst:-false}, 00:22:49.046 "ddgst": ${ddgst:-false} 00:22:49.046 }, 00:22:49.046 "method": "bdev_nvme_attach_controller" 00:22:49.046 } 00:22:49.046 EOF 00:22:49.046 )") 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.046 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.046 { 00:22:49.046 "params": { 00:22:49.046 "name": "Nvme$subsystem", 00:22:49.046 "trtype": "$TEST_TRANSPORT", 00:22:49.046 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.046 "adrfam": "ipv4", 00:22:49.046 "trsvcid": "$NVMF_PORT", 00:22:49.046 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.046 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.046 "hdgst": ${hdgst:-false}, 00:22:49.046 "ddgst": ${ddgst:-false} 00:22:49.046 }, 00:22:49.046 "method": "bdev_nvme_attach_controller" 00:22:49.046 } 00:22:49.046 EOF 00:22:49.046 )") 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.046 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.046 { 00:22:49.046 "params": { 00:22:49.046 "name": "Nvme$subsystem", 00:22:49.046 "trtype": "$TEST_TRANSPORT", 00:22:49.046 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.046 "adrfam": "ipv4", 00:22:49.046 "trsvcid": "$NVMF_PORT", 00:22:49.046 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.046 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.046 "hdgst": ${hdgst:-false}, 00:22:49.046 "ddgst": ${ddgst:-false} 00:22:49.046 }, 00:22:49.046 "method": "bdev_nvme_attach_controller" 00:22:49.046 } 00:22:49.046 EOF 00:22:49.046 )") 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.046 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.046 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.046 { 00:22:49.046 "params": { 00:22:49.046 "name": "Nvme$subsystem", 00:22:49.046 "trtype": "$TEST_TRANSPORT", 00:22:49.046 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.046 "adrfam": "ipv4", 00:22:49.046 "trsvcid": "$NVMF_PORT", 00:22:49.046 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.046 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.046 "hdgst": ${hdgst:-false}, 00:22:49.046 "ddgst": ${ddgst:-false} 00:22:49.046 }, 00:22:49.046 "method": "bdev_nvme_attach_controller" 00:22:49.046 } 00:22:49.046 EOF 00:22:49.046 )") 00:22:49.304 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.304 21:12:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.304 21:12:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.304 { 00:22:49.304 "params": { 00:22:49.304 "name": "Nvme$subsystem", 00:22:49.304 "trtype": "$TEST_TRANSPORT", 00:22:49.304 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.304 "adrfam": "ipv4", 00:22:49.304 "trsvcid": "$NVMF_PORT", 00:22:49.304 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.304 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.304 "hdgst": ${hdgst:-false}, 00:22:49.304 "ddgst": ${ddgst:-false} 00:22:49.304 }, 00:22:49.304 "method": "bdev_nvme_attach_controller" 00:22:49.304 } 00:22:49.304 EOF 00:22:49.304 )") 00:22:49.304 21:12:45 -- nvmf/common.sh@542 -- # cat 00:22:49.304 21:12:45 -- nvmf/common.sh@544 -- # jq . 00:22:49.304 21:12:45 -- nvmf/common.sh@545 -- # IFS=, 00:22:49.304 21:12:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:49.304 "params": { 00:22:49.304 "name": "Nvme1", 00:22:49.304 "trtype": "tcp", 00:22:49.304 "traddr": "10.0.0.2", 00:22:49.304 "adrfam": "ipv4", 00:22:49.304 "trsvcid": "4420", 00:22:49.304 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme2", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme3", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme4", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme5", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme6", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme7", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme8", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme9", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 },{ 00:22:49.305 "params": { 00:22:49.305 "name": "Nvme10", 00:22:49.305 "trtype": "tcp", 00:22:49.305 "traddr": "10.0.0.2", 00:22:49.305 "adrfam": "ipv4", 00:22:49.305 "trsvcid": "4420", 00:22:49.305 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:49.305 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:49.305 "hdgst": false, 00:22:49.305 "ddgst": false 00:22:49.305 }, 00:22:49.305 "method": "bdev_nvme_attach_controller" 00:22:49.305 }' 00:22:49.305 [2024-11-27 21:12:45.295658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:49.305 [2024-11-27 21:12:45.295736] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4051019 ] 00:22:49.305 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.305 [2024-11-27 21:12:45.358750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:49.305 [2024-11-27 21:12:45.466766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:51.847 Running I/O for 10 seconds... 00:22:51.847 21:12:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:51.847 21:12:47 -- common/autotest_common.sh@862 -- # return 0 00:22:51.847 21:12:47 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:51.847 21:12:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.847 21:12:47 -- common/autotest_common.sh@10 -- # set +x 00:22:51.847 21:12:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.847 21:12:47 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:51.847 21:12:47 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:51.847 21:12:47 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:51.847 21:12:47 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:51.847 21:12:47 -- target/shutdown.sh@57 -- # local ret=1 00:22:51.847 21:12:47 -- target/shutdown.sh@58 -- # local i 00:22:51.847 21:12:47 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:51.847 21:12:47 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:51.847 21:12:47 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:51.847 21:12:47 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:51.847 21:12:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.847 21:12:47 -- common/autotest_common.sh@10 -- # set +x 00:22:51.847 21:12:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.847 21:12:47 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:51.847 21:12:47 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:51.847 21:12:47 -- target/shutdown.sh@64 -- # ret=0 00:22:51.847 21:12:47 -- target/shutdown.sh@65 -- # break 00:22:51.847 21:12:47 -- target/shutdown.sh@69 -- # return 0 00:22:51.847 21:12:47 -- target/shutdown.sh@134 -- # killprocess 4050826 00:22:51.847 21:12:47 -- common/autotest_common.sh@936 -- # '[' -z 4050826 ']' 00:22:51.847 21:12:47 -- common/autotest_common.sh@940 -- # kill -0 4050826 00:22:51.847 21:12:47 -- common/autotest_common.sh@941 -- # uname 00:22:51.847 21:12:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.847 21:12:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4050826 00:22:51.847 21:12:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:51.847 21:12:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:51.847 21:12:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4050826' 00:22:51.847 killing process with pid 4050826 00:22:51.847 21:12:47 -- common/autotest_common.sh@955 -- # kill 4050826 00:22:51.847 21:12:47 -- common/autotest_common.sh@960 -- # wait 4050826 00:22:51.847 [2024-11-27 21:12:47.985772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.985995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.847 [2024-11-27 21:12:47.986597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.986697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d2e0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.987987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.988823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196fcb0 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.990984] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.848 [2024-11-27 21:12:47.991027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.848 [2024-11-27 21:12:47.991045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.848 [2024-11-27 21:12:47.991059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.848 [2024-11-27 21:12:47.991074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.848 [2024-11-27 21:12:47.991087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.848 [2024-11-27 21:12:47.991101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.848 [2024-11-27 21:12:47.991113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.848 [2024-11-27 21:12:47.991126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x588f70 is same with the state(5) to be set 00:22:51.848 [2024-11-27 21:12:47.991215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.848 [2024-11-27 21:12:47.991236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.848 [2024-11-27 21:12:47.991251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.849 [2024-11-27 21:12:47.991264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.849 [2024-11-27 21:12:47.991289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.849 [2024-11-27 21:12:47.991303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.849 [2024-11-27 21:12:47.991317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.849 [2024-11-27 21:12:47.991329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.849 [2024-11-27 21:12:47.991341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e1590 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993557] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.849 [2024-11-27 21:12:47.993636] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.849 [2024-11-27 21:12:47.993649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.993990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.994906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196d790 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.997920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.997978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.997996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.849 [2024-11-27 21:12:47.998126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998412] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.850 [2024-11-27 21:12:47.998416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.998944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:47.999103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196dc40 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.000982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x588f70 (9): Bad file descriptor 00:22:51.850 [2024-11-27 21:12:48.001327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.850 [2024-11-27 21:12:48.001352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 ns[2024-11-27 21:12:48.001461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:51.851 the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-27 21:12:48.001476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with [2024-11-27 21:12:48.001491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:22:51.851 id:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with [2024-11-27 21:12:48.001506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:51.851 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with [2024-11-27 21:12:48.001521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x74f600 is same wthe state(5) to be set 00:22:51.851 ith the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001619] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-27 21:12:48.001620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:51.851 the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with [2024-11-27 21:12:48.001634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:51.851 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001677] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5ab1b0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e1590 (9): B[2024-11-27 21:12:48.001756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with ad file descriptor 00:22:51.851 the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e0d0 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.001805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.851 [2024-11-27 21:12:48.001921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.851 [2024-11-27 21:12:48.001933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5b4690 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.851 [2024-11-27 21:12:48.002820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.002995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003012] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.852 [2024-11-27 21:12:48.003022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.003593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196e580 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004489] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.852 [2024-11-27 21:12:48.004765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.004878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.852 [2024-11-27 21:12:48.005656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with [2024-11-27 21:12:48.005921] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.853 the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.005999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.006752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196ea30 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.008823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.853 [2024-11-27 21:12:48.008853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.853 [2024-11-27 21:12:48.008858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.853 [2024-11-27 21:12:48.008866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21504 len:12[2024-11-27 21:12:48.008878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.008894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.854 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.008909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.008923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.008936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.008948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.008962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.008988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.008993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23424 len:12the state(5) to be set 00:22:51.854 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:12the state(5) to be set 00:22:51.854 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.854 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.009157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23936 len:12[2024-11-27 21:12:48.009233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.009249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24064 len:12the state(5) to be set 00:22:51.854 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.854 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:1the state(5) to be set 00:22:51.854 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 [2024-11-27 21:12:48.009410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:12[2024-11-27 21:12:48.009423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.009437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.854 the state(5) to be set 00:22:51.854 [2024-11-27 21:12:48.009452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25984 len:1the state(5) to be set 00:22:51.854 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.854 [2024-11-27 21:12:48.009469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with [2024-11-27 21:12:48.009470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.855 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.009488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.009517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196eee0 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.009538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.009984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.009999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7d9e00 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010330] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7d9e00 was disconnected and freed. reset controller. 00:22:51.855 [2024-11-27 21:12:48.010380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.010558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.855 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.855 [2024-11-27 21:12:48.010619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.855 [2024-11-27 21:12:48.010622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.855 [2024-11-27 21:12:48.010631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:12the state(5) to be set 00:22:51.856 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.856 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.856 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20992 len:12the state(5) to be set 00:22:51.856 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.010942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.010959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21376 len:12the state(5) to be set 00:22:51.856 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.010973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.010990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.010995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.011004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.011017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.011030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.011042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.011055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:22272 len:12the state(5) to be set 00:22:51.856 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.011069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.011071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.856 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.011083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.011097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.011109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.856 [2024-11-27 21:12:48.011122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.856 [2024-11-27 21:12:48.011135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.856 [2024-11-27 21:12:48.011149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.011150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25088 len:12the state(5) to be set 00:22:51.857 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.011254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23040 len:12the state(5) to be set 00:22:51.857 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with [2024-11-27 21:12:48.011271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.857 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f370 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.011331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.011985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.011998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.012020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.012036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.012052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.012052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.012066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.012080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with [2024-11-27 21:12:48.012082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27648 len:12the state(5) to be set 00:22:51.857 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.012097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with [2024-11-27 21:12:48.012099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.857 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.857 [2024-11-27 21:12:48.012111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.857 [2024-11-27 21:12:48.012116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.857 [2024-11-27 21:12:48.012124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with [2024-11-27 21:12:48.012130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.857 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 21:12:48.012225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28544 len:12[2024-11-27 21:12:48.012306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with [2024-11-27 21:12:48.012321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.858 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with [2024-11-27 21:12:48.012385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28800 len:1the state(5) to be set 00:22:51.858 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.858 [2024-11-27 21:12:48.012454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 [2024-11-27 21:12:48.012468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012583] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7db3e0 was disconnected and freed. reset controller. 00:22:51.858 [2024-11-27 21:12:48.012599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x74f600 (9): Bad file descriptor 00:22:51.858 [2024-11-27 21:12:48.012783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ab1b0 (9): Bad file descriptor 00:22:51.858 [2024-11-27 21:12:48.012824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012867] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.858 [2024-11-27 21:12:48.012883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-27 21:12:48.012896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.858 the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.858 [2024-11-27 21:12:48.012926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.858 [2024-11-27 21:12:48.012929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.012940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.012944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.012952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.012958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.012966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.012973] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.012980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x196f820 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.012988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x72a0a0 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.013042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73ec70 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.013192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5b4690 (9): Bad file descriptor 00:22:51.859 [2024-11-27 21:12:48.013241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013340] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73f150 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.013413] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013448] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.859 [2024-11-27 21:12:48.013534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.013551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x739a60 is same with the state(5) to be set 00:22:51.859 [2024-11-27 21:12:48.016025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:51.859 [2024-11-27 21:12:48.016061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x72a0a0 (9): Bad file descriptor 00:22:51.859 [2024-11-27 21:12:48.016117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.859 [2024-11-27 21:12:48.016706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.859 [2024-11-27 21:12:48.016721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.016977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.016990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.860 [2024-11-27 21:12:48.017523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.860 [2024-11-27 21:12:48.017547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.017947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.017960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7cd260 is same with the state(5) to be set 00:22:51.861 [2024-11-27 21:12:48.019331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.019984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.019999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.861 [2024-11-27 21:12:48.020012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.861 [2024-11-27 21:12:48.020027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.020905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.020919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.028091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.028146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.028163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.028177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.028194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.028208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.028223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.862 [2024-11-27 21:12:48.028237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.862 [2024-11-27 21:12:48.028252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.028413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.028430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7df580 is same with the state(5) to be set 00:22:51.863 [2024-11-27 21:12:48.030152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:51.863 [2024-11-27 21:12:48.030195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:51.863 [2024-11-27 21:12:48.030214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:51.863 [2024-11-27 21:12:48.030284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x739a60 (9): Bad file descriptor 00:22:51.863 [2024-11-27 21:12:48.030404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.863 [2024-11-27 21:12:48.030426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.030442] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.863 [2024-11-27 21:12:48.030455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.030469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.863 [2024-11-27 21:12:48.030482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.030495] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.863 [2024-11-27 21:12:48.030508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.030520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d6490 is same with the state(5) to be set 00:22:51.863 [2024-11-27 21:12:48.030596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73ec70 (9): Bad file descriptor 00:22:51.863 [2024-11-27 21:12:48.030637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73f150 (9): Bad file descriptor 00:22:51.863 [2024-11-27 21:12:48.031632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.031734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.031763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x72a0a0 with addr=10.0.0.2, port=4420 00:22:51.863 [2024-11-27 21:12:48.031780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x72a0a0 is same with the state(5) to be set 00:22:51.863 [2024-11-27 21:12:48.031894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.031992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.032018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x588f70 with addr=10.0.0.2, port=4420 00:22:51.863 [2024-11-27 21:12:48.032034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x588f70 is same with the state(5) to be set 00:22:51.863 [2024-11-27 21:12:48.032128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.032219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.863 [2024-11-27 21:12:48.032244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5e1590 with addr=10.0.0.2, port=4420 00:22:51.863 [2024-11-27 21:12:48.032259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e1590 is same with the state(5) to be set 00:22:51.863 [2024-11-27 21:12:48.032605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.032975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.032989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.863 [2024-11-27 21:12:48.033196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.863 [2024-11-27 21:12:48.033212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.033973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.033988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.864 [2024-11-27 21:12:48.034292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.864 [2024-11-27 21:12:48.034309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.034493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.034508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x579550 is same with the state(5) to be set 00:22:51.865 [2024-11-27 21:12:48.035763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.035976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.035990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.865 [2024-11-27 21:12:48.036439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.865 [2024-11-27 21:12:48.036453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.036971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.036984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.866 [2024-11-27 21:12:48.037626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.866 [2024-11-27 21:12:48.037641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.037654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.037669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.037683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.037702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.037716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.037730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7151a0 is same with the state(5) to be set 00:22:51.867 [2024-11-27 21:12:48.038975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.038999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.867 [2024-11-27 21:12:48.039904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.867 [2024-11-27 21:12:48.039917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.039932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.039945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.039960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.039973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.039988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.868 [2024-11-27 21:12:48.040847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.868 [2024-11-27 21:12:48.040861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7166f0 is same with the state(5) to be set 00:22:51.868 [2024-11-27 21:12:48.042188] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.868 [2024-11-27 21:12:48.042609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:51.868 [2024-11-27 21:12:48.042642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:51.868 [2024-11-27 21:12:48.042659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:51.868 [2024-11-27 21:12:48.042851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.868 [2024-11-27 21:12:48.042965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.868 [2024-11-27 21:12:48.042990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x739a60 with addr=10.0.0.2, port=4420 00:22:51.868 [2024-11-27 21:12:48.043006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x739a60 is same with the state(5) to be set 00:22:51.868 [2024-11-27 21:12:48.043033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x72a0a0 (9): Bad file descriptor 00:22:51.868 [2024-11-27 21:12:48.043052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x588f70 (9): Bad file descriptor 00:22:51.868 [2024-11-27 21:12:48.043069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e1590 (9): Bad file descriptor 00:22:51.868 [2024-11-27 21:12:48.043121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d6490 (9): Bad file descriptor 00:22:51.868 [2024-11-27 21:12:48.043179] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.868 [2024-11-27 21:12:48.043203] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.868 [2024-11-27 21:12:48.043221] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.868 [2024-11-27 21:12:48.043241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x739a60 (9): Bad file descriptor 00:22:51.869 [2024-11-27 21:12:48.043416] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.869 [2024-11-27 21:12:48.043556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.043674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.043700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x74f600 with addr=10.0.0.2, port=4420 00:22:51.869 [2024-11-27 21:12:48.043716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x74f600 is same with the state(5) to be set 00:22:51.869 [2024-11-27 21:12:48.043798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.043909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.043940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5ab1b0 with addr=10.0.0.2, port=4420 00:22:51.869 [2024-11-27 21:12:48.043956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5ab1b0 is same with the state(5) to be set 00:22:51.869 [2024-11-27 21:12:48.044052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.044160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.869 [2024-11-27 21:12:48.044183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5b4690 with addr=10.0.0.2, port=4420 00:22:51.869 [2024-11-27 21:12:48.044199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5b4690 is same with the state(5) to be set 00:22:51.869 [2024-11-27 21:12:48.044217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:51.869 [2024-11-27 21:12:48.044231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:51.869 [2024-11-27 21:12:48.044249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:51.869 [2024-11-27 21:12:48.044269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:51.869 [2024-11-27 21:12:48.044283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:51.869 [2024-11-27 21:12:48.044296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:51.869 [2024-11-27 21:12:48.044315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:51.869 [2024-11-27 21:12:48.044329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:51.869 [2024-11-27 21:12:48.044342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:51.869 [2024-11-27 21:12:48.045204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.045974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.045989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.046002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.046017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.046030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.046047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.046060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.869 [2024-11-27 21:12:48.046076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.869 [2024-11-27 21:12:48.046089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.046972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.046987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.047000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.047015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.047028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.047043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.047056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.047071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.870 [2024-11-27 21:12:48.047084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.870 [2024-11-27 21:12:48.047098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7d8950 is same with the state(5) to be set 00:22:51.871 [2024-11-27 21:12:48.048342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.048978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.048994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.871 [2024-11-27 21:12:48.049532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.871 [2024-11-27 21:12:48.049549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.049980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.049995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.872 [2024-11-27 21:12:48.050271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.872 [2024-11-27 21:12:48.050285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7dc9c0 is same with the state(5) to be set 00:22:51.872 [2024-11-27 21:12:48.051565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.051596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.051608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.051624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:51.872 [2024-11-27 21:12:48.051643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:51.872 [2024-11-27 21:12:48.051700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x74f600 (9): Bad file descriptor 00:22:51.872 [2024-11-27 21:12:48.051729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ab1b0 (9): Bad file descriptor 00:22:51.872 [2024-11-27 21:12:48.051748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5b4690 (9): Bad file descriptor 00:22:51.872 [2024-11-27 21:12:48.051764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:51.872 [2024-11-27 21:12:48.051778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:51.872 [2024-11-27 21:12:48.051793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:51.872 [2024-11-27 21:12:48.051929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.052086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.872 [2024-11-27 21:12:48.052183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.872 [2024-11-27 21:12:48.052208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73f150 with addr=10.0.0.2, port=4420 00:22:51.872 [2024-11-27 21:12:48.052223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73f150 is same with the state(5) to be set 00:22:51.872 [2024-11-27 21:12:48.052310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.872 [2024-11-27 21:12:48.052397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.872 [2024-11-27 21:12:48.052422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73ec70 with addr=10.0.0.2, port=4420 00:22:51.872 [2024-11-27 21:12:48.052437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73ec70 is same with the state(5) to be set 00:22:51.872 [2024-11-27 21:12:48.052451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:51.872 [2024-11-27 21:12:48.052464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:51.872 [2024-11-27 21:12:48.052477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:51.872 [2024-11-27 21:12:48.052496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:51.872 [2024-11-27 21:12:48.052509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:51.872 [2024-11-27 21:12:48.052521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:51.872 [2024-11-27 21:12:48.052547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:51.872 [2024-11-27 21:12:48.052562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:51.872 [2024-11-27 21:12:48.052575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:51.872 [2024-11-27 21:12:48.053171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.053192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.053204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.872 [2024-11-27 21:12:48.053220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73f150 (9): Bad file descriptor 00:22:51.872 [2024-11-27 21:12:48.053238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73ec70 (9): Bad file descriptor 00:22:51.873 [2024-11-27 21:12:48.053363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:51.873 [2024-11-27 21:12:48.053384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:51.873 [2024-11-27 21:12:48.053397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:51.873 [2024-11-27 21:12:48.053423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:51.873 [2024-11-27 21:12:48.053438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:51.873 [2024-11-27 21:12:48.053450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:51.873 [2024-11-27 21:12:48.053531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.053979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.053995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.873 [2024-11-27 21:12:48.054609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.873 [2024-11-27 21:12:48.054626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.054982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.054996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.874 [2024-11-27 21:12:48.055393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.874 [2024-11-27 21:12:48.055407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ddfa0 is same with the state(5) to be set 00:22:51.874 [2024-11-27 21:12:48.057240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:51.874 [2024-11-27 21:12:48.057362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.874 [2024-11-27 21:12:48.057470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.134 task offset: 24320 on job bdev=Nvme6n1 fails 00:22:52.134 00:22:52.134 Latency(us) 00:22:52.134 [2024-11-27T20:12:48.375Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme1n1 ended in about 0.56 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme1n1 : 0.56 291.15 18.20 113.62 0.00 156777.10 96702.01 128159.29 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme2n1 ended in about 0.58 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme2n1 : 0.58 282.84 17.68 110.38 0.00 159279.31 104080.88 127382.57 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme3n1 ended in about 0.58 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme3n1 : 0.58 281.29 17.58 109.77 0.00 158078.45 78060.66 146800.64 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme4n1 ended in about 0.59 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme4n1 : 0.59 279.79 17.49 109.19 0.00 156850.35 97478.73 125829.12 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme5n1 ended in about 0.59 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme5n1 : 0.59 276.85 17.30 108.04 0.00 156461.98 96313.65 122722.23 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme6n1 ended in about 0.56 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme6n1 : 0.56 293.39 18.34 114.49 0.00 144950.81 55535.69 123498.95 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme7n1 ended in about 0.56 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme7n1 : 0.56 292.80 18.30 114.26 0.00 143148.68 47768.46 123498.95 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme8n1 ended in about 0.60 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme8n1 : 0.60 275.37 17.21 107.46 0.00 151026.63 72235.24 132042.90 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme9n1 ended in about 0.60 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme9n1 : 0.60 273.03 17.06 106.55 0.00 150331.66 65633.09 133596.35 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:52.134 [2024-11-27T20:12:48.375Z] Job: Nvme10n1 ended in about 0.57 seconds with error 00:22:52.134 Verification LBA range: start 0x0 length 0x400 00:22:52.134 Nvme10n1 : 0.57 223.07 13.94 111.54 0.00 167109.72 44079.03 141363.58 00:22:52.134 [2024-11-27T20:12:48.375Z] =================================================================================================================== 00:22:52.134 [2024-11-27T20:12:48.375Z] Total : 2769.58 173.10 1105.30 0.00 154197.59 44079.03 146800.64 00:22:52.134 [2024-11-27 21:12:48.084079] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:52.134 [2024-11-27 21:12:48.084173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:52.134 [2024-11-27 21:12:48.084454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.084579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.084607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5e1590 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.084628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e1590 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.084735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.084840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.084865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x588f70 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.084881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x588f70 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.084973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x72a0a0 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.085124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x72a0a0 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.085218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x739a60 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.085348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x739a60 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.085433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5b4690 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.085584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5b4690 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.085683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.085804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5ab1b0 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.085819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5ab1b0 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.085909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.086003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.086028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x74f600 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.086043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x74f600 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.086539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.086633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.134 [2024-11-27 21:12:48.086659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5d6490 with addr=10.0.0.2, port=4420 00:22:52.134 [2024-11-27 21:12:48.086675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5d6490 is same with the state(5) to be set 00:22:52.134 [2024-11-27 21:12:48.086702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e1590 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x588f70 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x72a0a0 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x739a60 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5b4690 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5ab1b0 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x74f600 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.086880] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086905] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086924] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086942] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086959] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086976] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.086994] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:52.134 [2024-11-27 21:12:48.087076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5d6490 (9): Bad file descriptor 00:22:52.134 [2024-11-27 21:12:48.087101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:52.134 [2024-11-27 21:12:48.087115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:52.134 [2024-11-27 21:12:48.087138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:52.134 [2024-11-27 21:12:48.087156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:52.134 [2024-11-27 21:12:48.087169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:52.134 [2024-11-27 21:12:48.087181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:52.135 [2024-11-27 21:12:48.087470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:52.135 [2024-11-27 21:12:48.087487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.087586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.087599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:52.135 [2024-11-27 21:12:48.087627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.087772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.135 [2024-11-27 21:12:48.087869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.135 [2024-11-27 21:12:48.087894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73ec70 with addr=10.0.0.2, port=4420 00:22:52.135 [2024-11-27 21:12:48.087910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73ec70 is same with the state(5) to be set 00:22:52.135 [2024-11-27 21:12:48.087993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.135 [2024-11-27 21:12:48.088082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:52.135 [2024-11-27 21:12:48.088106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x73f150 with addr=10.0.0.2, port=4420 00:22:52.135 [2024-11-27 21:12:48.088120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x73f150 is same with the state(5) to be set 00:22:52.135 [2024-11-27 21:12:48.088163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73ec70 (9): Bad file descriptor 00:22:52.135 [2024-11-27 21:12:48.088187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x73f150 (9): Bad file descriptor 00:22:52.135 [2024-11-27 21:12:48.088225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.088243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.088257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:52.135 [2024-11-27 21:12:48.088273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:52.135 [2024-11-27 21:12:48.088286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:52.135 [2024-11-27 21:12:48.088298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:52.135 [2024-11-27 21:12:48.088334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.135 [2024-11-27 21:12:48.088350] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.395 21:12:48 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:52.395 21:12:48 -- target/shutdown.sh@138 -- # sleep 1 00:22:53.334 21:12:49 -- target/shutdown.sh@141 -- # kill -9 4051019 00:22:53.334 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (4051019) - No such process 00:22:53.334 21:12:49 -- target/shutdown.sh@141 -- # true 00:22:53.334 21:12:49 -- target/shutdown.sh@143 -- # stoptarget 00:22:53.334 21:12:49 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:53.334 21:12:49 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:53.334 21:12:49 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:53.593 21:12:49 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:53.593 21:12:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:53.593 21:12:49 -- nvmf/common.sh@116 -- # sync 00:22:53.593 21:12:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:53.593 21:12:49 -- nvmf/common.sh@119 -- # set +e 00:22:53.593 21:12:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:53.593 21:12:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:53.593 rmmod nvme_tcp 00:22:53.593 rmmod nvme_fabrics 00:22:53.593 rmmod nvme_keyring 00:22:53.593 21:12:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:53.593 21:12:49 -- nvmf/common.sh@123 -- # set -e 00:22:53.593 21:12:49 -- nvmf/common.sh@124 -- # return 0 00:22:53.593 21:12:49 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:53.593 21:12:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:53.593 21:12:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:53.593 21:12:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:53.593 21:12:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:53.593 21:12:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:53.593 21:12:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.593 21:12:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.593 21:12:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.495 21:12:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.495 00:22:55.495 real 0m8.141s 00:22:55.495 user 0m21.593s 00:22:55.495 sys 0m1.514s 00:22:55.495 21:12:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:55.495 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.495 ************************************ 00:22:55.495 END TEST nvmf_shutdown_tc3 00:22:55.495 ************************************ 00:22:55.495 21:12:51 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:55.495 00:22:55.495 real 0m28.619s 00:22:55.495 user 1m22.769s 00:22:55.495 sys 0m6.166s 00:22:55.495 21:12:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:55.495 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.495 ************************************ 00:22:55.495 END TEST nvmf_shutdown 00:22:55.495 ************************************ 00:22:55.495 21:12:51 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:55.495 21:12:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:55.495 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.495 21:12:51 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:55.495 21:12:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:55.495 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.754 21:12:51 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:55.754 21:12:51 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:55.754 21:12:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:55.754 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.754 ************************************ 00:22:55.754 START TEST nvmf_multicontroller 00:22:55.754 ************************************ 00:22:55.754 21:12:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:55.754 * Looking for test storage... 00:22:55.754 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:55.754 21:12:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:55.754 21:12:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:55.754 21:12:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:55.754 21:12:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:55.754 21:12:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:55.754 21:12:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:55.754 21:12:51 -- scripts/common.sh@335 -- # IFS=.-: 00:22:55.754 21:12:51 -- scripts/common.sh@335 -- # read -ra ver1 00:22:55.754 21:12:51 -- scripts/common.sh@336 -- # IFS=.-: 00:22:55.754 21:12:51 -- scripts/common.sh@336 -- # read -ra ver2 00:22:55.754 21:12:51 -- scripts/common.sh@337 -- # local 'op=<' 00:22:55.754 21:12:51 -- scripts/common.sh@339 -- # ver1_l=2 00:22:55.754 21:12:51 -- scripts/common.sh@340 -- # ver2_l=1 00:22:55.754 21:12:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:55.754 21:12:51 -- scripts/common.sh@343 -- # case "$op" in 00:22:55.754 21:12:51 -- scripts/common.sh@344 -- # : 1 00:22:55.754 21:12:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:55.754 21:12:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:55.754 21:12:51 -- scripts/common.sh@364 -- # decimal 1 00:22:55.754 21:12:51 -- scripts/common.sh@352 -- # local d=1 00:22:55.754 21:12:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:55.754 21:12:51 -- scripts/common.sh@354 -- # echo 1 00:22:55.754 21:12:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:55.754 21:12:51 -- scripts/common.sh@365 -- # decimal 2 00:22:55.754 21:12:51 -- scripts/common.sh@352 -- # local d=2 00:22:55.754 21:12:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:55.754 21:12:51 -- scripts/common.sh@354 -- # echo 2 00:22:55.754 21:12:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:55.754 21:12:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:55.754 21:12:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:55.754 21:12:51 -- scripts/common.sh@367 -- # return 0 00:22:55.754 21:12:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:55.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.754 --rc genhtml_branch_coverage=1 00:22:55.754 --rc genhtml_function_coverage=1 00:22:55.754 --rc genhtml_legend=1 00:22:55.754 --rc geninfo_all_blocks=1 00:22:55.754 --rc geninfo_unexecuted_blocks=1 00:22:55.754 00:22:55.754 ' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:55.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.754 --rc genhtml_branch_coverage=1 00:22:55.754 --rc genhtml_function_coverage=1 00:22:55.754 --rc genhtml_legend=1 00:22:55.754 --rc geninfo_all_blocks=1 00:22:55.754 --rc geninfo_unexecuted_blocks=1 00:22:55.754 00:22:55.754 ' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:55.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.754 --rc genhtml_branch_coverage=1 00:22:55.754 --rc genhtml_function_coverage=1 00:22:55.754 --rc genhtml_legend=1 00:22:55.754 --rc geninfo_all_blocks=1 00:22:55.754 --rc geninfo_unexecuted_blocks=1 00:22:55.754 00:22:55.754 ' 00:22:55.754 21:12:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:55.754 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.754 --rc genhtml_branch_coverage=1 00:22:55.754 --rc genhtml_function_coverage=1 00:22:55.754 --rc genhtml_legend=1 00:22:55.754 --rc geninfo_all_blocks=1 00:22:55.754 --rc geninfo_unexecuted_blocks=1 00:22:55.754 00:22:55.754 ' 00:22:55.754 21:12:51 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.754 21:12:51 -- nvmf/common.sh@7 -- # uname -s 00:22:55.754 21:12:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.754 21:12:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.754 21:12:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.754 21:12:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.754 21:12:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.754 21:12:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.754 21:12:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.754 21:12:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.754 21:12:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.754 21:12:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.754 21:12:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.754 21:12:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.754 21:12:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.754 21:12:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.754 21:12:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.754 21:12:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.754 21:12:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.754 21:12:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.754 21:12:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.754 21:12:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.754 21:12:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.755 21:12:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.755 21:12:51 -- paths/export.sh@5 -- # export PATH 00:22:55.755 21:12:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.755 21:12:51 -- nvmf/common.sh@46 -- # : 0 00:22:55.755 21:12:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.755 21:12:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.755 21:12:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.755 21:12:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.755 21:12:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.755 21:12:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.755 21:12:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.755 21:12:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.755 21:12:51 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:55.755 21:12:51 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:55.755 21:12:51 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:55.755 21:12:51 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:55.755 21:12:51 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:55.755 21:12:51 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:55.755 21:12:51 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:55.755 21:12:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.755 21:12:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.755 21:12:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.755 21:12:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.755 21:12:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.755 21:12:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.755 21:12:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.755 21:12:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.755 21:12:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.755 21:12:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.755 21:12:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.755 21:12:51 -- common/autotest_common.sh@10 -- # set +x 00:22:57.657 21:12:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.657 21:12:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.657 21:12:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.657 21:12:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.657 21:12:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.657 21:12:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.657 21:12:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.657 21:12:53 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.657 21:12:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.657 21:12:53 -- nvmf/common.sh@295 -- # e810=() 00:22:57.657 21:12:53 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.657 21:12:53 -- nvmf/common.sh@296 -- # x722=() 00:22:57.657 21:12:53 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.657 21:12:53 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.657 21:12:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.657 21:12:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.657 21:12:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.657 21:12:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.657 21:12:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.657 21:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.657 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.657 21:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.657 21:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.657 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.657 21:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.657 21:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.657 21:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.657 21:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.657 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.657 21:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.657 21:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.657 21:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.657 21:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.657 21:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.657 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.657 21:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.657 21:12:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.657 21:12:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.657 21:12:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.657 21:12:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.657 21:12:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.657 21:12:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.657 21:12:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.657 21:12:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.657 21:12:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.657 21:12:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.657 21:12:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.657 21:12:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.657 21:12:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.657 21:12:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.657 21:12:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.657 21:12:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.657 21:12:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.657 21:12:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.657 21:12:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.657 21:12:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.917 21:12:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.917 21:12:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.917 21:12:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.917 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.917 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.170 ms 00:22:57.917 00:22:57.917 --- 10.0.0.2 ping statistics --- 00:22:57.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.917 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:22:57.917 21:12:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.917 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.917 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:57.917 00:22:57.917 --- 10.0.0.1 ping statistics --- 00:22:57.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.917 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:57.917 21:12:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.917 21:12:53 -- nvmf/common.sh@410 -- # return 0 00:22:57.917 21:12:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.917 21:12:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.917 21:12:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.917 21:12:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.917 21:12:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.917 21:12:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.917 21:12:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.917 21:12:53 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:57.917 21:12:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.917 21:12:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:57.917 21:12:53 -- common/autotest_common.sh@10 -- # set +x 00:22:57.917 21:12:53 -- nvmf/common.sh@469 -- # nvmfpid=4053572 00:22:57.917 21:12:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:57.917 21:12:53 -- nvmf/common.sh@470 -- # waitforlisten 4053572 00:22:57.917 21:12:53 -- common/autotest_common.sh@829 -- # '[' -z 4053572 ']' 00:22:57.917 21:12:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.917 21:12:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.917 21:12:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.917 21:12:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.917 21:12:53 -- common/autotest_common.sh@10 -- # set +x 00:22:57.917 [2024-11-27 21:12:54.006987] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.917 [2024-11-27 21:12:54.007055] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.917 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.917 [2024-11-27 21:12:54.069109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:58.176 [2024-11-27 21:12:54.177062] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:58.176 [2024-11-27 21:12:54.177232] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:58.176 [2024-11-27 21:12:54.177250] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:58.176 [2024-11-27 21:12:54.177263] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:58.176 [2024-11-27 21:12:54.179549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:58.176 [2024-11-27 21:12:54.179618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:58.176 [2024-11-27 21:12:54.179622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:59.110 21:12:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:59.110 21:12:54 -- common/autotest_common.sh@862 -- # return 0 00:22:59.110 21:12:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:59.110 21:12:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:59.110 21:12:54 -- common/autotest_common.sh@10 -- # set +x 00:22:59.110 21:12:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:59.110 21:12:55 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:59.110 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.110 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.110 [2024-11-27 21:12:55.027159] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:59.110 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.110 21:12:55 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:59.110 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.110 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.110 Malloc0 00:22:59.110 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 [2024-11-27 21:12:55.093995] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 [2024-11-27 21:12:55.101892] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 Malloc1 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:59.111 21:12:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:22:59.111 21:12:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.111 21:12:55 -- host/multicontroller.sh@44 -- # bdevperf_pid=4053731 00:22:59.111 21:12:55 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:59.111 21:12:55 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:59.111 21:12:55 -- host/multicontroller.sh@47 -- # waitforlisten 4053731 /var/tmp/bdevperf.sock 00:22:59.111 21:12:55 -- common/autotest_common.sh@829 -- # '[' -z 4053731 ']' 00:22:59.111 21:12:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:59.111 21:12:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:59.111 21:12:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:59.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:59.111 21:12:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:59.111 21:12:55 -- common/autotest_common.sh@10 -- # set +x 00:23:00.043 21:12:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:00.044 21:12:56 -- common/autotest_common.sh@862 -- # return 0 00:23:00.044 21:12:56 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:00.044 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.044 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 NVMe0n1 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.302 21:12:56 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:00.302 21:12:56 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:00.302 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.302 1 00:23:00.302 21:12:56 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.302 21:12:56 -- common/autotest_common.sh@650 -- # local es=0 00:23:00.302 21:12:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.302 21:12:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.302 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 request: 00:23:00.302 { 00:23:00.302 "name": "NVMe0", 00:23:00.302 "trtype": "tcp", 00:23:00.302 "traddr": "10.0.0.2", 00:23:00.302 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:00.302 "hostaddr": "10.0.0.2", 00:23:00.302 "hostsvcid": "60000", 00:23:00.302 "adrfam": "ipv4", 00:23:00.302 "trsvcid": "4420", 00:23:00.302 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.302 "method": "bdev_nvme_attach_controller", 00:23:00.302 "req_id": 1 00:23:00.302 } 00:23:00.302 Got JSON-RPC error response 00:23:00.302 response: 00:23:00.302 { 00:23:00.302 "code": -114, 00:23:00.302 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.302 } 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # es=1 00:23:00.302 21:12:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:00.302 21:12:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:00.302 21:12:56 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.302 21:12:56 -- common/autotest_common.sh@650 -- # local es=0 00:23:00.302 21:12:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.302 21:12:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.302 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 request: 00:23:00.302 { 00:23:00.302 "name": "NVMe0", 00:23:00.302 "trtype": "tcp", 00:23:00.302 "traddr": "10.0.0.2", 00:23:00.302 "hostaddr": "10.0.0.2", 00:23:00.302 "hostsvcid": "60000", 00:23:00.302 "adrfam": "ipv4", 00:23:00.302 "trsvcid": "4420", 00:23:00.302 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:00.302 "method": "bdev_nvme_attach_controller", 00:23:00.302 "req_id": 1 00:23:00.302 } 00:23:00.302 Got JSON-RPC error response 00:23:00.302 response: 00:23:00.302 { 00:23:00.302 "code": -114, 00:23:00.302 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.302 } 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # es=1 00:23:00.302 21:12:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:00.302 21:12:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:00.302 21:12:56 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@650 -- # local es=0 00:23:00.302 21:12:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 request: 00:23:00.302 { 00:23:00.302 "name": "NVMe0", 00:23:00.302 "trtype": "tcp", 00:23:00.302 "traddr": "10.0.0.2", 00:23:00.302 "hostaddr": "10.0.0.2", 00:23:00.302 "hostsvcid": "60000", 00:23:00.302 "adrfam": "ipv4", 00:23:00.302 "trsvcid": "4420", 00:23:00.302 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.302 "multipath": "disable", 00:23:00.302 "method": "bdev_nvme_attach_controller", 00:23:00.302 "req_id": 1 00:23:00.302 } 00:23:00.302 Got JSON-RPC error response 00:23:00.302 response: 00:23:00.302 { 00:23:00.302 "code": -114, 00:23:00.302 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:00.302 } 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # es=1 00:23:00.302 21:12:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:00.302 21:12:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:00.302 21:12:56 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.302 21:12:56 -- common/autotest_common.sh@650 -- # local es=0 00:23:00.302 21:12:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.302 21:12:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:00.302 21:12:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.302 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.302 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.302 request: 00:23:00.302 { 00:23:00.302 "name": "NVMe0", 00:23:00.302 "trtype": "tcp", 00:23:00.302 "traddr": "10.0.0.2", 00:23:00.302 "hostaddr": "10.0.0.2", 00:23:00.302 "hostsvcid": "60000", 00:23:00.302 "adrfam": "ipv4", 00:23:00.302 "trsvcid": "4420", 00:23:00.302 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.302 "multipath": "failover", 00:23:00.302 "method": "bdev_nvme_attach_controller", 00:23:00.302 "req_id": 1 00:23:00.302 } 00:23:00.302 Got JSON-RPC error response 00:23:00.302 response: 00:23:00.302 { 00:23:00.302 "code": -114, 00:23:00.302 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.302 } 00:23:00.302 21:12:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:00.302 21:12:56 -- common/autotest_common.sh@653 -- # es=1 00:23:00.302 21:12:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:00.302 21:12:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:00.303 21:12:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:00.303 21:12:56 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:00.303 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.303 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.569 00:23:00.569 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.569 21:12:56 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:00.570 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.570 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.570 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.570 21:12:56 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:00.570 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.570 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.570 00:23:00.570 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.570 21:12:56 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:00.570 21:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.570 21:12:56 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:00.570 21:12:56 -- common/autotest_common.sh@10 -- # set +x 00:23:00.570 21:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.570 21:12:56 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:00.570 21:12:56 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:01.988 0 00:23:01.988 21:12:57 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:01.988 21:12:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.988 21:12:57 -- common/autotest_common.sh@10 -- # set +x 00:23:01.988 21:12:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.988 21:12:57 -- host/multicontroller.sh@100 -- # killprocess 4053731 00:23:01.988 21:12:57 -- common/autotest_common.sh@936 -- # '[' -z 4053731 ']' 00:23:01.988 21:12:57 -- common/autotest_common.sh@940 -- # kill -0 4053731 00:23:01.988 21:12:57 -- common/autotest_common.sh@941 -- # uname 00:23:01.988 21:12:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:01.988 21:12:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4053731 00:23:01.988 21:12:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:01.988 21:12:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:01.988 21:12:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4053731' 00:23:01.988 killing process with pid 4053731 00:23:01.988 21:12:57 -- common/autotest_common.sh@955 -- # kill 4053731 00:23:01.988 21:12:57 -- common/autotest_common.sh@960 -- # wait 4053731 00:23:01.988 21:12:58 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:01.988 21:12:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.988 21:12:58 -- common/autotest_common.sh@10 -- # set +x 00:23:01.988 21:12:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.988 21:12:58 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:01.988 21:12:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:01.988 21:12:58 -- common/autotest_common.sh@10 -- # set +x 00:23:01.988 21:12:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:01.988 21:12:58 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:01.988 21:12:58 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:01.988 21:12:58 -- common/autotest_common.sh@1607 -- # read -r file 00:23:01.988 21:12:58 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:01.988 21:12:58 -- common/autotest_common.sh@1606 -- # sort -u 00:23:01.988 21:12:58 -- common/autotest_common.sh@1608 -- # cat 00:23:01.988 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:01.988 [2024-11-27 21:12:55.200113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:01.988 [2024-11-27 21:12:55.200201] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4053731 ] 00:23:01.988 EAL: No free 2048 kB hugepages reported on node 1 00:23:01.988 [2024-11-27 21:12:55.260099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:01.988 [2024-11-27 21:12:55.368228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:01.988 [2024-11-27 21:12:56.655308] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name c15fe454-81f8-4cc4-8064-f7dac3103cd7 already exists 00:23:01.988 [2024-11-27 21:12:56.655350] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:c15fe454-81f8-4cc4-8064-f7dac3103cd7 alias for bdev NVMe1n1 00:23:01.988 [2024-11-27 21:12:56.655385] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:01.988 Running I/O for 1 seconds... 00:23:01.988 00:23:01.988 Latency(us) 00:23:01.988 [2024-11-27T20:12:58.229Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:01.988 [2024-11-27T20:12:58.229Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:01.989 NVMe0n1 : 1.00 19637.12 76.71 0.00 0.00 6508.38 2936.98 13495.56 00:23:01.989 [2024-11-27T20:12:58.230Z] =================================================================================================================== 00:23:01.989 [2024-11-27T20:12:58.230Z] Total : 19637.12 76.71 0.00 0.00 6508.38 2936.98 13495.56 00:23:01.989 Received shutdown signal, test time was about 1.000000 seconds 00:23:01.989 00:23:01.989 Latency(us) 00:23:01.989 [2024-11-27T20:12:58.230Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:01.989 [2024-11-27T20:12:58.230Z] =================================================================================================================== 00:23:01.989 [2024-11-27T20:12:58.230Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:01.989 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:01.989 21:12:58 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:01.989 21:12:58 -- common/autotest_common.sh@1607 -- # read -r file 00:23:01.989 21:12:58 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:01.989 21:12:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:01.989 21:12:58 -- nvmf/common.sh@116 -- # sync 00:23:01.989 21:12:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:01.989 21:12:58 -- nvmf/common.sh@119 -- # set +e 00:23:01.989 21:12:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:01.989 21:12:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:01.989 rmmod nvme_tcp 00:23:01.989 rmmod nvme_fabrics 00:23:01.989 rmmod nvme_keyring 00:23:01.989 21:12:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:01.989 21:12:58 -- nvmf/common.sh@123 -- # set -e 00:23:01.989 21:12:58 -- nvmf/common.sh@124 -- # return 0 00:23:01.989 21:12:58 -- nvmf/common.sh@477 -- # '[' -n 4053572 ']' 00:23:01.989 21:12:58 -- nvmf/common.sh@478 -- # killprocess 4053572 00:23:01.989 21:12:58 -- common/autotest_common.sh@936 -- # '[' -z 4053572 ']' 00:23:01.989 21:12:58 -- common/autotest_common.sh@940 -- # kill -0 4053572 00:23:01.989 21:12:58 -- common/autotest_common.sh@941 -- # uname 00:23:01.989 21:12:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:01.989 21:12:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4053572 00:23:02.246 21:12:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:02.246 21:12:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:02.246 21:12:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4053572' 00:23:02.246 killing process with pid 4053572 00:23:02.246 21:12:58 -- common/autotest_common.sh@955 -- # kill 4053572 00:23:02.246 21:12:58 -- common/autotest_common.sh@960 -- # wait 4053572 00:23:02.505 21:12:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:02.505 21:12:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:02.505 21:12:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:02.505 21:12:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:02.505 21:12:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:02.505 21:12:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:02.505 21:12:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:02.505 21:12:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:04.417 21:13:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:04.417 00:23:04.417 real 0m8.883s 00:23:04.417 user 0m17.238s 00:23:04.417 sys 0m2.319s 00:23:04.417 21:13:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:04.417 21:13:00 -- common/autotest_common.sh@10 -- # set +x 00:23:04.417 ************************************ 00:23:04.417 END TEST nvmf_multicontroller 00:23:04.417 ************************************ 00:23:04.417 21:13:00 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:04.417 21:13:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:04.417 21:13:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:04.417 21:13:00 -- common/autotest_common.sh@10 -- # set +x 00:23:04.417 ************************************ 00:23:04.417 START TEST nvmf_aer 00:23:04.417 ************************************ 00:23:04.417 21:13:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:04.676 * Looking for test storage... 00:23:04.676 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:04.676 21:13:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:04.676 21:13:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:04.676 21:13:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:04.676 21:13:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:04.676 21:13:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:04.676 21:13:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:04.676 21:13:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:04.676 21:13:00 -- scripts/common.sh@335 -- # IFS=.-: 00:23:04.676 21:13:00 -- scripts/common.sh@335 -- # read -ra ver1 00:23:04.676 21:13:00 -- scripts/common.sh@336 -- # IFS=.-: 00:23:04.676 21:13:00 -- scripts/common.sh@336 -- # read -ra ver2 00:23:04.676 21:13:00 -- scripts/common.sh@337 -- # local 'op=<' 00:23:04.676 21:13:00 -- scripts/common.sh@339 -- # ver1_l=2 00:23:04.676 21:13:00 -- scripts/common.sh@340 -- # ver2_l=1 00:23:04.676 21:13:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:04.676 21:13:00 -- scripts/common.sh@343 -- # case "$op" in 00:23:04.676 21:13:00 -- scripts/common.sh@344 -- # : 1 00:23:04.676 21:13:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:04.676 21:13:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:04.676 21:13:00 -- scripts/common.sh@364 -- # decimal 1 00:23:04.676 21:13:00 -- scripts/common.sh@352 -- # local d=1 00:23:04.676 21:13:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:04.676 21:13:00 -- scripts/common.sh@354 -- # echo 1 00:23:04.676 21:13:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:04.676 21:13:00 -- scripts/common.sh@365 -- # decimal 2 00:23:04.676 21:13:00 -- scripts/common.sh@352 -- # local d=2 00:23:04.676 21:13:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:04.676 21:13:00 -- scripts/common.sh@354 -- # echo 2 00:23:04.676 21:13:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:04.676 21:13:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:04.676 21:13:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:04.676 21:13:00 -- scripts/common.sh@367 -- # return 0 00:23:04.676 21:13:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:04.676 21:13:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:04.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:04.676 --rc genhtml_branch_coverage=1 00:23:04.676 --rc genhtml_function_coverage=1 00:23:04.676 --rc genhtml_legend=1 00:23:04.676 --rc geninfo_all_blocks=1 00:23:04.676 --rc geninfo_unexecuted_blocks=1 00:23:04.676 00:23:04.676 ' 00:23:04.676 21:13:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:04.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:04.676 --rc genhtml_branch_coverage=1 00:23:04.676 --rc genhtml_function_coverage=1 00:23:04.676 --rc genhtml_legend=1 00:23:04.676 --rc geninfo_all_blocks=1 00:23:04.676 --rc geninfo_unexecuted_blocks=1 00:23:04.676 00:23:04.676 ' 00:23:04.676 21:13:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:04.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:04.676 --rc genhtml_branch_coverage=1 00:23:04.676 --rc genhtml_function_coverage=1 00:23:04.676 --rc genhtml_legend=1 00:23:04.676 --rc geninfo_all_blocks=1 00:23:04.676 --rc geninfo_unexecuted_blocks=1 00:23:04.676 00:23:04.676 ' 00:23:04.676 21:13:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:04.676 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:04.676 --rc genhtml_branch_coverage=1 00:23:04.676 --rc genhtml_function_coverage=1 00:23:04.676 --rc genhtml_legend=1 00:23:04.676 --rc geninfo_all_blocks=1 00:23:04.676 --rc geninfo_unexecuted_blocks=1 00:23:04.676 00:23:04.676 ' 00:23:04.676 21:13:00 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:04.676 21:13:00 -- nvmf/common.sh@7 -- # uname -s 00:23:04.676 21:13:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:04.676 21:13:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:04.676 21:13:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:04.676 21:13:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:04.676 21:13:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:04.676 21:13:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:04.676 21:13:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:04.676 21:13:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:04.676 21:13:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:04.676 21:13:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:04.676 21:13:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:04.676 21:13:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:04.676 21:13:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:04.676 21:13:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:04.676 21:13:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:04.676 21:13:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:04.676 21:13:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:04.676 21:13:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:04.676 21:13:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:04.676 21:13:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.676 21:13:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.676 21:13:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.676 21:13:00 -- paths/export.sh@5 -- # export PATH 00:23:04.676 21:13:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.676 21:13:00 -- nvmf/common.sh@46 -- # : 0 00:23:04.676 21:13:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:04.676 21:13:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:04.676 21:13:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:04.676 21:13:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:04.676 21:13:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:04.676 21:13:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:04.676 21:13:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:04.676 21:13:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:04.676 21:13:00 -- host/aer.sh@11 -- # nvmftestinit 00:23:04.676 21:13:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:04.676 21:13:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:04.676 21:13:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:04.676 21:13:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:04.676 21:13:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:04.676 21:13:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:04.677 21:13:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:04.677 21:13:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:04.677 21:13:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:04.677 21:13:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:04.677 21:13:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:04.677 21:13:00 -- common/autotest_common.sh@10 -- # set +x 00:23:06.582 21:13:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:06.582 21:13:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:06.582 21:13:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:06.582 21:13:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:06.582 21:13:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:06.582 21:13:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:06.582 21:13:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:06.582 21:13:02 -- nvmf/common.sh@294 -- # net_devs=() 00:23:06.582 21:13:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:06.582 21:13:02 -- nvmf/common.sh@295 -- # e810=() 00:23:06.582 21:13:02 -- nvmf/common.sh@295 -- # local -ga e810 00:23:06.582 21:13:02 -- nvmf/common.sh@296 -- # x722=() 00:23:06.582 21:13:02 -- nvmf/common.sh@296 -- # local -ga x722 00:23:06.582 21:13:02 -- nvmf/common.sh@297 -- # mlx=() 00:23:06.582 21:13:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:06.582 21:13:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:06.582 21:13:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:06.582 21:13:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:06.582 21:13:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:06.582 21:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:06.582 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:06.582 21:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:06.582 21:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:06.582 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:06.582 21:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:06.582 21:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:06.582 21:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:06.582 21:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:06.582 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:06.582 21:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:06.582 21:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:06.582 21:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:06.582 21:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:06.582 21:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:06.582 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:06.582 21:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:06.582 21:13:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:06.582 21:13:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:06.582 21:13:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:06.582 21:13:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:06.582 21:13:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:06.582 21:13:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:06.582 21:13:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:06.582 21:13:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:06.582 21:13:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:06.582 21:13:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:06.582 21:13:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:06.582 21:13:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:06.582 21:13:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:06.582 21:13:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:06.582 21:13:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:06.582 21:13:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:06.841 21:13:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:06.841 21:13:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:06.841 21:13:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:06.841 21:13:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:06.841 21:13:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:06.841 21:13:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:06.841 21:13:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:06.841 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:06.841 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:23:06.841 00:23:06.841 --- 10.0.0.2 ping statistics --- 00:23:06.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:06.841 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:23:06.841 21:13:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:06.841 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:06.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:23:06.841 00:23:06.841 --- 10.0.0.1 ping statistics --- 00:23:06.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:06.841 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:23:06.841 21:13:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:06.841 21:13:02 -- nvmf/common.sh@410 -- # return 0 00:23:06.841 21:13:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:06.841 21:13:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:06.841 21:13:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:06.841 21:13:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:06.841 21:13:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:06.841 21:13:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:06.841 21:13:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:06.841 21:13:02 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:06.841 21:13:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:06.841 21:13:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:06.841 21:13:02 -- common/autotest_common.sh@10 -- # set +x 00:23:06.841 21:13:02 -- nvmf/common.sh@469 -- # nvmfpid=4056100 00:23:06.841 21:13:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:06.841 21:13:02 -- nvmf/common.sh@470 -- # waitforlisten 4056100 00:23:06.841 21:13:02 -- common/autotest_common.sh@829 -- # '[' -z 4056100 ']' 00:23:06.841 21:13:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:06.841 21:13:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:06.841 21:13:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:06.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:06.841 21:13:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:06.842 21:13:02 -- common/autotest_common.sh@10 -- # set +x 00:23:06.842 [2024-11-27 21:13:02.976943] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:06.842 [2024-11-27 21:13:02.977026] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:06.842 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.842 [2024-11-27 21:13:03.046371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:07.100 [2024-11-27 21:13:03.161883] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:07.100 [2024-11-27 21:13:03.162056] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:07.100 [2024-11-27 21:13:03.162075] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:07.100 [2024-11-27 21:13:03.162089] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:07.100 [2024-11-27 21:13:03.162190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:07.100 [2024-11-27 21:13:03.162262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:07.100 [2024-11-27 21:13:03.162355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:07.100 [2024-11-27 21:13:03.162358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:08.033 21:13:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:08.033 21:13:03 -- common/autotest_common.sh@862 -- # return 0 00:23:08.033 21:13:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:08.033 21:13:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:08.033 21:13:03 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 21:13:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:08.033 21:13:03 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:08.033 21:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:03 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 [2024-11-27 21:13:03.966042] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:08.033 21:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.033 21:13:03 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:08.033 21:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:03 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 Malloc0 00:23:08.033 21:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.033 21:13:03 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:08.033 21:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:03 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.033 21:13:04 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:08.033 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.033 21:13:04 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:08.033 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 [2024-11-27 21:13:04.017173] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:08.033 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.033 21:13:04 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:08.033 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.033 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.033 [2024-11-27 21:13:04.024926] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:08.033 [ 00:23:08.033 { 00:23:08.034 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:08.034 "subtype": "Discovery", 00:23:08.034 "listen_addresses": [], 00:23:08.034 "allow_any_host": true, 00:23:08.034 "hosts": [] 00:23:08.034 }, 00:23:08.034 { 00:23:08.034 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:08.034 "subtype": "NVMe", 00:23:08.034 "listen_addresses": [ 00:23:08.034 { 00:23:08.034 "transport": "TCP", 00:23:08.034 "trtype": "TCP", 00:23:08.034 "adrfam": "IPv4", 00:23:08.034 "traddr": "10.0.0.2", 00:23:08.034 "trsvcid": "4420" 00:23:08.034 } 00:23:08.034 ], 00:23:08.034 "allow_any_host": true, 00:23:08.034 "hosts": [], 00:23:08.034 "serial_number": "SPDK00000000000001", 00:23:08.034 "model_number": "SPDK bdev Controller", 00:23:08.034 "max_namespaces": 2, 00:23:08.034 "min_cntlid": 1, 00:23:08.034 "max_cntlid": 65519, 00:23:08.034 "namespaces": [ 00:23:08.034 { 00:23:08.034 "nsid": 1, 00:23:08.034 "bdev_name": "Malloc0", 00:23:08.034 "name": "Malloc0", 00:23:08.034 "nguid": "407CC6929241434FA769783FAAB2AD9B", 00:23:08.034 "uuid": "407cc692-9241-434f-a769-783faab2ad9b" 00:23:08.034 } 00:23:08.034 ] 00:23:08.034 } 00:23:08.034 ] 00:23:08.034 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.034 21:13:04 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:08.034 21:13:04 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:08.034 21:13:04 -- host/aer.sh@33 -- # aerpid=4056265 00:23:08.034 21:13:04 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:08.034 21:13:04 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:08.034 21:13:04 -- common/autotest_common.sh@1254 -- # local i=0 00:23:08.034 21:13:04 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1257 -- # i=1 00:23:08.034 21:13:04 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:08.034 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.034 21:13:04 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1257 -- # i=2 00:23:08.034 21:13:04 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:08.034 21:13:04 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:23:08.034 21:13:04 -- common/autotest_common.sh@1257 -- # i=3 00:23:08.034 21:13:04 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:08.293 21:13:04 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.293 21:13:04 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.293 21:13:04 -- common/autotest_common.sh@1265 -- # return 0 00:23:08.293 21:13:04 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 Malloc1 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 Asynchronous Event Request test 00:23:08.293 Attaching to 10.0.0.2 00:23:08.293 Attached to 10.0.0.2 00:23:08.293 Registering asynchronous event callbacks... 00:23:08.293 Starting namespace attribute notice tests for all controllers... 00:23:08.293 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:08.293 aer_cb - Changed Namespace 00:23:08.293 Cleaning up... 00:23:08.293 [ 00:23:08.293 { 00:23:08.293 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:08.293 "subtype": "Discovery", 00:23:08.293 "listen_addresses": [], 00:23:08.293 "allow_any_host": true, 00:23:08.293 "hosts": [] 00:23:08.293 }, 00:23:08.293 { 00:23:08.293 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:08.293 "subtype": "NVMe", 00:23:08.293 "listen_addresses": [ 00:23:08.293 { 00:23:08.293 "transport": "TCP", 00:23:08.293 "trtype": "TCP", 00:23:08.293 "adrfam": "IPv4", 00:23:08.293 "traddr": "10.0.0.2", 00:23:08.293 "trsvcid": "4420" 00:23:08.293 } 00:23:08.293 ], 00:23:08.293 "allow_any_host": true, 00:23:08.293 "hosts": [], 00:23:08.293 "serial_number": "SPDK00000000000001", 00:23:08.293 "model_number": "SPDK bdev Controller", 00:23:08.293 "max_namespaces": 2, 00:23:08.293 "min_cntlid": 1, 00:23:08.293 "max_cntlid": 65519, 00:23:08.293 "namespaces": [ 00:23:08.293 { 00:23:08.293 "nsid": 1, 00:23:08.293 "bdev_name": "Malloc0", 00:23:08.293 "name": "Malloc0", 00:23:08.293 "nguid": "407CC6929241434FA769783FAAB2AD9B", 00:23:08.293 "uuid": "407cc692-9241-434f-a769-783faab2ad9b" 00:23:08.293 }, 00:23:08.293 { 00:23:08.293 "nsid": 2, 00:23:08.293 "bdev_name": "Malloc1", 00:23:08.293 "name": "Malloc1", 00:23:08.293 "nguid": "FFA839D3427B4403ACC4323F83A0EF2D", 00:23:08.293 "uuid": "ffa839d3-427b-4403-acc4-323f83a0ef2d" 00:23:08.293 } 00:23:08.293 ] 00:23:08.293 } 00:23:08.293 ] 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@43 -- # wait 4056265 00:23:08.293 21:13:04 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:08.293 21:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.293 21:13:04 -- common/autotest_common.sh@10 -- # set +x 00:23:08.293 21:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.293 21:13:04 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:08.293 21:13:04 -- host/aer.sh@51 -- # nvmftestfini 00:23:08.293 21:13:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:08.293 21:13:04 -- nvmf/common.sh@116 -- # sync 00:23:08.293 21:13:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:08.293 21:13:04 -- nvmf/common.sh@119 -- # set +e 00:23:08.293 21:13:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:08.293 21:13:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:08.293 rmmod nvme_tcp 00:23:08.293 rmmod nvme_fabrics 00:23:08.551 rmmod nvme_keyring 00:23:08.551 21:13:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:08.551 21:13:04 -- nvmf/common.sh@123 -- # set -e 00:23:08.551 21:13:04 -- nvmf/common.sh@124 -- # return 0 00:23:08.551 21:13:04 -- nvmf/common.sh@477 -- # '[' -n 4056100 ']' 00:23:08.551 21:13:04 -- nvmf/common.sh@478 -- # killprocess 4056100 00:23:08.551 21:13:04 -- common/autotest_common.sh@936 -- # '[' -z 4056100 ']' 00:23:08.551 21:13:04 -- common/autotest_common.sh@940 -- # kill -0 4056100 00:23:08.551 21:13:04 -- common/autotest_common.sh@941 -- # uname 00:23:08.551 21:13:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:08.551 21:13:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4056100 00:23:08.551 21:13:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:08.551 21:13:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:08.551 21:13:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4056100' 00:23:08.551 killing process with pid 4056100 00:23:08.551 21:13:04 -- common/autotest_common.sh@955 -- # kill 4056100 00:23:08.551 [2024-11-27 21:13:04.609837] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:08.551 21:13:04 -- common/autotest_common.sh@960 -- # wait 4056100 00:23:08.809 21:13:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:08.809 21:13:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:08.809 21:13:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:08.809 21:13:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:08.809 21:13:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:08.809 21:13:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.809 21:13:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.809 21:13:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:10.711 21:13:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:10.711 00:23:10.711 real 0m6.289s 00:23:10.711 user 0m7.656s 00:23:10.711 sys 0m1.971s 00:23:10.711 21:13:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:10.711 21:13:06 -- common/autotest_common.sh@10 -- # set +x 00:23:10.711 ************************************ 00:23:10.711 END TEST nvmf_aer 00:23:10.711 ************************************ 00:23:10.970 21:13:06 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:10.970 21:13:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:10.970 21:13:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:10.970 21:13:06 -- common/autotest_common.sh@10 -- # set +x 00:23:10.970 ************************************ 00:23:10.970 START TEST nvmf_async_init 00:23:10.970 ************************************ 00:23:10.970 21:13:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:10.970 * Looking for test storage... 00:23:10.970 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:10.970 21:13:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:10.970 21:13:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:10.970 21:13:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:10.970 21:13:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:10.970 21:13:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:10.970 21:13:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:10.970 21:13:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:10.970 21:13:07 -- scripts/common.sh@335 -- # IFS=.-: 00:23:10.970 21:13:07 -- scripts/common.sh@335 -- # read -ra ver1 00:23:10.970 21:13:07 -- scripts/common.sh@336 -- # IFS=.-: 00:23:10.970 21:13:07 -- scripts/common.sh@336 -- # read -ra ver2 00:23:10.970 21:13:07 -- scripts/common.sh@337 -- # local 'op=<' 00:23:10.970 21:13:07 -- scripts/common.sh@339 -- # ver1_l=2 00:23:10.970 21:13:07 -- scripts/common.sh@340 -- # ver2_l=1 00:23:10.970 21:13:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:10.970 21:13:07 -- scripts/common.sh@343 -- # case "$op" in 00:23:10.970 21:13:07 -- scripts/common.sh@344 -- # : 1 00:23:10.970 21:13:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:10.970 21:13:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:10.970 21:13:07 -- scripts/common.sh@364 -- # decimal 1 00:23:10.970 21:13:07 -- scripts/common.sh@352 -- # local d=1 00:23:10.970 21:13:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:10.970 21:13:07 -- scripts/common.sh@354 -- # echo 1 00:23:10.970 21:13:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:10.970 21:13:07 -- scripts/common.sh@365 -- # decimal 2 00:23:10.970 21:13:07 -- scripts/common.sh@352 -- # local d=2 00:23:10.970 21:13:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:10.970 21:13:07 -- scripts/common.sh@354 -- # echo 2 00:23:10.970 21:13:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:10.970 21:13:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:10.970 21:13:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:10.970 21:13:07 -- scripts/common.sh@367 -- # return 0 00:23:10.970 21:13:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:10.970 21:13:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:10.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.970 --rc genhtml_branch_coverage=1 00:23:10.970 --rc genhtml_function_coverage=1 00:23:10.970 --rc genhtml_legend=1 00:23:10.970 --rc geninfo_all_blocks=1 00:23:10.970 --rc geninfo_unexecuted_blocks=1 00:23:10.970 00:23:10.970 ' 00:23:10.970 21:13:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:10.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.970 --rc genhtml_branch_coverage=1 00:23:10.970 --rc genhtml_function_coverage=1 00:23:10.970 --rc genhtml_legend=1 00:23:10.970 --rc geninfo_all_blocks=1 00:23:10.970 --rc geninfo_unexecuted_blocks=1 00:23:10.970 00:23:10.970 ' 00:23:10.970 21:13:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:10.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.970 --rc genhtml_branch_coverage=1 00:23:10.970 --rc genhtml_function_coverage=1 00:23:10.970 --rc genhtml_legend=1 00:23:10.970 --rc geninfo_all_blocks=1 00:23:10.970 --rc geninfo_unexecuted_blocks=1 00:23:10.970 00:23:10.970 ' 00:23:10.970 21:13:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:10.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:10.970 --rc genhtml_branch_coverage=1 00:23:10.970 --rc genhtml_function_coverage=1 00:23:10.970 --rc genhtml_legend=1 00:23:10.970 --rc geninfo_all_blocks=1 00:23:10.970 --rc geninfo_unexecuted_blocks=1 00:23:10.970 00:23:10.970 ' 00:23:10.970 21:13:07 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:10.970 21:13:07 -- nvmf/common.sh@7 -- # uname -s 00:23:10.970 21:13:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:10.970 21:13:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:10.970 21:13:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:10.970 21:13:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:10.970 21:13:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:10.970 21:13:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:10.970 21:13:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:10.970 21:13:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:10.970 21:13:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:10.970 21:13:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:10.970 21:13:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:10.970 21:13:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:10.970 21:13:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:10.970 21:13:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:10.970 21:13:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:10.970 21:13:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:10.970 21:13:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:10.970 21:13:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:10.970 21:13:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:10.971 21:13:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.971 21:13:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.971 21:13:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.971 21:13:07 -- paths/export.sh@5 -- # export PATH 00:23:10.971 21:13:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:10.971 21:13:07 -- nvmf/common.sh@46 -- # : 0 00:23:10.971 21:13:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:10.971 21:13:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:10.971 21:13:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:10.971 21:13:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:10.971 21:13:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:10.971 21:13:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:10.971 21:13:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:10.971 21:13:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:10.971 21:13:07 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:10.971 21:13:07 -- host/async_init.sh@14 -- # null_block_size=512 00:23:10.971 21:13:07 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:10.971 21:13:07 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:10.971 21:13:07 -- host/async_init.sh@20 -- # uuidgen 00:23:10.971 21:13:07 -- host/async_init.sh@20 -- # tr -d - 00:23:10.971 21:13:07 -- host/async_init.sh@20 -- # nguid=4892c477f880401ebbc8c50af8d8a405 00:23:10.971 21:13:07 -- host/async_init.sh@22 -- # nvmftestinit 00:23:10.971 21:13:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:10.971 21:13:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:10.971 21:13:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:10.971 21:13:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:10.971 21:13:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:10.971 21:13:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:10.971 21:13:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:10.971 21:13:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:10.971 21:13:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:10.971 21:13:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:10.971 21:13:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:10.971 21:13:07 -- common/autotest_common.sh@10 -- # set +x 00:23:13.499 21:13:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:13.499 21:13:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:13.499 21:13:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:13.499 21:13:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:13.499 21:13:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:13.499 21:13:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:13.499 21:13:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:13.499 21:13:09 -- nvmf/common.sh@294 -- # net_devs=() 00:23:13.499 21:13:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:13.499 21:13:09 -- nvmf/common.sh@295 -- # e810=() 00:23:13.499 21:13:09 -- nvmf/common.sh@295 -- # local -ga e810 00:23:13.499 21:13:09 -- nvmf/common.sh@296 -- # x722=() 00:23:13.499 21:13:09 -- nvmf/common.sh@296 -- # local -ga x722 00:23:13.499 21:13:09 -- nvmf/common.sh@297 -- # mlx=() 00:23:13.499 21:13:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:13.499 21:13:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:13.499 21:13:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:13.499 21:13:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:13.499 21:13:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.499 21:13:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:13.499 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:13.499 21:13:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.499 21:13:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:13.499 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:13.499 21:13:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.499 21:13:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.499 21:13:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.499 21:13:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:13.499 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:13.499 21:13:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.499 21:13:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.499 21:13:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.499 21:13:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.499 21:13:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:13.499 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:13.499 21:13:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.499 21:13:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:13.499 21:13:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:13.499 21:13:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:13.499 21:13:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:13.499 21:13:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:13.499 21:13:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:13.499 21:13:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:13.499 21:13:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:13.499 21:13:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:13.499 21:13:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:13.499 21:13:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:13.499 21:13:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:13.499 21:13:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:13.499 21:13:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:13.499 21:13:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:13.499 21:13:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:13.499 21:13:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:13.499 21:13:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:13.499 21:13:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:13.499 21:13:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:13.499 21:13:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:13.499 21:13:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:13.499 21:13:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:13.499 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:13.499 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:23:13.499 00:23:13.499 --- 10.0.0.2 ping statistics --- 00:23:13.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.499 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:23:13.499 21:13:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:13.499 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:13.500 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:23:13.500 00:23:13.500 --- 10.0.0.1 ping statistics --- 00:23:13.500 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.500 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:23:13.500 21:13:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:13.500 21:13:09 -- nvmf/common.sh@410 -- # return 0 00:23:13.500 21:13:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:13.500 21:13:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:13.500 21:13:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:13.500 21:13:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:13.500 21:13:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:13.500 21:13:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:13.500 21:13:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:13.500 21:13:09 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:13.500 21:13:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:13.500 21:13:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:13.500 21:13:09 -- common/autotest_common.sh@10 -- # set +x 00:23:13.500 21:13:09 -- nvmf/common.sh@469 -- # nvmfpid=4058222 00:23:13.500 21:13:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:13.500 21:13:09 -- nvmf/common.sh@470 -- # waitforlisten 4058222 00:23:13.500 21:13:09 -- common/autotest_common.sh@829 -- # '[' -z 4058222 ']' 00:23:13.500 21:13:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:13.500 21:13:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:13.500 21:13:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:13.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:13.500 21:13:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:13.500 21:13:09 -- common/autotest_common.sh@10 -- # set +x 00:23:13.500 [2024-11-27 21:13:09.460223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:13.500 [2024-11-27 21:13:09.460309] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:13.500 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.500 [2024-11-27 21:13:09.537216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:13.500 [2024-11-27 21:13:09.653750] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:13.500 [2024-11-27 21:13:09.653913] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:13.500 [2024-11-27 21:13:09.653933] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:13.500 [2024-11-27 21:13:09.653947] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:13.500 [2024-11-27 21:13:09.653977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:14.433 21:13:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:14.433 21:13:10 -- common/autotest_common.sh@862 -- # return 0 00:23:14.433 21:13:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:14.433 21:13:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 21:13:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:14.433 21:13:10 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 [2024-11-27 21:13:10.520619] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 null0 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 4892c477f880401ebbc8c50af8d8a405 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.433 [2024-11-27 21:13:10.560893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:14.433 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.433 21:13:10 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:14.433 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.433 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.691 nvme0n1 00:23:14.691 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.691 21:13:10 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.691 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.691 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.691 [ 00:23:14.691 { 00:23:14.691 "name": "nvme0n1", 00:23:14.691 "aliases": [ 00:23:14.691 "4892c477-f880-401e-bbc8-c50af8d8a405" 00:23:14.691 ], 00:23:14.691 "product_name": "NVMe disk", 00:23:14.691 "block_size": 512, 00:23:14.691 "num_blocks": 2097152, 00:23:14.691 "uuid": "4892c477-f880-401e-bbc8-c50af8d8a405", 00:23:14.691 "assigned_rate_limits": { 00:23:14.691 "rw_ios_per_sec": 0, 00:23:14.691 "rw_mbytes_per_sec": 0, 00:23:14.691 "r_mbytes_per_sec": 0, 00:23:14.691 "w_mbytes_per_sec": 0 00:23:14.691 }, 00:23:14.691 "claimed": false, 00:23:14.691 "zoned": false, 00:23:14.691 "supported_io_types": { 00:23:14.691 "read": true, 00:23:14.691 "write": true, 00:23:14.691 "unmap": false, 00:23:14.691 "write_zeroes": true, 00:23:14.691 "flush": true, 00:23:14.691 "reset": true, 00:23:14.691 "compare": true, 00:23:14.691 "compare_and_write": true, 00:23:14.691 "abort": true, 00:23:14.691 "nvme_admin": true, 00:23:14.691 "nvme_io": true 00:23:14.691 }, 00:23:14.691 "driver_specific": { 00:23:14.691 "nvme": [ 00:23:14.691 { 00:23:14.691 "trid": { 00:23:14.691 "trtype": "TCP", 00:23:14.691 "adrfam": "IPv4", 00:23:14.691 "traddr": "10.0.0.2", 00:23:14.691 "trsvcid": "4420", 00:23:14.691 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.691 }, 00:23:14.691 "ctrlr_data": { 00:23:14.691 "cntlid": 1, 00:23:14.691 "vendor_id": "0x8086", 00:23:14.691 "model_number": "SPDK bdev Controller", 00:23:14.691 "serial_number": "00000000000000000000", 00:23:14.691 "firmware_revision": "24.01.1", 00:23:14.691 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.691 "oacs": { 00:23:14.691 "security": 0, 00:23:14.691 "format": 0, 00:23:14.691 "firmware": 0, 00:23:14.691 "ns_manage": 0 00:23:14.691 }, 00:23:14.691 "multi_ctrlr": true, 00:23:14.691 "ana_reporting": false 00:23:14.691 }, 00:23:14.691 "vs": { 00:23:14.691 "nvme_version": "1.3" 00:23:14.691 }, 00:23:14.691 "ns_data": { 00:23:14.691 "id": 1, 00:23:14.691 "can_share": true 00:23:14.691 } 00:23:14.691 } 00:23:14.691 ], 00:23:14.691 "mp_policy": "active_passive" 00:23:14.691 } 00:23:14.691 } 00:23:14.691 ] 00:23:14.691 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.691 21:13:10 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:14.691 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.691 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.691 [2024-11-27 21:13:10.809506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:14.691 [2024-11-27 21:13:10.809616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x711ba0 (9): Bad file descriptor 00:23:14.950 [2024-11-27 21:13:10.941672] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:14.950 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:10 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.950 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 [ 00:23:14.950 { 00:23:14.950 "name": "nvme0n1", 00:23:14.950 "aliases": [ 00:23:14.950 "4892c477-f880-401e-bbc8-c50af8d8a405" 00:23:14.950 ], 00:23:14.950 "product_name": "NVMe disk", 00:23:14.950 "block_size": 512, 00:23:14.950 "num_blocks": 2097152, 00:23:14.950 "uuid": "4892c477-f880-401e-bbc8-c50af8d8a405", 00:23:14.950 "assigned_rate_limits": { 00:23:14.950 "rw_ios_per_sec": 0, 00:23:14.950 "rw_mbytes_per_sec": 0, 00:23:14.950 "r_mbytes_per_sec": 0, 00:23:14.950 "w_mbytes_per_sec": 0 00:23:14.950 }, 00:23:14.950 "claimed": false, 00:23:14.950 "zoned": false, 00:23:14.950 "supported_io_types": { 00:23:14.950 "read": true, 00:23:14.950 "write": true, 00:23:14.950 "unmap": false, 00:23:14.950 "write_zeroes": true, 00:23:14.950 "flush": true, 00:23:14.950 "reset": true, 00:23:14.950 "compare": true, 00:23:14.950 "compare_and_write": true, 00:23:14.950 "abort": true, 00:23:14.950 "nvme_admin": true, 00:23:14.950 "nvme_io": true 00:23:14.950 }, 00:23:14.950 "driver_specific": { 00:23:14.950 "nvme": [ 00:23:14.950 { 00:23:14.950 "trid": { 00:23:14.950 "trtype": "TCP", 00:23:14.950 "adrfam": "IPv4", 00:23:14.950 "traddr": "10.0.0.2", 00:23:14.950 "trsvcid": "4420", 00:23:14.950 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.950 }, 00:23:14.950 "ctrlr_data": { 00:23:14.950 "cntlid": 2, 00:23:14.950 "vendor_id": "0x8086", 00:23:14.950 "model_number": "SPDK bdev Controller", 00:23:14.950 "serial_number": "00000000000000000000", 00:23:14.950 "firmware_revision": "24.01.1", 00:23:14.950 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.950 "oacs": { 00:23:14.950 "security": 0, 00:23:14.950 "format": 0, 00:23:14.950 "firmware": 0, 00:23:14.950 "ns_manage": 0 00:23:14.950 }, 00:23:14.950 "multi_ctrlr": true, 00:23:14.950 "ana_reporting": false 00:23:14.950 }, 00:23:14.950 "vs": { 00:23:14.950 "nvme_version": "1.3" 00:23:14.950 }, 00:23:14.950 "ns_data": { 00:23:14.950 "id": 1, 00:23:14.950 "can_share": true 00:23:14.950 } 00:23:14.950 } 00:23:14.950 ], 00:23:14.950 "mp_policy": "active_passive" 00:23:14.950 } 00:23:14.950 } 00:23:14.950 ] 00:23:14.950 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:10 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:14.950 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:10 -- host/async_init.sh@53 -- # mktemp 00:23:14.950 21:13:10 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.NU1iaMNy2e 00:23:14.950 21:13:10 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:14.950 21:13:10 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.NU1iaMNy2e 00:23:14.950 21:13:10 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:10 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:14.950 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 [2024-11-27 21:13:10.990124] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:14.950 [2024-11-27 21:13:10.990307] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:14.950 21:13:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:10 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.NU1iaMNy2e 00:23:14.950 21:13:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:10 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 21:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:11 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.NU1iaMNy2e 00:23:14.950 21:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:11 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 [2024-11-27 21:13:11.006157] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:14.950 nvme0n1 00:23:14.950 21:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.950 21:13:11 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.950 21:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.950 21:13:11 -- common/autotest_common.sh@10 -- # set +x 00:23:14.950 [ 00:23:14.950 { 00:23:14.950 "name": "nvme0n1", 00:23:14.950 "aliases": [ 00:23:14.950 "4892c477-f880-401e-bbc8-c50af8d8a405" 00:23:14.950 ], 00:23:14.950 "product_name": "NVMe disk", 00:23:14.950 "block_size": 512, 00:23:14.950 "num_blocks": 2097152, 00:23:14.950 "uuid": "4892c477-f880-401e-bbc8-c50af8d8a405", 00:23:14.950 "assigned_rate_limits": { 00:23:14.950 "rw_ios_per_sec": 0, 00:23:14.950 "rw_mbytes_per_sec": 0, 00:23:14.950 "r_mbytes_per_sec": 0, 00:23:14.951 "w_mbytes_per_sec": 0 00:23:14.951 }, 00:23:14.951 "claimed": false, 00:23:14.951 "zoned": false, 00:23:14.951 "supported_io_types": { 00:23:14.951 "read": true, 00:23:14.951 "write": true, 00:23:14.951 "unmap": false, 00:23:14.951 "write_zeroes": true, 00:23:14.951 "flush": true, 00:23:14.951 "reset": true, 00:23:14.951 "compare": true, 00:23:14.951 "compare_and_write": true, 00:23:14.951 "abort": true, 00:23:14.951 "nvme_admin": true, 00:23:14.951 "nvme_io": true 00:23:14.951 }, 00:23:14.951 "driver_specific": { 00:23:14.951 "nvme": [ 00:23:14.951 { 00:23:14.951 "trid": { 00:23:14.951 "trtype": "TCP", 00:23:14.951 "adrfam": "IPv4", 00:23:14.951 "traddr": "10.0.0.2", 00:23:14.951 "trsvcid": "4421", 00:23:14.951 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.951 }, 00:23:14.951 "ctrlr_data": { 00:23:14.951 "cntlid": 3, 00:23:14.951 "vendor_id": "0x8086", 00:23:14.951 "model_number": "SPDK bdev Controller", 00:23:14.951 "serial_number": "00000000000000000000", 00:23:14.951 "firmware_revision": "24.01.1", 00:23:14.951 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.951 "oacs": { 00:23:14.951 "security": 0, 00:23:14.951 "format": 0, 00:23:14.951 "firmware": 0, 00:23:14.951 "ns_manage": 0 00:23:14.951 }, 00:23:14.951 "multi_ctrlr": true, 00:23:14.951 "ana_reporting": false 00:23:14.951 }, 00:23:14.951 "vs": { 00:23:14.951 "nvme_version": "1.3" 00:23:14.951 }, 00:23:14.951 "ns_data": { 00:23:14.951 "id": 1, 00:23:14.951 "can_share": true 00:23:14.951 } 00:23:14.951 } 00:23:14.951 ], 00:23:14.951 "mp_policy": "active_passive" 00:23:14.951 } 00:23:14.951 } 00:23:14.951 ] 00:23:14.951 21:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.951 21:13:11 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:14.951 21:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.951 21:13:11 -- common/autotest_common.sh@10 -- # set +x 00:23:14.951 21:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.951 21:13:11 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.NU1iaMNy2e 00:23:14.951 21:13:11 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:14.951 21:13:11 -- host/async_init.sh@78 -- # nvmftestfini 00:23:14.951 21:13:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:14.951 21:13:11 -- nvmf/common.sh@116 -- # sync 00:23:14.951 21:13:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:14.951 21:13:11 -- nvmf/common.sh@119 -- # set +e 00:23:14.951 21:13:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:14.951 21:13:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:14.951 rmmod nvme_tcp 00:23:14.951 rmmod nvme_fabrics 00:23:14.951 rmmod nvme_keyring 00:23:14.951 21:13:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:14.951 21:13:11 -- nvmf/common.sh@123 -- # set -e 00:23:14.951 21:13:11 -- nvmf/common.sh@124 -- # return 0 00:23:14.951 21:13:11 -- nvmf/common.sh@477 -- # '[' -n 4058222 ']' 00:23:14.951 21:13:11 -- nvmf/common.sh@478 -- # killprocess 4058222 00:23:14.951 21:13:11 -- common/autotest_common.sh@936 -- # '[' -z 4058222 ']' 00:23:14.951 21:13:11 -- common/autotest_common.sh@940 -- # kill -0 4058222 00:23:14.951 21:13:11 -- common/autotest_common.sh@941 -- # uname 00:23:14.951 21:13:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:14.951 21:13:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4058222 00:23:15.209 21:13:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:15.209 21:13:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:15.209 21:13:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4058222' 00:23:15.209 killing process with pid 4058222 00:23:15.209 21:13:11 -- common/autotest_common.sh@955 -- # kill 4058222 00:23:15.209 21:13:11 -- common/autotest_common.sh@960 -- # wait 4058222 00:23:15.467 21:13:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:15.467 21:13:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:15.467 21:13:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:15.467 21:13:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:15.467 21:13:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:15.467 21:13:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.467 21:13:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.467 21:13:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.371 21:13:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:17.371 00:23:17.371 real 0m6.528s 00:23:17.371 user 0m3.219s 00:23:17.371 sys 0m1.959s 00:23:17.371 21:13:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:17.371 21:13:13 -- common/autotest_common.sh@10 -- # set +x 00:23:17.371 ************************************ 00:23:17.371 END TEST nvmf_async_init 00:23:17.371 ************************************ 00:23:17.371 21:13:13 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:17.371 21:13:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:17.371 21:13:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:17.371 21:13:13 -- common/autotest_common.sh@10 -- # set +x 00:23:17.371 ************************************ 00:23:17.371 START TEST dma 00:23:17.371 ************************************ 00:23:17.371 21:13:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:17.371 * Looking for test storage... 00:23:17.371 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.371 21:13:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:17.371 21:13:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:17.371 21:13:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:17.630 21:13:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:17.630 21:13:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:17.630 21:13:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:17.630 21:13:13 -- scripts/common.sh@335 -- # IFS=.-: 00:23:17.630 21:13:13 -- scripts/common.sh@335 -- # read -ra ver1 00:23:17.630 21:13:13 -- scripts/common.sh@336 -- # IFS=.-: 00:23:17.630 21:13:13 -- scripts/common.sh@336 -- # read -ra ver2 00:23:17.630 21:13:13 -- scripts/common.sh@337 -- # local 'op=<' 00:23:17.630 21:13:13 -- scripts/common.sh@339 -- # ver1_l=2 00:23:17.630 21:13:13 -- scripts/common.sh@340 -- # ver2_l=1 00:23:17.630 21:13:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:17.630 21:13:13 -- scripts/common.sh@343 -- # case "$op" in 00:23:17.630 21:13:13 -- scripts/common.sh@344 -- # : 1 00:23:17.630 21:13:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:17.630 21:13:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:17.630 21:13:13 -- scripts/common.sh@364 -- # decimal 1 00:23:17.630 21:13:13 -- scripts/common.sh@352 -- # local d=1 00:23:17.630 21:13:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:17.630 21:13:13 -- scripts/common.sh@354 -- # echo 1 00:23:17.630 21:13:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:17.630 21:13:13 -- scripts/common.sh@365 -- # decimal 2 00:23:17.630 21:13:13 -- scripts/common.sh@352 -- # local d=2 00:23:17.630 21:13:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:17.630 21:13:13 -- scripts/common.sh@354 -- # echo 2 00:23:17.630 21:13:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:17.630 21:13:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:17.630 21:13:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:17.630 21:13:13 -- scripts/common.sh@367 -- # return 0 00:23:17.630 21:13:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:17.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.630 --rc genhtml_branch_coverage=1 00:23:17.630 --rc genhtml_function_coverage=1 00:23:17.630 --rc genhtml_legend=1 00:23:17.630 --rc geninfo_all_blocks=1 00:23:17.630 --rc geninfo_unexecuted_blocks=1 00:23:17.630 00:23:17.630 ' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:17.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.630 --rc genhtml_branch_coverage=1 00:23:17.630 --rc genhtml_function_coverage=1 00:23:17.630 --rc genhtml_legend=1 00:23:17.630 --rc geninfo_all_blocks=1 00:23:17.630 --rc geninfo_unexecuted_blocks=1 00:23:17.630 00:23:17.630 ' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:17.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.630 --rc genhtml_branch_coverage=1 00:23:17.630 --rc genhtml_function_coverage=1 00:23:17.630 --rc genhtml_legend=1 00:23:17.630 --rc geninfo_all_blocks=1 00:23:17.630 --rc geninfo_unexecuted_blocks=1 00:23:17.630 00:23:17.630 ' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:17.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.630 --rc genhtml_branch_coverage=1 00:23:17.630 --rc genhtml_function_coverage=1 00:23:17.630 --rc genhtml_legend=1 00:23:17.630 --rc geninfo_all_blocks=1 00:23:17.630 --rc geninfo_unexecuted_blocks=1 00:23:17.630 00:23:17.630 ' 00:23:17.630 21:13:13 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.630 21:13:13 -- nvmf/common.sh@7 -- # uname -s 00:23:17.630 21:13:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.630 21:13:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.630 21:13:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.630 21:13:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.630 21:13:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.630 21:13:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.630 21:13:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.630 21:13:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.630 21:13:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.630 21:13:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.630 21:13:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.630 21:13:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.630 21:13:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.630 21:13:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.630 21:13:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.630 21:13:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.630 21:13:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.630 21:13:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.630 21:13:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.630 21:13:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.630 21:13:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.630 21:13:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.630 21:13:13 -- paths/export.sh@5 -- # export PATH 00:23:17.630 21:13:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.630 21:13:13 -- nvmf/common.sh@46 -- # : 0 00:23:17.630 21:13:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.630 21:13:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.630 21:13:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.630 21:13:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.630 21:13:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.630 21:13:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.630 21:13:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.630 21:13:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.630 21:13:13 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:17.630 21:13:13 -- host/dma.sh@13 -- # exit 0 00:23:17.630 00:23:17.630 real 0m0.155s 00:23:17.630 user 0m0.097s 00:23:17.630 sys 0m0.067s 00:23:17.630 21:13:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:17.630 21:13:13 -- common/autotest_common.sh@10 -- # set +x 00:23:17.630 ************************************ 00:23:17.630 END TEST dma 00:23:17.630 ************************************ 00:23:17.630 21:13:13 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:17.630 21:13:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:17.630 21:13:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:17.630 21:13:13 -- common/autotest_common.sh@10 -- # set +x 00:23:17.630 ************************************ 00:23:17.630 START TEST nvmf_identify 00:23:17.630 ************************************ 00:23:17.630 21:13:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:17.630 * Looking for test storage... 00:23:17.631 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.631 21:13:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:17.631 21:13:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:17.631 21:13:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:17.631 21:13:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:17.631 21:13:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:17.631 21:13:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:17.631 21:13:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:17.631 21:13:13 -- scripts/common.sh@335 -- # IFS=.-: 00:23:17.631 21:13:13 -- scripts/common.sh@335 -- # read -ra ver1 00:23:17.631 21:13:13 -- scripts/common.sh@336 -- # IFS=.-: 00:23:17.631 21:13:13 -- scripts/common.sh@336 -- # read -ra ver2 00:23:17.631 21:13:13 -- scripts/common.sh@337 -- # local 'op=<' 00:23:17.631 21:13:13 -- scripts/common.sh@339 -- # ver1_l=2 00:23:17.631 21:13:13 -- scripts/common.sh@340 -- # ver2_l=1 00:23:17.631 21:13:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:17.631 21:13:13 -- scripts/common.sh@343 -- # case "$op" in 00:23:17.631 21:13:13 -- scripts/common.sh@344 -- # : 1 00:23:17.631 21:13:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:17.631 21:13:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:17.631 21:13:13 -- scripts/common.sh@364 -- # decimal 1 00:23:17.631 21:13:13 -- scripts/common.sh@352 -- # local d=1 00:23:17.631 21:13:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:17.631 21:13:13 -- scripts/common.sh@354 -- # echo 1 00:23:17.631 21:13:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:17.631 21:13:13 -- scripts/common.sh@365 -- # decimal 2 00:23:17.631 21:13:13 -- scripts/common.sh@352 -- # local d=2 00:23:17.631 21:13:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:17.631 21:13:13 -- scripts/common.sh@354 -- # echo 2 00:23:17.631 21:13:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:17.631 21:13:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:17.631 21:13:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:17.631 21:13:13 -- scripts/common.sh@367 -- # return 0 00:23:17.631 21:13:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:17.631 21:13:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:17.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.631 --rc genhtml_branch_coverage=1 00:23:17.631 --rc genhtml_function_coverage=1 00:23:17.631 --rc genhtml_legend=1 00:23:17.631 --rc geninfo_all_blocks=1 00:23:17.631 --rc geninfo_unexecuted_blocks=1 00:23:17.631 00:23:17.631 ' 00:23:17.631 21:13:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:17.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.631 --rc genhtml_branch_coverage=1 00:23:17.631 --rc genhtml_function_coverage=1 00:23:17.631 --rc genhtml_legend=1 00:23:17.631 --rc geninfo_all_blocks=1 00:23:17.631 --rc geninfo_unexecuted_blocks=1 00:23:17.631 00:23:17.631 ' 00:23:17.631 21:13:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:17.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.631 --rc genhtml_branch_coverage=1 00:23:17.631 --rc genhtml_function_coverage=1 00:23:17.631 --rc genhtml_legend=1 00:23:17.631 --rc geninfo_all_blocks=1 00:23:17.631 --rc geninfo_unexecuted_blocks=1 00:23:17.631 00:23:17.631 ' 00:23:17.631 21:13:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:17.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.631 --rc genhtml_branch_coverage=1 00:23:17.631 --rc genhtml_function_coverage=1 00:23:17.631 --rc genhtml_legend=1 00:23:17.631 --rc geninfo_all_blocks=1 00:23:17.631 --rc geninfo_unexecuted_blocks=1 00:23:17.631 00:23:17.631 ' 00:23:17.631 21:13:13 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.631 21:13:13 -- nvmf/common.sh@7 -- # uname -s 00:23:17.631 21:13:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.631 21:13:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.631 21:13:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.631 21:13:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.631 21:13:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.631 21:13:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.631 21:13:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.631 21:13:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.631 21:13:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.631 21:13:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.631 21:13:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.631 21:13:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.631 21:13:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.631 21:13:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.631 21:13:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.631 21:13:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.631 21:13:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.631 21:13:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.631 21:13:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.631 21:13:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.631 21:13:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.631 21:13:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.631 21:13:13 -- paths/export.sh@5 -- # export PATH 00:23:17.631 21:13:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.631 21:13:13 -- nvmf/common.sh@46 -- # : 0 00:23:17.631 21:13:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.631 21:13:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.631 21:13:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.631 21:13:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.631 21:13:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.631 21:13:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.631 21:13:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.631 21:13:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.631 21:13:13 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:17.631 21:13:13 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:17.631 21:13:13 -- host/identify.sh@14 -- # nvmftestinit 00:23:17.631 21:13:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:17.631 21:13:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:17.631 21:13:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:17.631 21:13:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:17.631 21:13:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:17.631 21:13:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.631 21:13:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.631 21:13:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.631 21:13:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:17.631 21:13:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:17.631 21:13:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:17.631 21:13:13 -- common/autotest_common.sh@10 -- # set +x 00:23:20.162 21:13:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:20.162 21:13:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:20.162 21:13:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:20.162 21:13:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:20.162 21:13:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:20.162 21:13:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:20.162 21:13:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:20.162 21:13:15 -- nvmf/common.sh@294 -- # net_devs=() 00:23:20.162 21:13:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:20.162 21:13:15 -- nvmf/common.sh@295 -- # e810=() 00:23:20.162 21:13:15 -- nvmf/common.sh@295 -- # local -ga e810 00:23:20.162 21:13:15 -- nvmf/common.sh@296 -- # x722=() 00:23:20.162 21:13:15 -- nvmf/common.sh@296 -- # local -ga x722 00:23:20.162 21:13:15 -- nvmf/common.sh@297 -- # mlx=() 00:23:20.162 21:13:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:20.162 21:13:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:20.162 21:13:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:20.162 21:13:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:20.162 21:13:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:20.162 21:13:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:20.162 21:13:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:20.162 21:13:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:20.162 21:13:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:20.163 21:13:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:20.163 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:20.163 21:13:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:20.163 21:13:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:20.163 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:20.163 21:13:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:20.163 21:13:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:20.163 21:13:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:20.163 21:13:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:20.163 21:13:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:20.163 21:13:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:20.163 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:20.163 21:13:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:20.163 21:13:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:20.163 21:13:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:20.163 21:13:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:20.163 21:13:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:20.163 21:13:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:20.163 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:20.163 21:13:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:20.163 21:13:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:20.163 21:13:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:20.163 21:13:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:20.163 21:13:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:20.163 21:13:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:20.163 21:13:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:20.163 21:13:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:20.163 21:13:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:20.163 21:13:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:20.163 21:13:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:20.163 21:13:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:20.163 21:13:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:20.163 21:13:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:20.163 21:13:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:20.163 21:13:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:20.163 21:13:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:20.163 21:13:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:20.163 21:13:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:20.163 21:13:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:20.163 21:13:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:20.163 21:13:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:20.163 21:13:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:20.163 21:13:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:20.163 21:13:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:20.163 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:20.163 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:23:20.163 00:23:20.163 --- 10.0.0.2 ping statistics --- 00:23:20.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:20.163 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:23:20.163 21:13:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:20.163 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:20.163 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:23:20.163 00:23:20.163 --- 10.0.0.1 ping statistics --- 00:23:20.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:20.163 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:23:20.163 21:13:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:20.163 21:13:16 -- nvmf/common.sh@410 -- # return 0 00:23:20.163 21:13:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:20.163 21:13:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:20.163 21:13:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:20.163 21:13:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:20.163 21:13:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:20.163 21:13:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:20.163 21:13:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:20.163 21:13:16 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:20.163 21:13:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:20.163 21:13:16 -- common/autotest_common.sh@10 -- # set +x 00:23:20.163 21:13:16 -- host/identify.sh@19 -- # nvmfpid=4060508 00:23:20.163 21:13:16 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:20.163 21:13:16 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:20.163 21:13:16 -- host/identify.sh@23 -- # waitforlisten 4060508 00:23:20.163 21:13:16 -- common/autotest_common.sh@829 -- # '[' -z 4060508 ']' 00:23:20.163 21:13:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:20.163 21:13:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:20.163 21:13:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:20.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:20.163 21:13:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:20.163 21:13:16 -- common/autotest_common.sh@10 -- # set +x 00:23:20.163 [2024-11-27 21:13:16.099345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:20.163 [2024-11-27 21:13:16.099433] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:20.163 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.163 [2024-11-27 21:13:16.172936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:20.163 [2024-11-27 21:13:16.290063] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:20.163 [2024-11-27 21:13:16.290215] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:20.163 [2024-11-27 21:13:16.290234] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:20.163 [2024-11-27 21:13:16.290247] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:20.163 [2024-11-27 21:13:16.290305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:20.163 [2024-11-27 21:13:16.290360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:20.163 [2024-11-27 21:13:16.290477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:20.163 [2024-11-27 21:13:16.290480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:21.097 21:13:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:21.097 21:13:17 -- common/autotest_common.sh@862 -- # return 0 00:23:21.097 21:13:17 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 [2024-11-27 21:13:17.053952] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:21.097 21:13:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 21:13:17 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 Malloc0 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 [2024-11-27 21:13:17.135217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:21.097 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.097 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.097 [2024-11-27 21:13:17.150978] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:21.097 [ 00:23:21.097 { 00:23:21.097 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:21.097 "subtype": "Discovery", 00:23:21.097 "listen_addresses": [ 00:23:21.097 { 00:23:21.097 "transport": "TCP", 00:23:21.097 "trtype": "TCP", 00:23:21.097 "adrfam": "IPv4", 00:23:21.097 "traddr": "10.0.0.2", 00:23:21.097 "trsvcid": "4420" 00:23:21.097 } 00:23:21.097 ], 00:23:21.097 "allow_any_host": true, 00:23:21.097 "hosts": [] 00:23:21.097 }, 00:23:21.097 { 00:23:21.097 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:21.097 "subtype": "NVMe", 00:23:21.097 "listen_addresses": [ 00:23:21.097 { 00:23:21.097 "transport": "TCP", 00:23:21.097 "trtype": "TCP", 00:23:21.097 "adrfam": "IPv4", 00:23:21.097 "traddr": "10.0.0.2", 00:23:21.097 "trsvcid": "4420" 00:23:21.097 } 00:23:21.097 ], 00:23:21.097 "allow_any_host": true, 00:23:21.097 "hosts": [], 00:23:21.097 "serial_number": "SPDK00000000000001", 00:23:21.097 "model_number": "SPDK bdev Controller", 00:23:21.097 "max_namespaces": 32, 00:23:21.097 "min_cntlid": 1, 00:23:21.097 "max_cntlid": 65519, 00:23:21.097 "namespaces": [ 00:23:21.097 { 00:23:21.097 "nsid": 1, 00:23:21.097 "bdev_name": "Malloc0", 00:23:21.097 "name": "Malloc0", 00:23:21.097 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:21.097 "eui64": "ABCDEF0123456789", 00:23:21.097 "uuid": "0e55b12a-995b-4071-8718-5225ef465390" 00:23:21.097 } 00:23:21.097 ] 00:23:21.097 } 00:23:21.097 ] 00:23:21.097 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.097 21:13:17 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:21.097 [2024-11-27 21:13:17.175484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:21.097 [2024-11-27 21:13:17.175537] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4060667 ] 00:23:21.097 EAL: No free 2048 kB hugepages reported on node 1 00:23:21.097 [2024-11-27 21:13:17.208831] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:21.097 [2024-11-27 21:13:17.208905] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:21.097 [2024-11-27 21:13:17.208915] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:21.097 [2024-11-27 21:13:17.208947] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:21.097 [2024-11-27 21:13:17.208962] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:21.097 [2024-11-27 21:13:17.212582] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:21.097 [2024-11-27 21:13:17.212660] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x17d3e10 0 00:23:21.097 [2024-11-27 21:13:17.220540] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:21.097 [2024-11-27 21:13:17.220564] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:21.097 [2024-11-27 21:13:17.220573] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:21.097 [2024-11-27 21:13:17.220579] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:21.097 [2024-11-27 21:13:17.220640] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.097 [2024-11-27 21:13:17.220654] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.097 [2024-11-27 21:13:17.220661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.097 [2024-11-27 21:13:17.220680] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:21.097 [2024-11-27 21:13:17.220708] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.097 [2024-11-27 21:13:17.228542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.097 [2024-11-27 21:13:17.228560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.097 [2024-11-27 21:13:17.228567] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.097 [2024-11-27 21:13:17.228585] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.097 [2024-11-27 21:13:17.228608] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:21.097 [2024-11-27 21:13:17.228621] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:21.097 [2024-11-27 21:13:17.228631] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:21.097 [2024-11-27 21:13:17.228661] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.097 [2024-11-27 21:13:17.228675] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.097 [2024-11-27 21:13:17.228682] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.228693] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.228717] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.228851] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.228867] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.228874] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.228884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.228896] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:21.098 [2024-11-27 21:13:17.228910] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:21.098 [2024-11-27 21:13:17.228922] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.228933] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.228939] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.228950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.228972] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.229080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.229096] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.229103] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.229124] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:21.098 [2024-11-27 21:13:17.229139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229152] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229161] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.229179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.229201] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.229303] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.229319] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.229325] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229332] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.229345] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229363] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229372] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229378] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.229395] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.229419] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.229515] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.229538] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.229546] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229552] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.229563] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:21.098 [2024-11-27 21:13:17.229579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229593] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229707] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:21.098 [2024-11-27 21:13:17.229715] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229732] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229740] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229746] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.229772] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.229794] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.229904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.229920] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.229926] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229936] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.229948] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:21.098 [2024-11-27 21:13:17.229965] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229973] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.229979] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.229993] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.230015] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.230100] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.230115] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.230122] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.230131] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.230141] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:21.098 [2024-11-27 21:13:17.230150] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:21.098 [2024-11-27 21:13:17.230168] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:21.098 [2024-11-27 21:13:17.230186] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:21.098 [2024-11-27 21:13:17.230204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.230211] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.230217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.230229] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.098 [2024-11-27 21:13:17.230250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.230395] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.098 [2024-11-27 21:13:17.230416] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.098 [2024-11-27 21:13:17.230428] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.230435] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17d3e10): datao=0, datal=4096, cccid=0 00:23:21.098 [2024-11-27 21:13:17.230444] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1853b30) on tqpair(0x17d3e10): expected_datao=0, payload_size=4096 00:23:21.098 [2024-11-27 21:13:17.230464] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.230476] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.270648] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.270668] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.270679] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.270687] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.098 [2024-11-27 21:13:17.270702] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:21.098 [2024-11-27 21:13:17.270712] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:21.098 [2024-11-27 21:13:17.270719] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:21.098 [2024-11-27 21:13:17.270728] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:21.098 [2024-11-27 21:13:17.270735] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:21.098 [2024-11-27 21:13:17.270744] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:21.098 [2024-11-27 21:13:17.270767] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:21.098 [2024-11-27 21:13:17.270784] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.270791] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.098 [2024-11-27 21:13:17.270797] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.098 [2024-11-27 21:13:17.270809] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:21.098 [2024-11-27 21:13:17.270833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.098 [2024-11-27 21:13:17.270931] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.098 [2024-11-27 21:13:17.270947] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.098 [2024-11-27 21:13:17.270958] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.270966] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853b30) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.270986] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.270994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271000] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.099 [2024-11-27 21:13:17.271021] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271027] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271033] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.099 [2024-11-27 21:13:17.271051] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271058] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271064] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271072] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.099 [2024-11-27 21:13:17.271081] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271088] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271094] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.099 [2024-11-27 21:13:17.271126] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:21.099 [2024-11-27 21:13:17.271149] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:21.099 [2024-11-27 21:13:17.271163] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271169] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271175] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271185] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.099 [2024-11-27 21:13:17.271224] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853b30, cid 0, qid 0 00:23:21.099 [2024-11-27 21:13:17.271235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853c90, cid 1, qid 0 00:23:21.099 [2024-11-27 21:13:17.271241] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853df0, cid 2, qid 0 00:23:21.099 [2024-11-27 21:13:17.271248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.099 [2024-11-27 21:13:17.271255] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18540b0, cid 4, qid 0 00:23:21.099 [2024-11-27 21:13:17.271455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.099 [2024-11-27 21:13:17.271471] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.099 [2024-11-27 21:13:17.271478] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271487] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18540b0) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.271500] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:21.099 [2024-11-27 21:13:17.271514] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:21.099 [2024-11-27 21:13:17.271542] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271554] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271561] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.099 [2024-11-27 21:13:17.271593] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18540b0, cid 4, qid 0 00:23:21.099 [2024-11-27 21:13:17.271701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.099 [2024-11-27 21:13:17.271717] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.099 [2024-11-27 21:13:17.271724] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271733] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17d3e10): datao=0, datal=4096, cccid=4 00:23:21.099 [2024-11-27 21:13:17.271742] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18540b0) on tqpair(0x17d3e10): expected_datao=0, payload_size=4096 00:23:21.099 [2024-11-27 21:13:17.271760] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271774] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271789] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.099 [2024-11-27 21:13:17.271799] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.099 [2024-11-27 21:13:17.271805] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271811] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18540b0) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.271834] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:21.099 [2024-11-27 21:13:17.271879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271889] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271896] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271906] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.099 [2024-11-27 21:13:17.271919] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271925] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.271931] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.271940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.099 [2024-11-27 21:13:17.271968] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18540b0, cid 4, qid 0 00:23:21.099 [2024-11-27 21:13:17.271995] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1854210, cid 5, qid 0 00:23:21.099 [2024-11-27 21:13:17.272212] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.099 [2024-11-27 21:13:17.272227] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.099 [2024-11-27 21:13:17.272234] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.272243] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17d3e10): datao=0, datal=1024, cccid=4 00:23:21.099 [2024-11-27 21:13:17.272252] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18540b0) on tqpair(0x17d3e10): expected_datao=0, payload_size=1024 00:23:21.099 [2024-11-27 21:13:17.272262] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.272270] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.272282] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.099 [2024-11-27 21:13:17.272292] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.099 [2024-11-27 21:13:17.272298] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.272305] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1854210) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.316553] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.099 [2024-11-27 21:13:17.316572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.099 [2024-11-27 21:13:17.316580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18540b0) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.316607] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316616] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316622] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.316633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.099 [2024-11-27 21:13:17.316666] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18540b0, cid 4, qid 0 00:23:21.099 [2024-11-27 21:13:17.316843] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.099 [2024-11-27 21:13:17.316860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.099 [2024-11-27 21:13:17.316870] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316879] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17d3e10): datao=0, datal=3072, cccid=4 00:23:21.099 [2024-11-27 21:13:17.316892] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18540b0) on tqpair(0x17d3e10): expected_datao=0, payload_size=3072 00:23:21.099 [2024-11-27 21:13:17.316909] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316918] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316931] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.099 [2024-11-27 21:13:17.316940] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.099 [2024-11-27 21:13:17.316947] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316953] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18540b0) on tqpair=0x17d3e10 00:23:21.099 [2024-11-27 21:13:17.316971] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316979] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.316985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x17d3e10) 00:23:21.099 [2024-11-27 21:13:17.316996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.099 [2024-11-27 21:13:17.317028] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18540b0, cid 4, qid 0 00:23:21.099 [2024-11-27 21:13:17.317141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.099 [2024-11-27 21:13:17.317156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.099 [2024-11-27 21:13:17.317163] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.099 [2024-11-27 21:13:17.317169] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x17d3e10): datao=0, datal=8, cccid=4 00:23:21.099 [2024-11-27 21:13:17.317180] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18540b0) on tqpair(0x17d3e10): expected_datao=0, payload_size=8 00:23:21.100 [2024-11-27 21:13:17.317192] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.100 [2024-11-27 21:13:17.317199] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.361 [2024-11-27 21:13:17.359558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.361 [2024-11-27 21:13:17.359577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.361 [2024-11-27 21:13:17.359585] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.361 [2024-11-27 21:13:17.359591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x18540b0) on tqpair=0x17d3e10 00:23:21.361 ===================================================== 00:23:21.361 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:21.361 ===================================================== 00:23:21.361 Controller Capabilities/Features 00:23:21.361 ================================ 00:23:21.361 Vendor ID: 0000 00:23:21.361 Subsystem Vendor ID: 0000 00:23:21.361 Serial Number: .................... 00:23:21.361 Model Number: ........................................ 00:23:21.361 Firmware Version: 24.01.1 00:23:21.361 Recommended Arb Burst: 0 00:23:21.361 IEEE OUI Identifier: 00 00 00 00:23:21.361 Multi-path I/O 00:23:21.361 May have multiple subsystem ports: No 00:23:21.361 May have multiple controllers: No 00:23:21.361 Associated with SR-IOV VF: No 00:23:21.361 Max Data Transfer Size: 131072 00:23:21.361 Max Number of Namespaces: 0 00:23:21.361 Max Number of I/O Queues: 1024 00:23:21.361 NVMe Specification Version (VS): 1.3 00:23:21.361 NVMe Specification Version (Identify): 1.3 00:23:21.361 Maximum Queue Entries: 128 00:23:21.361 Contiguous Queues Required: Yes 00:23:21.361 Arbitration Mechanisms Supported 00:23:21.361 Weighted Round Robin: Not Supported 00:23:21.361 Vendor Specific: Not Supported 00:23:21.361 Reset Timeout: 15000 ms 00:23:21.361 Doorbell Stride: 4 bytes 00:23:21.361 NVM Subsystem Reset: Not Supported 00:23:21.361 Command Sets Supported 00:23:21.361 NVM Command Set: Supported 00:23:21.361 Boot Partition: Not Supported 00:23:21.361 Memory Page Size Minimum: 4096 bytes 00:23:21.361 Memory Page Size Maximum: 4096 bytes 00:23:21.361 Persistent Memory Region: Not Supported 00:23:21.361 Optional Asynchronous Events Supported 00:23:21.361 Namespace Attribute Notices: Not Supported 00:23:21.362 Firmware Activation Notices: Not Supported 00:23:21.362 ANA Change Notices: Not Supported 00:23:21.362 PLE Aggregate Log Change Notices: Not Supported 00:23:21.362 LBA Status Info Alert Notices: Not Supported 00:23:21.362 EGE Aggregate Log Change Notices: Not Supported 00:23:21.362 Normal NVM Subsystem Shutdown event: Not Supported 00:23:21.362 Zone Descriptor Change Notices: Not Supported 00:23:21.362 Discovery Log Change Notices: Supported 00:23:21.362 Controller Attributes 00:23:21.362 128-bit Host Identifier: Not Supported 00:23:21.362 Non-Operational Permissive Mode: Not Supported 00:23:21.362 NVM Sets: Not Supported 00:23:21.362 Read Recovery Levels: Not Supported 00:23:21.362 Endurance Groups: Not Supported 00:23:21.362 Predictable Latency Mode: Not Supported 00:23:21.362 Traffic Based Keep ALive: Not Supported 00:23:21.362 Namespace Granularity: Not Supported 00:23:21.362 SQ Associations: Not Supported 00:23:21.362 UUID List: Not Supported 00:23:21.362 Multi-Domain Subsystem: Not Supported 00:23:21.362 Fixed Capacity Management: Not Supported 00:23:21.362 Variable Capacity Management: Not Supported 00:23:21.362 Delete Endurance Group: Not Supported 00:23:21.362 Delete NVM Set: Not Supported 00:23:21.362 Extended LBA Formats Supported: Not Supported 00:23:21.362 Flexible Data Placement Supported: Not Supported 00:23:21.362 00:23:21.362 Controller Memory Buffer Support 00:23:21.362 ================================ 00:23:21.362 Supported: No 00:23:21.362 00:23:21.362 Persistent Memory Region Support 00:23:21.362 ================================ 00:23:21.362 Supported: No 00:23:21.362 00:23:21.362 Admin Command Set Attributes 00:23:21.362 ============================ 00:23:21.362 Security Send/Receive: Not Supported 00:23:21.362 Format NVM: Not Supported 00:23:21.362 Firmware Activate/Download: Not Supported 00:23:21.362 Namespace Management: Not Supported 00:23:21.362 Device Self-Test: Not Supported 00:23:21.362 Directives: Not Supported 00:23:21.362 NVMe-MI: Not Supported 00:23:21.362 Virtualization Management: Not Supported 00:23:21.362 Doorbell Buffer Config: Not Supported 00:23:21.362 Get LBA Status Capability: Not Supported 00:23:21.362 Command & Feature Lockdown Capability: Not Supported 00:23:21.362 Abort Command Limit: 1 00:23:21.362 Async Event Request Limit: 4 00:23:21.362 Number of Firmware Slots: N/A 00:23:21.362 Firmware Slot 1 Read-Only: N/A 00:23:21.362 Firmware Activation Without Reset: N/A 00:23:21.362 Multiple Update Detection Support: N/A 00:23:21.362 Firmware Update Granularity: No Information Provided 00:23:21.362 Per-Namespace SMART Log: No 00:23:21.362 Asymmetric Namespace Access Log Page: Not Supported 00:23:21.362 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:21.362 Command Effects Log Page: Not Supported 00:23:21.362 Get Log Page Extended Data: Supported 00:23:21.362 Telemetry Log Pages: Not Supported 00:23:21.362 Persistent Event Log Pages: Not Supported 00:23:21.362 Supported Log Pages Log Page: May Support 00:23:21.362 Commands Supported & Effects Log Page: Not Supported 00:23:21.362 Feature Identifiers & Effects Log Page:May Support 00:23:21.362 NVMe-MI Commands & Effects Log Page: May Support 00:23:21.362 Data Area 4 for Telemetry Log: Not Supported 00:23:21.362 Error Log Page Entries Supported: 128 00:23:21.362 Keep Alive: Not Supported 00:23:21.362 00:23:21.362 NVM Command Set Attributes 00:23:21.362 ========================== 00:23:21.362 Submission Queue Entry Size 00:23:21.362 Max: 1 00:23:21.362 Min: 1 00:23:21.362 Completion Queue Entry Size 00:23:21.362 Max: 1 00:23:21.362 Min: 1 00:23:21.362 Number of Namespaces: 0 00:23:21.362 Compare Command: Not Supported 00:23:21.362 Write Uncorrectable Command: Not Supported 00:23:21.362 Dataset Management Command: Not Supported 00:23:21.362 Write Zeroes Command: Not Supported 00:23:21.362 Set Features Save Field: Not Supported 00:23:21.362 Reservations: Not Supported 00:23:21.362 Timestamp: Not Supported 00:23:21.362 Copy: Not Supported 00:23:21.362 Volatile Write Cache: Not Present 00:23:21.362 Atomic Write Unit (Normal): 1 00:23:21.362 Atomic Write Unit (PFail): 1 00:23:21.362 Atomic Compare & Write Unit: 1 00:23:21.362 Fused Compare & Write: Supported 00:23:21.362 Scatter-Gather List 00:23:21.362 SGL Command Set: Supported 00:23:21.362 SGL Keyed: Supported 00:23:21.362 SGL Bit Bucket Descriptor: Not Supported 00:23:21.362 SGL Metadata Pointer: Not Supported 00:23:21.362 Oversized SGL: Not Supported 00:23:21.362 SGL Metadata Address: Not Supported 00:23:21.362 SGL Offset: Supported 00:23:21.362 Transport SGL Data Block: Not Supported 00:23:21.362 Replay Protected Memory Block: Not Supported 00:23:21.362 00:23:21.362 Firmware Slot Information 00:23:21.362 ========================= 00:23:21.362 Active slot: 0 00:23:21.362 00:23:21.362 00:23:21.362 Error Log 00:23:21.362 ========= 00:23:21.362 00:23:21.362 Active Namespaces 00:23:21.362 ================= 00:23:21.362 Discovery Log Page 00:23:21.362 ================== 00:23:21.362 Generation Counter: 2 00:23:21.362 Number of Records: 2 00:23:21.362 Record Format: 0 00:23:21.362 00:23:21.362 Discovery Log Entry 0 00:23:21.362 ---------------------- 00:23:21.362 Transport Type: 3 (TCP) 00:23:21.362 Address Family: 1 (IPv4) 00:23:21.362 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:21.362 Entry Flags: 00:23:21.362 Duplicate Returned Information: 1 00:23:21.362 Explicit Persistent Connection Support for Discovery: 1 00:23:21.362 Transport Requirements: 00:23:21.362 Secure Channel: Not Required 00:23:21.362 Port ID: 0 (0x0000) 00:23:21.362 Controller ID: 65535 (0xffff) 00:23:21.362 Admin Max SQ Size: 128 00:23:21.362 Transport Service Identifier: 4420 00:23:21.362 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:21.362 Transport Address: 10.0.0.2 00:23:21.362 Discovery Log Entry 1 00:23:21.362 ---------------------- 00:23:21.362 Transport Type: 3 (TCP) 00:23:21.362 Address Family: 1 (IPv4) 00:23:21.362 Subsystem Type: 2 (NVM Subsystem) 00:23:21.362 Entry Flags: 00:23:21.362 Duplicate Returned Information: 0 00:23:21.362 Explicit Persistent Connection Support for Discovery: 0 00:23:21.362 Transport Requirements: 00:23:21.362 Secure Channel: Not Required 00:23:21.362 Port ID: 0 (0x0000) 00:23:21.362 Controller ID: 65535 (0xffff) 00:23:21.362 Admin Max SQ Size: 128 00:23:21.362 Transport Service Identifier: 4420 00:23:21.362 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:21.362 Transport Address: 10.0.0.2 [2024-11-27 21:13:17.359736] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:21.362 [2024-11-27 21:13:17.359767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.362 [2024-11-27 21:13:17.359781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.362 [2024-11-27 21:13:17.359790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.362 [2024-11-27 21:13:17.359799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.362 [2024-11-27 21:13:17.359813] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.359820] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.359826] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.362 [2024-11-27 21:13:17.359838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.362 [2024-11-27 21:13:17.359879] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.362 [2024-11-27 21:13:17.360017] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.362 [2024-11-27 21:13:17.360033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.362 [2024-11-27 21:13:17.360039] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.362 [2024-11-27 21:13:17.360061] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360068] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360074] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.362 [2024-11-27 21:13:17.360085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.362 [2024-11-27 21:13:17.360114] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.362 [2024-11-27 21:13:17.360234] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.362 [2024-11-27 21:13:17.360250] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.362 [2024-11-27 21:13:17.360257] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.362 [2024-11-27 21:13:17.360278] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:21.362 [2024-11-27 21:13:17.360287] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:21.362 [2024-11-27 21:13:17.360303] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360321] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.362 [2024-11-27 21:13:17.360332] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.362 [2024-11-27 21:13:17.360354] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.362 [2024-11-27 21:13:17.360457] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.362 [2024-11-27 21:13:17.360476] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.362 [2024-11-27 21:13:17.360484] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360490] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.362 [2024-11-27 21:13:17.360511] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360536] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.362 [2024-11-27 21:13:17.360548] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.362 [2024-11-27 21:13:17.360570] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.362 [2024-11-27 21:13:17.360668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.362 [2024-11-27 21:13:17.360683] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.362 [2024-11-27 21:13:17.360693] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360701] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.362 [2024-11-27 21:13:17.360719] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360728] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.362 [2024-11-27 21:13:17.360734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.360747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.360770] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.360860] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.360875] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.360882] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.360892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.360911] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.360920] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.360926] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.360937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.360961] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.361055] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.361070] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.361077] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361083] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.361103] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361113] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.361130] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.361151] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.361242] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.361257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.361268] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361279] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.361298] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361313] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.361326] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.361349] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.361438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.361453] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.361460] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361469] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.361489] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361497] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361503] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.361514] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.361548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.361644] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.361659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.361666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.361692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361702] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361709] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.361719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.361741] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.361836] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.361851] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.361858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361864] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.361884] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361894] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.361900] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.361911] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.361932] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.362029] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.362044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.362055] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362062] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.362082] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362092] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362099] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.362109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.362131] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.362230] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.362245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.362251] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362258] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.362277] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362288] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362294] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.362305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.362326] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.362431] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.362446] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.362453] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.362479] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362496] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.362507] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.362535] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.362626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.362645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.362653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.362679] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362690] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362696] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.362707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.362729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.362815] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.362830] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.362837] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362850] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.362871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.362885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.363 [2024-11-27 21:13:17.362899] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.363 [2024-11-27 21:13:17.362922] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.363 [2024-11-27 21:13:17.363026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.363 [2024-11-27 21:13:17.363042] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.363 [2024-11-27 21:13:17.363048] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.363055] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.363 [2024-11-27 21:13:17.363074] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.363 [2024-11-27 21:13:17.363084] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.364 [2024-11-27 21:13:17.363101] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.363123] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.364 [2024-11-27 21:13:17.363218] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.363233] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.363240] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363249] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.364 [2024-11-27 21:13:17.363269] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363277] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.364 [2024-11-27 21:13:17.363294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.363319] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.364 [2024-11-27 21:13:17.363414] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.363429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.363435] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.364 [2024-11-27 21:13:17.363463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363472] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.363479] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.364 [2024-11-27 21:13:17.363489] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.363514] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.364 [2024-11-27 21:13:17.367554] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.367570] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.367576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.367582] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.364 [2024-11-27 21:13:17.367606] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.367618] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.367624] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x17d3e10) 00:23:21.364 [2024-11-27 21:13:17.367634] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.367657] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1853f50, cid 3, qid 0 00:23:21.364 [2024-11-27 21:13:17.367770] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.367786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.367793] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.367803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1853f50) on tqpair=0x17d3e10 00:23:21.364 [2024-11-27 21:13:17.367820] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:23:21.364 00:23:21.364 21:13:17 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:21.364 [2024-11-27 21:13:17.401344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:21.364 [2024-11-27 21:13:17.401385] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4060675 ] 00:23:21.364 EAL: No free 2048 kB hugepages reported on node 1 00:23:21.364 [2024-11-27 21:13:17.433260] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:21.364 [2024-11-27 21:13:17.433308] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:21.364 [2024-11-27 21:13:17.433318] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:21.364 [2024-11-27 21:13:17.433332] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:21.364 [2024-11-27 21:13:17.433344] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:21.364 [2024-11-27 21:13:17.436566] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:21.364 [2024-11-27 21:13:17.436609] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2440e10 0 00:23:21.364 [2024-11-27 21:13:17.444558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:21.364 [2024-11-27 21:13:17.444577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:21.364 [2024-11-27 21:13:17.444584] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:21.364 [2024-11-27 21:13:17.444590] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:21.364 [2024-11-27 21:13:17.444642] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.444654] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.444661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.364 [2024-11-27 21:13:17.444675] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:21.364 [2024-11-27 21:13:17.444701] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.364 [2024-11-27 21:13:17.452545] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.452563] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.452581] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452588] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.364 [2024-11-27 21:13:17.452607] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:21.364 [2024-11-27 21:13:17.452633] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:21.364 [2024-11-27 21:13:17.452642] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:21.364 [2024-11-27 21:13:17.452659] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452668] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452674] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.364 [2024-11-27 21:13:17.452686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.452711] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.364 [2024-11-27 21:13:17.452819] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.452831] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.452838] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452845] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.364 [2024-11-27 21:13:17.452855] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:21.364 [2024-11-27 21:13:17.452867] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:21.364 [2024-11-27 21:13:17.452879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452887] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.452893] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.364 [2024-11-27 21:13:17.452905] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.452926] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.364 [2024-11-27 21:13:17.453014] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.453026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.453033] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453039] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.364 [2024-11-27 21:13:17.453049] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:21.364 [2024-11-27 21:13:17.453061] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:21.364 [2024-11-27 21:13:17.453074] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453082] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453089] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.364 [2024-11-27 21:13:17.453100] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.453122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.364 [2024-11-27 21:13:17.453211] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.364 [2024-11-27 21:13:17.453223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.364 [2024-11-27 21:13:17.453233] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453240] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.364 [2024-11-27 21:13:17.453250] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:21.364 [2024-11-27 21:13:17.453266] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.364 [2024-11-27 21:13:17.453281] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.364 [2024-11-27 21:13:17.453291] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.364 [2024-11-27 21:13:17.453312] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.364 [2024-11-27 21:13:17.453403] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.453415] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.453421] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453428] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.453436] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:21.365 [2024-11-27 21:13:17.453445] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:21.365 [2024-11-27 21:13:17.453457] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:21.365 [2024-11-27 21:13:17.453566] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:21.365 [2024-11-27 21:13:17.453576] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:21.365 [2024-11-27 21:13:17.453589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453596] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453603] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.453613] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.365 [2024-11-27 21:13:17.453635] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.365 [2024-11-27 21:13:17.453730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.453745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.453752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453759] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.453769] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:21.365 [2024-11-27 21:13:17.453785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.453810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.365 [2024-11-27 21:13:17.453832] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.365 [2024-11-27 21:13:17.453915] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.453927] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.453938] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.453946] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.453955] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:21.365 [2024-11-27 21:13:17.453963] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.453976] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:21.365 [2024-11-27 21:13:17.453989] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.454003] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.454010] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.454016] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.454027] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.365 [2024-11-27 21:13:17.454048] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.365 [2024-11-27 21:13:17.454181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.365 [2024-11-27 21:13:17.454196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.365 [2024-11-27 21:13:17.454203] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.454209] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=4096, cccid=0 00:23:21.365 [2024-11-27 21:13:17.454217] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c0b30) on tqpair(0x2440e10): expected_datao=0, payload_size=4096 00:23:21.365 [2024-11-27 21:13:17.454235] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.454244] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.494640] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.494648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494655] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.494667] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:21.365 [2024-11-27 21:13:17.494676] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:21.365 [2024-11-27 21:13:17.494683] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:21.365 [2024-11-27 21:13:17.494690] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:21.365 [2024-11-27 21:13:17.494697] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:21.365 [2024-11-27 21:13:17.494705] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.494724] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.494737] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494745] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494751] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.494766] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:21.365 [2024-11-27 21:13:17.494791] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.365 [2024-11-27 21:13:17.494881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.494893] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.494900] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494906] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0b30) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.494917] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494925] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494931] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.494941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.365 [2024-11-27 21:13:17.494951] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494957] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.494972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.365 [2024-11-27 21:13:17.494982] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494988] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.494994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.495003] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.365 [2024-11-27 21:13:17.495013] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.495019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.495025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.495034] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.365 [2024-11-27 21:13:17.495043] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.495061] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.495073] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.495080] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.495086] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.365 [2024-11-27 21:13:17.495097] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.365 [2024-11-27 21:13:17.495134] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0b30, cid 0, qid 0 00:23:21.365 [2024-11-27 21:13:17.495146] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0c90, cid 1, qid 0 00:23:21.365 [2024-11-27 21:13:17.495153] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0df0, cid 2, qid 0 00:23:21.365 [2024-11-27 21:13:17.495160] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.365 [2024-11-27 21:13:17.495167] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.365 [2024-11-27 21:13:17.495363] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.365 [2024-11-27 21:13:17.495380] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.365 [2024-11-27 21:13:17.495387] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.365 [2024-11-27 21:13:17.495394] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.365 [2024-11-27 21:13:17.495403] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:21.365 [2024-11-27 21:13:17.495411] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.495424] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:21.365 [2024-11-27 21:13:17.495440] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.495451] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495458] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495465] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.495475] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:21.366 [2024-11-27 21:13:17.495497] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.366 [2024-11-27 21:13:17.495635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.366 [2024-11-27 21:13:17.495650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.366 [2024-11-27 21:13:17.495657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495663] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.366 [2024-11-27 21:13:17.495731] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.495750] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.495765] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495772] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495778] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.495789] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.366 [2024-11-27 21:13:17.495810] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.366 [2024-11-27 21:13:17.495950] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.366 [2024-11-27 21:13:17.495962] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.366 [2024-11-27 21:13:17.495969] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.495975] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=4096, cccid=4 00:23:21.366 [2024-11-27 21:13:17.495982] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c10b0) on tqpair(0x2440e10): expected_datao=0, payload_size=4096 00:23:21.366 [2024-11-27 21:13:17.495993] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496001] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.366 [2024-11-27 21:13:17.496022] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.366 [2024-11-27 21:13:17.496028] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496034] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.366 [2024-11-27 21:13:17.496061] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:21.366 [2024-11-27 21:13:17.496083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.496101] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.496114] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496121] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496127] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.496138] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.366 [2024-11-27 21:13:17.496159] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.366 [2024-11-27 21:13:17.496271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.366 [2024-11-27 21:13:17.496283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.366 [2024-11-27 21:13:17.496290] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496296] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=4096, cccid=4 00:23:21.366 [2024-11-27 21:13:17.496303] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c10b0) on tqpair(0x2440e10): expected_datao=0, payload_size=4096 00:23:21.366 [2024-11-27 21:13:17.496314] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496321] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496333] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.366 [2024-11-27 21:13:17.496342] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.366 [2024-11-27 21:13:17.496348] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496355] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.366 [2024-11-27 21:13:17.496380] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.496400] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.496413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496421] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.496427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.496437] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.366 [2024-11-27 21:13:17.496458] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.366 [2024-11-27 21:13:17.500538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.366 [2024-11-27 21:13:17.500554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.366 [2024-11-27 21:13:17.500561] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500567] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=4096, cccid=4 00:23:21.366 [2024-11-27 21:13:17.500574] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c10b0) on tqpair(0x2440e10): expected_datao=0, payload_size=4096 00:23:21.366 [2024-11-27 21:13:17.500585] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500591] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500603] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.366 [2024-11-27 21:13:17.500613] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.366 [2024-11-27 21:13:17.500619] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500625] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.366 [2024-11-27 21:13:17.500640] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500655] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500686] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500697] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500706] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500715] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:21.366 [2024-11-27 21:13:17.500723] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:21.366 [2024-11-27 21:13:17.500731] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:21.366 [2024-11-27 21:13:17.500750] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500758] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500765] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.500776] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.366 [2024-11-27 21:13:17.500787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500793] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.366 [2024-11-27 21:13:17.500800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2440e10) 00:23:21.366 [2024-11-27 21:13:17.500824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.366 [2024-11-27 21:13:17.500850] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.366 [2024-11-27 21:13:17.500862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1210, cid 5, qid 0 00:23:21.366 [2024-11-27 21:13:17.501019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.366 [2024-11-27 21:13:17.501034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.366 [2024-11-27 21:13:17.501041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501047] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.501059] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.501068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.501074] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1210) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.501097] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501106] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501123] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501148] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1210, cid 5, qid 0 00:23:21.367 [2024-11-27 21:13:17.501242] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.501257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.501263] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501270] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1210) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.501286] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501295] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501301] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501312] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1210, cid 5, qid 0 00:23:21.367 [2024-11-27 21:13:17.501424] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.501438] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.501445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1210) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.501468] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501476] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501483] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501493] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501514] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1210, cid 5, qid 0 00:23:21.367 [2024-11-27 21:13:17.501614] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.501627] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.501634] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501640] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1210) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.501660] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501669] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501676] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501698] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501705] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501712] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501733] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501740] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501746] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501772] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501780] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.501787] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2440e10) 00:23:21.367 [2024-11-27 21:13:17.501796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.367 [2024-11-27 21:13:17.501819] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1210, cid 5, qid 0 00:23:21.367 [2024-11-27 21:13:17.501830] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c10b0, cid 4, qid 0 00:23:21.367 [2024-11-27 21:13:17.501838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c1370, cid 6, qid 0 00:23:21.367 [2024-11-27 21:13:17.501845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c14d0, cid 7, qid 0 00:23:21.367 [2024-11-27 21:13:17.502017] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.367 [2024-11-27 21:13:17.502029] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.367 [2024-11-27 21:13:17.502036] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502042] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=8192, cccid=5 00:23:21.367 [2024-11-27 21:13:17.502050] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c1210) on tqpair(0x2440e10): expected_datao=0, payload_size=8192 00:23:21.367 [2024-11-27 21:13:17.502067] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502076] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502089] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.367 [2024-11-27 21:13:17.502098] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.367 [2024-11-27 21:13:17.502105] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502111] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=512, cccid=4 00:23:21.367 [2024-11-27 21:13:17.502118] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c10b0) on tqpair(0x2440e10): expected_datao=0, payload_size=512 00:23:21.367 [2024-11-27 21:13:17.502128] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502134] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502143] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.367 [2024-11-27 21:13:17.502151] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.367 [2024-11-27 21:13:17.502157] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502163] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=512, cccid=6 00:23:21.367 [2024-11-27 21:13:17.502171] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c1370) on tqpair(0x2440e10): expected_datao=0, payload_size=512 00:23:21.367 [2024-11-27 21:13:17.502180] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502187] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502195] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.367 [2024-11-27 21:13:17.502204] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.367 [2024-11-27 21:13:17.502210] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502217] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2440e10): datao=0, datal=4096, cccid=7 00:23:21.367 [2024-11-27 21:13:17.502224] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x24c14d0) on tqpair(0x2440e10): expected_datao=0, payload_size=4096 00:23:21.367 [2024-11-27 21:13:17.502234] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502245] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502257] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.502266] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.502273] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502279] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1210) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.502300] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.502311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.502317] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502324] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c10b0) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.502339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.502349] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.502356] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502380] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c1370) on tqpair=0x2440e10 00:23:21.367 [2024-11-27 21:13:17.502392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.367 [2024-11-27 21:13:17.502401] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.367 [2024-11-27 21:13:17.502407] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.367 [2024-11-27 21:13:17.502413] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c14d0) on tqpair=0x2440e10 00:23:21.367 ===================================================== 00:23:21.367 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:21.367 ===================================================== 00:23:21.367 Controller Capabilities/Features 00:23:21.367 ================================ 00:23:21.367 Vendor ID: 8086 00:23:21.367 Subsystem Vendor ID: 8086 00:23:21.367 Serial Number: SPDK00000000000001 00:23:21.367 Model Number: SPDK bdev Controller 00:23:21.367 Firmware Version: 24.01.1 00:23:21.367 Recommended Arb Burst: 6 00:23:21.367 IEEE OUI Identifier: e4 d2 5c 00:23:21.367 Multi-path I/O 00:23:21.367 May have multiple subsystem ports: Yes 00:23:21.367 May have multiple controllers: Yes 00:23:21.368 Associated with SR-IOV VF: No 00:23:21.368 Max Data Transfer Size: 131072 00:23:21.368 Max Number of Namespaces: 32 00:23:21.368 Max Number of I/O Queues: 127 00:23:21.368 NVMe Specification Version (VS): 1.3 00:23:21.368 NVMe Specification Version (Identify): 1.3 00:23:21.368 Maximum Queue Entries: 128 00:23:21.368 Contiguous Queues Required: Yes 00:23:21.368 Arbitration Mechanisms Supported 00:23:21.368 Weighted Round Robin: Not Supported 00:23:21.368 Vendor Specific: Not Supported 00:23:21.368 Reset Timeout: 15000 ms 00:23:21.368 Doorbell Stride: 4 bytes 00:23:21.368 NVM Subsystem Reset: Not Supported 00:23:21.368 Command Sets Supported 00:23:21.368 NVM Command Set: Supported 00:23:21.368 Boot Partition: Not Supported 00:23:21.368 Memory Page Size Minimum: 4096 bytes 00:23:21.368 Memory Page Size Maximum: 4096 bytes 00:23:21.368 Persistent Memory Region: Not Supported 00:23:21.368 Optional Asynchronous Events Supported 00:23:21.368 Namespace Attribute Notices: Supported 00:23:21.368 Firmware Activation Notices: Not Supported 00:23:21.368 ANA Change Notices: Not Supported 00:23:21.368 PLE Aggregate Log Change Notices: Not Supported 00:23:21.368 LBA Status Info Alert Notices: Not Supported 00:23:21.368 EGE Aggregate Log Change Notices: Not Supported 00:23:21.368 Normal NVM Subsystem Shutdown event: Not Supported 00:23:21.368 Zone Descriptor Change Notices: Not Supported 00:23:21.368 Discovery Log Change Notices: Not Supported 00:23:21.368 Controller Attributes 00:23:21.368 128-bit Host Identifier: Supported 00:23:21.368 Non-Operational Permissive Mode: Not Supported 00:23:21.368 NVM Sets: Not Supported 00:23:21.368 Read Recovery Levels: Not Supported 00:23:21.368 Endurance Groups: Not Supported 00:23:21.368 Predictable Latency Mode: Not Supported 00:23:21.368 Traffic Based Keep ALive: Not Supported 00:23:21.368 Namespace Granularity: Not Supported 00:23:21.368 SQ Associations: Not Supported 00:23:21.368 UUID List: Not Supported 00:23:21.368 Multi-Domain Subsystem: Not Supported 00:23:21.368 Fixed Capacity Management: Not Supported 00:23:21.368 Variable Capacity Management: Not Supported 00:23:21.368 Delete Endurance Group: Not Supported 00:23:21.368 Delete NVM Set: Not Supported 00:23:21.368 Extended LBA Formats Supported: Not Supported 00:23:21.368 Flexible Data Placement Supported: Not Supported 00:23:21.368 00:23:21.368 Controller Memory Buffer Support 00:23:21.368 ================================ 00:23:21.368 Supported: No 00:23:21.368 00:23:21.368 Persistent Memory Region Support 00:23:21.368 ================================ 00:23:21.368 Supported: No 00:23:21.368 00:23:21.368 Admin Command Set Attributes 00:23:21.368 ============================ 00:23:21.368 Security Send/Receive: Not Supported 00:23:21.368 Format NVM: Not Supported 00:23:21.368 Firmware Activate/Download: Not Supported 00:23:21.368 Namespace Management: Not Supported 00:23:21.368 Device Self-Test: Not Supported 00:23:21.368 Directives: Not Supported 00:23:21.368 NVMe-MI: Not Supported 00:23:21.368 Virtualization Management: Not Supported 00:23:21.368 Doorbell Buffer Config: Not Supported 00:23:21.368 Get LBA Status Capability: Not Supported 00:23:21.368 Command & Feature Lockdown Capability: Not Supported 00:23:21.368 Abort Command Limit: 4 00:23:21.368 Async Event Request Limit: 4 00:23:21.368 Number of Firmware Slots: N/A 00:23:21.368 Firmware Slot 1 Read-Only: N/A 00:23:21.368 Firmware Activation Without Reset: N/A 00:23:21.368 Multiple Update Detection Support: N/A 00:23:21.368 Firmware Update Granularity: No Information Provided 00:23:21.368 Per-Namespace SMART Log: No 00:23:21.368 Asymmetric Namespace Access Log Page: Not Supported 00:23:21.368 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:21.368 Command Effects Log Page: Supported 00:23:21.368 Get Log Page Extended Data: Supported 00:23:21.368 Telemetry Log Pages: Not Supported 00:23:21.368 Persistent Event Log Pages: Not Supported 00:23:21.368 Supported Log Pages Log Page: May Support 00:23:21.368 Commands Supported & Effects Log Page: Not Supported 00:23:21.368 Feature Identifiers & Effects Log Page:May Support 00:23:21.368 NVMe-MI Commands & Effects Log Page: May Support 00:23:21.368 Data Area 4 for Telemetry Log: Not Supported 00:23:21.368 Error Log Page Entries Supported: 128 00:23:21.368 Keep Alive: Supported 00:23:21.368 Keep Alive Granularity: 10000 ms 00:23:21.368 00:23:21.368 NVM Command Set Attributes 00:23:21.368 ========================== 00:23:21.368 Submission Queue Entry Size 00:23:21.368 Max: 64 00:23:21.368 Min: 64 00:23:21.368 Completion Queue Entry Size 00:23:21.368 Max: 16 00:23:21.368 Min: 16 00:23:21.368 Number of Namespaces: 32 00:23:21.368 Compare Command: Supported 00:23:21.368 Write Uncorrectable Command: Not Supported 00:23:21.368 Dataset Management Command: Supported 00:23:21.368 Write Zeroes Command: Supported 00:23:21.368 Set Features Save Field: Not Supported 00:23:21.368 Reservations: Supported 00:23:21.368 Timestamp: Not Supported 00:23:21.368 Copy: Supported 00:23:21.368 Volatile Write Cache: Present 00:23:21.368 Atomic Write Unit (Normal): 1 00:23:21.368 Atomic Write Unit (PFail): 1 00:23:21.368 Atomic Compare & Write Unit: 1 00:23:21.368 Fused Compare & Write: Supported 00:23:21.368 Scatter-Gather List 00:23:21.368 SGL Command Set: Supported 00:23:21.368 SGL Keyed: Supported 00:23:21.368 SGL Bit Bucket Descriptor: Not Supported 00:23:21.368 SGL Metadata Pointer: Not Supported 00:23:21.368 Oversized SGL: Not Supported 00:23:21.368 SGL Metadata Address: Not Supported 00:23:21.368 SGL Offset: Supported 00:23:21.368 Transport SGL Data Block: Not Supported 00:23:21.368 Replay Protected Memory Block: Not Supported 00:23:21.368 00:23:21.368 Firmware Slot Information 00:23:21.368 ========================= 00:23:21.368 Active slot: 1 00:23:21.368 Slot 1 Firmware Revision: 24.01.1 00:23:21.368 00:23:21.368 00:23:21.368 Commands Supported and Effects 00:23:21.368 ============================== 00:23:21.368 Admin Commands 00:23:21.368 -------------- 00:23:21.368 Get Log Page (02h): Supported 00:23:21.368 Identify (06h): Supported 00:23:21.368 Abort (08h): Supported 00:23:21.368 Set Features (09h): Supported 00:23:21.368 Get Features (0Ah): Supported 00:23:21.368 Asynchronous Event Request (0Ch): Supported 00:23:21.368 Keep Alive (18h): Supported 00:23:21.368 I/O Commands 00:23:21.368 ------------ 00:23:21.368 Flush (00h): Supported LBA-Change 00:23:21.368 Write (01h): Supported LBA-Change 00:23:21.368 Read (02h): Supported 00:23:21.368 Compare (05h): Supported 00:23:21.368 Write Zeroes (08h): Supported LBA-Change 00:23:21.368 Dataset Management (09h): Supported LBA-Change 00:23:21.368 Copy (19h): Supported LBA-Change 00:23:21.368 Unknown (79h): Supported LBA-Change 00:23:21.368 Unknown (7Ah): Supported 00:23:21.368 00:23:21.368 Error Log 00:23:21.368 ========= 00:23:21.368 00:23:21.368 Arbitration 00:23:21.368 =========== 00:23:21.368 Arbitration Burst: 1 00:23:21.368 00:23:21.368 Power Management 00:23:21.368 ================ 00:23:21.368 Number of Power States: 1 00:23:21.368 Current Power State: Power State #0 00:23:21.368 Power State #0: 00:23:21.368 Max Power: 0.00 W 00:23:21.368 Non-Operational State: Operational 00:23:21.368 Entry Latency: Not Reported 00:23:21.368 Exit Latency: Not Reported 00:23:21.368 Relative Read Throughput: 0 00:23:21.368 Relative Read Latency: 0 00:23:21.368 Relative Write Throughput: 0 00:23:21.368 Relative Write Latency: 0 00:23:21.368 Idle Power: Not Reported 00:23:21.368 Active Power: Not Reported 00:23:21.368 Non-Operational Permissive Mode: Not Supported 00:23:21.368 00:23:21.368 Health Information 00:23:21.368 ================== 00:23:21.368 Critical Warnings: 00:23:21.368 Available Spare Space: OK 00:23:21.368 Temperature: OK 00:23:21.368 Device Reliability: OK 00:23:21.368 Read Only: No 00:23:21.368 Volatile Memory Backup: OK 00:23:21.368 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:21.368 Temperature Threshold: [2024-11-27 21:13:17.502586] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.368 [2024-11-27 21:13:17.502598] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.368 [2024-11-27 21:13:17.502605] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2440e10) 00:23:21.368 [2024-11-27 21:13:17.502615] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.368 [2024-11-27 21:13:17.502638] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c14d0, cid 7, qid 0 00:23:21.368 [2024-11-27 21:13:17.502749] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.368 [2024-11-27 21:13:17.502762] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.368 [2024-11-27 21:13:17.502768] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.502775] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c14d0) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.502816] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:21.369 [2024-11-27 21:13:17.502837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.369 [2024-11-27 21:13:17.502848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.369 [2024-11-27 21:13:17.502858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.369 [2024-11-27 21:13:17.502867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.369 [2024-11-27 21:13:17.502879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.502886] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.502893] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.502903] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.502925] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503035] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503048] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503054] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503061] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.503073] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503080] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503087] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.503097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.503122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503226] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503240] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503247] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503253] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.503262] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:21.369 [2024-11-27 21:13:17.503269] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:21.369 [2024-11-27 21:13:17.503285] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503294] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503300] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.503311] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.503331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503444] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.503468] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503477] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503483] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.503493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.503513] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503627] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503634] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503640] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.503658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503672] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.503687] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.503709] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503799] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503813] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503820] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503826] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.503844] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.503859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.503869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.503889] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.503976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.503990] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.503997] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504003] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.504020] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504029] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504035] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.504046] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.504069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.504151] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.504162] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.504169] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504175] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.504192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.504217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.504237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.504320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.504331] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.504338] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504344] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.504361] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504369] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504376] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.504386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.504410] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.504490] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.504502] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.504508] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.504515] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.508543] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.508568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.508575] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2440e10) 00:23:21.369 [2024-11-27 21:13:17.508586] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.369 [2024-11-27 21:13:17.508608] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x24c0f50, cid 3, qid 0 00:23:21.369 [2024-11-27 21:13:17.508705] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.369 [2024-11-27 21:13:17.508717] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.369 [2024-11-27 21:13:17.508724] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.369 [2024-11-27 21:13:17.508730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x24c0f50) on tqpair=0x2440e10 00:23:21.369 [2024-11-27 21:13:17.508744] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:21.369 0 Kelvin (-273 Celsius) 00:23:21.369 Available Spare: 0% 00:23:21.369 Available Spare Threshold: 0% 00:23:21.369 Life Percentage Used: 0% 00:23:21.369 Data Units Read: 0 00:23:21.369 Data Units Written: 0 00:23:21.370 Host Read Commands: 0 00:23:21.370 Host Write Commands: 0 00:23:21.370 Controller Busy Time: 0 minutes 00:23:21.370 Power Cycles: 0 00:23:21.370 Power On Hours: 0 hours 00:23:21.370 Unsafe Shutdowns: 0 00:23:21.370 Unrecoverable Media Errors: 0 00:23:21.370 Lifetime Error Log Entries: 0 00:23:21.370 Warning Temperature Time: 0 minutes 00:23:21.370 Critical Temperature Time: 0 minutes 00:23:21.370 00:23:21.370 Number of Queues 00:23:21.370 ================ 00:23:21.370 Number of I/O Submission Queues: 127 00:23:21.370 Number of I/O Completion Queues: 127 00:23:21.370 00:23:21.370 Active Namespaces 00:23:21.370 ================= 00:23:21.370 Namespace ID:1 00:23:21.370 Error Recovery Timeout: Unlimited 00:23:21.370 Command Set Identifier: NVM (00h) 00:23:21.370 Deallocate: Supported 00:23:21.370 Deallocated/Unwritten Error: Not Supported 00:23:21.370 Deallocated Read Value: Unknown 00:23:21.370 Deallocate in Write Zeroes: Not Supported 00:23:21.370 Deallocated Guard Field: 0xFFFF 00:23:21.370 Flush: Supported 00:23:21.370 Reservation: Supported 00:23:21.370 Namespace Sharing Capabilities: Multiple Controllers 00:23:21.370 Size (in LBAs): 131072 (0GiB) 00:23:21.370 Capacity (in LBAs): 131072 (0GiB) 00:23:21.370 Utilization (in LBAs): 131072 (0GiB) 00:23:21.370 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:21.370 EUI64: ABCDEF0123456789 00:23:21.370 UUID: 0e55b12a-995b-4071-8718-5225ef465390 00:23:21.370 Thin Provisioning: Not Supported 00:23:21.370 Per-NS Atomic Units: Yes 00:23:21.370 Atomic Boundary Size (Normal): 0 00:23:21.370 Atomic Boundary Size (PFail): 0 00:23:21.370 Atomic Boundary Offset: 0 00:23:21.370 Maximum Single Source Range Length: 65535 00:23:21.370 Maximum Copy Length: 65535 00:23:21.370 Maximum Source Range Count: 1 00:23:21.370 NGUID/EUI64 Never Reused: No 00:23:21.370 Namespace Write Protected: No 00:23:21.370 Number of LBA Formats: 1 00:23:21.370 Current LBA Format: LBA Format #00 00:23:21.370 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:21.370 00:23:21.370 21:13:17 -- host/identify.sh@51 -- # sync 00:23:21.370 21:13:17 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:21.370 21:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.370 21:13:17 -- common/autotest_common.sh@10 -- # set +x 00:23:21.370 21:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.370 21:13:17 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:21.370 21:13:17 -- host/identify.sh@56 -- # nvmftestfini 00:23:21.370 21:13:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:21.370 21:13:17 -- nvmf/common.sh@116 -- # sync 00:23:21.370 21:13:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:21.370 21:13:17 -- nvmf/common.sh@119 -- # set +e 00:23:21.370 21:13:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:21.370 21:13:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:21.370 rmmod nvme_tcp 00:23:21.370 rmmod nvme_fabrics 00:23:21.370 rmmod nvme_keyring 00:23:21.370 21:13:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:21.370 21:13:17 -- nvmf/common.sh@123 -- # set -e 00:23:21.370 21:13:17 -- nvmf/common.sh@124 -- # return 0 00:23:21.370 21:13:17 -- nvmf/common.sh@477 -- # '[' -n 4060508 ']' 00:23:21.370 21:13:17 -- nvmf/common.sh@478 -- # killprocess 4060508 00:23:21.370 21:13:17 -- common/autotest_common.sh@936 -- # '[' -z 4060508 ']' 00:23:21.370 21:13:17 -- common/autotest_common.sh@940 -- # kill -0 4060508 00:23:21.370 21:13:17 -- common/autotest_common.sh@941 -- # uname 00:23:21.370 21:13:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:21.370 21:13:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4060508 00:23:21.628 21:13:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:21.628 21:13:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:21.629 21:13:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4060508' 00:23:21.629 killing process with pid 4060508 00:23:21.629 21:13:17 -- common/autotest_common.sh@955 -- # kill 4060508 00:23:21.629 [2024-11-27 21:13:17.617853] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:21.629 21:13:17 -- common/autotest_common.sh@960 -- # wait 4060508 00:23:21.887 21:13:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:21.888 21:13:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:21.888 21:13:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:21.888 21:13:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:21.888 21:13:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:21.888 21:13:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.888 21:13:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.888 21:13:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.791 21:13:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:23.791 00:23:23.791 real 0m6.231s 00:23:23.791 user 0m7.311s 00:23:23.791 sys 0m1.928s 00:23:23.791 21:13:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:23.791 21:13:19 -- common/autotest_common.sh@10 -- # set +x 00:23:23.791 ************************************ 00:23:23.791 END TEST nvmf_identify 00:23:23.791 ************************************ 00:23:23.791 21:13:19 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:23.791 21:13:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:23.791 21:13:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:23.791 21:13:19 -- common/autotest_common.sh@10 -- # set +x 00:23:23.791 ************************************ 00:23:23.791 START TEST nvmf_perf 00:23:23.791 ************************************ 00:23:23.791 21:13:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:23.791 * Looking for test storage... 00:23:23.791 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:23.791 21:13:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:23.791 21:13:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:23.791 21:13:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:24.050 21:13:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:24.050 21:13:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:24.050 21:13:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:24.050 21:13:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:24.050 21:13:20 -- scripts/common.sh@335 -- # IFS=.-: 00:23:24.050 21:13:20 -- scripts/common.sh@335 -- # read -ra ver1 00:23:24.050 21:13:20 -- scripts/common.sh@336 -- # IFS=.-: 00:23:24.050 21:13:20 -- scripts/common.sh@336 -- # read -ra ver2 00:23:24.050 21:13:20 -- scripts/common.sh@337 -- # local 'op=<' 00:23:24.050 21:13:20 -- scripts/common.sh@339 -- # ver1_l=2 00:23:24.050 21:13:20 -- scripts/common.sh@340 -- # ver2_l=1 00:23:24.050 21:13:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:24.050 21:13:20 -- scripts/common.sh@343 -- # case "$op" in 00:23:24.050 21:13:20 -- scripts/common.sh@344 -- # : 1 00:23:24.050 21:13:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:24.050 21:13:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:24.050 21:13:20 -- scripts/common.sh@364 -- # decimal 1 00:23:24.050 21:13:20 -- scripts/common.sh@352 -- # local d=1 00:23:24.050 21:13:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:24.050 21:13:20 -- scripts/common.sh@354 -- # echo 1 00:23:24.050 21:13:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:24.050 21:13:20 -- scripts/common.sh@365 -- # decimal 2 00:23:24.050 21:13:20 -- scripts/common.sh@352 -- # local d=2 00:23:24.050 21:13:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:24.050 21:13:20 -- scripts/common.sh@354 -- # echo 2 00:23:24.050 21:13:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:24.050 21:13:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:24.050 21:13:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:24.050 21:13:20 -- scripts/common.sh@367 -- # return 0 00:23:24.050 21:13:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:24.050 21:13:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:24.050 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.050 --rc genhtml_branch_coverage=1 00:23:24.050 --rc genhtml_function_coverage=1 00:23:24.050 --rc genhtml_legend=1 00:23:24.050 --rc geninfo_all_blocks=1 00:23:24.050 --rc geninfo_unexecuted_blocks=1 00:23:24.050 00:23:24.050 ' 00:23:24.050 21:13:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:24.050 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.050 --rc genhtml_branch_coverage=1 00:23:24.050 --rc genhtml_function_coverage=1 00:23:24.050 --rc genhtml_legend=1 00:23:24.050 --rc geninfo_all_blocks=1 00:23:24.050 --rc geninfo_unexecuted_blocks=1 00:23:24.050 00:23:24.050 ' 00:23:24.050 21:13:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:24.050 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.050 --rc genhtml_branch_coverage=1 00:23:24.050 --rc genhtml_function_coverage=1 00:23:24.050 --rc genhtml_legend=1 00:23:24.050 --rc geninfo_all_blocks=1 00:23:24.050 --rc geninfo_unexecuted_blocks=1 00:23:24.050 00:23:24.050 ' 00:23:24.050 21:13:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:24.050 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:24.050 --rc genhtml_branch_coverage=1 00:23:24.050 --rc genhtml_function_coverage=1 00:23:24.050 --rc genhtml_legend=1 00:23:24.050 --rc geninfo_all_blocks=1 00:23:24.050 --rc geninfo_unexecuted_blocks=1 00:23:24.050 00:23:24.050 ' 00:23:24.050 21:13:20 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:24.050 21:13:20 -- nvmf/common.sh@7 -- # uname -s 00:23:24.050 21:13:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:24.051 21:13:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:24.051 21:13:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:24.051 21:13:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:24.051 21:13:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:24.051 21:13:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:24.051 21:13:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:24.051 21:13:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:24.051 21:13:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:24.051 21:13:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:24.051 21:13:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:24.051 21:13:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:24.051 21:13:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:24.051 21:13:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:24.051 21:13:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:24.051 21:13:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:24.051 21:13:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:24.051 21:13:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:24.051 21:13:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:24.051 21:13:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.051 21:13:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.051 21:13:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.051 21:13:20 -- paths/export.sh@5 -- # export PATH 00:23:24.051 21:13:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:24.051 21:13:20 -- nvmf/common.sh@46 -- # : 0 00:23:24.051 21:13:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:24.051 21:13:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:24.051 21:13:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:24.051 21:13:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:24.051 21:13:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:24.051 21:13:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:24.051 21:13:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:24.051 21:13:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:24.051 21:13:20 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:24.051 21:13:20 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:24.051 21:13:20 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:24.051 21:13:20 -- host/perf.sh@17 -- # nvmftestinit 00:23:24.051 21:13:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:24.051 21:13:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:24.051 21:13:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:24.051 21:13:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:24.051 21:13:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:24.051 21:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:24.051 21:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:24.051 21:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:24.051 21:13:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:24.051 21:13:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:24.051 21:13:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:24.051 21:13:20 -- common/autotest_common.sh@10 -- # set +x 00:23:26.584 21:13:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:26.584 21:13:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:26.584 21:13:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:26.584 21:13:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:26.584 21:13:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:26.584 21:13:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:26.584 21:13:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:26.584 21:13:22 -- nvmf/common.sh@294 -- # net_devs=() 00:23:26.584 21:13:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:26.584 21:13:22 -- nvmf/common.sh@295 -- # e810=() 00:23:26.584 21:13:22 -- nvmf/common.sh@295 -- # local -ga e810 00:23:26.584 21:13:22 -- nvmf/common.sh@296 -- # x722=() 00:23:26.584 21:13:22 -- nvmf/common.sh@296 -- # local -ga x722 00:23:26.584 21:13:22 -- nvmf/common.sh@297 -- # mlx=() 00:23:26.584 21:13:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:26.584 21:13:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:26.584 21:13:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:26.584 21:13:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:26.584 21:13:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:26.584 21:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:26.584 21:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:26.584 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:26.584 21:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:26.584 21:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:26.584 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:26.584 21:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:26.584 21:13:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:26.584 21:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:26.584 21:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:26.584 21:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:26.584 21:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:26.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:26.584 21:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:26.584 21:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:26.584 21:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:26.584 21:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:26.584 21:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:26.584 21:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:26.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:26.584 21:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:26.584 21:13:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:26.584 21:13:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:26.584 21:13:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:26.584 21:13:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:26.584 21:13:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:26.585 21:13:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:26.585 21:13:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:26.585 21:13:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:26.585 21:13:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:26.585 21:13:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:26.585 21:13:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:26.585 21:13:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:26.585 21:13:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:26.585 21:13:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:26.585 21:13:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:26.585 21:13:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:26.585 21:13:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:26.585 21:13:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:26.585 21:13:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:26.585 21:13:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:26.585 21:13:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:26.585 21:13:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:26.585 21:13:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:26.585 21:13:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:26.585 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:26.585 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.318 ms 00:23:26.585 00:23:26.585 --- 10.0.0.2 ping statistics --- 00:23:26.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:26.585 rtt min/avg/max/mdev = 0.318/0.318/0.318/0.000 ms 00:23:26.585 21:13:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:26.585 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:26.585 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:23:26.585 00:23:26.585 --- 10.0.0.1 ping statistics --- 00:23:26.585 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:26.585 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:23:26.585 21:13:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:26.585 21:13:22 -- nvmf/common.sh@410 -- # return 0 00:23:26.585 21:13:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:26.585 21:13:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:26.585 21:13:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:26.585 21:13:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:26.585 21:13:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:26.585 21:13:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:26.585 21:13:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:26.585 21:13:22 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:26.585 21:13:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:26.585 21:13:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:26.585 21:13:22 -- common/autotest_common.sh@10 -- # set +x 00:23:26.585 21:13:22 -- nvmf/common.sh@469 -- # nvmfpid=4062750 00:23:26.585 21:13:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:26.585 21:13:22 -- nvmf/common.sh@470 -- # waitforlisten 4062750 00:23:26.585 21:13:22 -- common/autotest_common.sh@829 -- # '[' -z 4062750 ']' 00:23:26.585 21:13:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:26.585 21:13:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:26.585 21:13:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:26.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:26.585 21:13:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:26.585 21:13:22 -- common/autotest_common.sh@10 -- # set +x 00:23:26.585 [2024-11-27 21:13:22.576212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:26.585 [2024-11-27 21:13:22.576295] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:26.585 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.585 [2024-11-27 21:13:22.645781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:26.585 [2024-11-27 21:13:22.760270] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:26.585 [2024-11-27 21:13:22.760430] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:26.585 [2024-11-27 21:13:22.760457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:26.585 [2024-11-27 21:13:22.760472] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:26.585 [2024-11-27 21:13:22.760559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:26.585 [2024-11-27 21:13:22.760603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:26.585 [2024-11-27 21:13:22.760687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:26.585 [2024-11-27 21:13:22.760689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:27.518 21:13:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:27.518 21:13:23 -- common/autotest_common.sh@862 -- # return 0 00:23:27.518 21:13:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:27.518 21:13:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:27.518 21:13:23 -- common/autotest_common.sh@10 -- # set +x 00:23:27.518 21:13:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:27.518 21:13:23 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:27.518 21:13:23 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:30.798 21:13:26 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:30.798 21:13:26 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:30.798 21:13:26 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:30.798 21:13:26 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:31.056 21:13:27 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:31.056 21:13:27 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:31.056 21:13:27 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:31.056 21:13:27 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:31.056 21:13:27 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:31.314 [2024-11-27 21:13:27.422933] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:31.314 21:13:27 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:31.571 21:13:27 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:31.571 21:13:27 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:31.829 21:13:27 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:31.829 21:13:27 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:32.091 21:13:28 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:32.396 [2024-11-27 21:13:28.449812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:32.396 21:13:28 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:32.679 21:13:28 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:32.679 21:13:28 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:32.679 21:13:28 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:32.679 21:13:28 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:34.052 Initializing NVMe Controllers 00:23:34.052 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:34.052 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:34.052 Initialization complete. Launching workers. 00:23:34.052 ======================================================== 00:23:34.052 Latency(us) 00:23:34.052 Device Information : IOPS MiB/s Average min max 00:23:34.052 PCIE (0000:88:00.0) NSID 1 from core 0: 87119.81 340.31 366.90 15.95 4324.50 00:23:34.052 ======================================================== 00:23:34.052 Total : 87119.81 340.31 366.90 15.95 4324.50 00:23:34.052 00:23:34.052 21:13:29 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:34.052 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.986 Initializing NVMe Controllers 00:23:34.986 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.986 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:34.986 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:34.986 Initialization complete. Launching workers. 00:23:34.986 ======================================================== 00:23:34.986 Latency(us) 00:23:34.986 Device Information : IOPS MiB/s Average min max 00:23:34.986 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 107.62 0.42 9365.72 147.86 45918.34 00:23:34.986 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 35.87 0.14 28096.85 7957.96 50281.42 00:23:34.986 ======================================================== 00:23:34.986 Total : 143.49 0.56 14048.50 147.86 50281.42 00:23:34.986 00:23:34.986 21:13:31 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:34.986 EAL: No free 2048 kB hugepages reported on node 1 00:23:36.359 Initializing NVMe Controllers 00:23:36.359 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:36.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:36.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:36.359 Initialization complete. Launching workers. 00:23:36.359 ======================================================== 00:23:36.359 Latency(us) 00:23:36.359 Device Information : IOPS MiB/s Average min max 00:23:36.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7969.47 31.13 4016.21 697.05 11067.55 00:23:36.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3873.19 15.13 8273.39 6062.88 16882.84 00:23:36.359 ======================================================== 00:23:36.359 Total : 11842.66 46.26 5408.54 697.05 16882.84 00:23:36.359 00:23:36.359 21:13:32 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:36.359 21:13:32 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:36.359 21:13:32 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:36.359 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.889 Initializing NVMe Controllers 00:23:38.889 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:38.889 Controller IO queue size 128, less than required. 00:23:38.889 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.889 Controller IO queue size 128, less than required. 00:23:38.889 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.889 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:38.889 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:38.889 Initialization complete. Launching workers. 00:23:38.889 ======================================================== 00:23:38.889 Latency(us) 00:23:38.889 Device Information : IOPS MiB/s Average min max 00:23:38.889 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1572.29 393.07 82627.16 54909.24 149046.39 00:23:38.889 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 570.52 142.63 232883.98 101968.74 351908.37 00:23:38.889 ======================================================== 00:23:38.889 Total : 2142.81 535.70 122632.64 54909.24 351908.37 00:23:38.889 00:23:38.889 21:13:35 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:39.147 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.147 No valid NVMe controllers or AIO or URING devices found 00:23:39.147 Initializing NVMe Controllers 00:23:39.147 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.147 Controller IO queue size 128, less than required. 00:23:39.147 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:39.147 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:39.147 Controller IO queue size 128, less than required. 00:23:39.147 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:39.147 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:39.147 WARNING: Some requested NVMe devices were skipped 00:23:39.147 21:13:35 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:39.405 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.934 Initializing NVMe Controllers 00:23:41.934 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.934 Controller IO queue size 128, less than required. 00:23:41.934 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.934 Controller IO queue size 128, less than required. 00:23:41.934 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.934 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.934 Initialization complete. Launching workers. 00:23:41.934 00:23:41.934 ==================== 00:23:41.934 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:41.934 TCP transport: 00:23:41.935 polls: 9934 00:23:41.935 idle_polls: 6558 00:23:41.935 sock_completions: 3376 00:23:41.935 nvme_completions: 5331 00:23:41.935 submitted_requests: 8023 00:23:41.935 queued_requests: 1 00:23:41.935 00:23:41.935 ==================== 00:23:41.935 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:41.935 TCP transport: 00:23:41.935 polls: 10246 00:23:41.935 idle_polls: 6348 00:23:41.935 sock_completions: 3898 00:23:41.935 nvme_completions: 6252 00:23:41.935 submitted_requests: 9524 00:23:41.935 queued_requests: 1 00:23:41.935 ======================================================== 00:23:41.935 Latency(us) 00:23:41.935 Device Information : IOPS MiB/s Average min max 00:23:41.935 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1394.84 348.71 94370.11 47804.04 166796.36 00:23:41.935 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1624.56 406.14 79956.69 40696.78 127813.83 00:23:41.935 ======================================================== 00:23:41.935 Total : 3019.40 754.85 86615.09 40696.78 166796.36 00:23:41.935 00:23:41.935 21:13:38 -- host/perf.sh@66 -- # sync 00:23:41.935 21:13:38 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:42.192 21:13:38 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:42.192 21:13:38 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:42.192 21:13:38 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:45.470 21:13:41 -- host/perf.sh@72 -- # ls_guid=aecd3eba-04e9-4ebe-8d60-c9726ae63562 00:23:45.470 21:13:41 -- host/perf.sh@73 -- # get_lvs_free_mb aecd3eba-04e9-4ebe-8d60-c9726ae63562 00:23:45.470 21:13:41 -- common/autotest_common.sh@1353 -- # local lvs_uuid=aecd3eba-04e9-4ebe-8d60-c9726ae63562 00:23:45.470 21:13:41 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:45.470 21:13:41 -- common/autotest_common.sh@1355 -- # local fc 00:23:45.470 21:13:41 -- common/autotest_common.sh@1356 -- # local cs 00:23:45.470 21:13:41 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:45.727 21:13:41 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:45.727 { 00:23:45.727 "uuid": "aecd3eba-04e9-4ebe-8d60-c9726ae63562", 00:23:45.727 "name": "lvs_0", 00:23:45.727 "base_bdev": "Nvme0n1", 00:23:45.727 "total_data_clusters": 238234, 00:23:45.727 "free_clusters": 238234, 00:23:45.727 "block_size": 512, 00:23:45.727 "cluster_size": 4194304 00:23:45.727 } 00:23:45.727 ]' 00:23:45.727 21:13:41 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="aecd3eba-04e9-4ebe-8d60-c9726ae63562") .free_clusters' 00:23:45.727 21:13:41 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:45.727 21:13:41 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="aecd3eba-04e9-4ebe-8d60-c9726ae63562") .cluster_size' 00:23:45.727 21:13:41 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:45.727 21:13:41 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:45.727 21:13:41 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:45.727 952936 00:23:45.727 21:13:41 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:45.727 21:13:41 -- host/perf.sh@78 -- # free_mb=20480 00:23:45.727 21:13:41 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u aecd3eba-04e9-4ebe-8d60-c9726ae63562 lbd_0 20480 00:23:46.291 21:13:42 -- host/perf.sh@80 -- # lb_guid=15fc6292-1786-42b3-8e0f-b48db91c5513 00:23:46.291 21:13:42 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 15fc6292-1786-42b3-8e0f-b48db91c5513 lvs_n_0 00:23:47.222 21:13:43 -- host/perf.sh@83 -- # ls_nested_guid=eaf5dc32-4fcf-48f2-9e2f-3725dddaebda 00:23:47.222 21:13:43 -- host/perf.sh@84 -- # get_lvs_free_mb eaf5dc32-4fcf-48f2-9e2f-3725dddaebda 00:23:47.222 21:13:43 -- common/autotest_common.sh@1353 -- # local lvs_uuid=eaf5dc32-4fcf-48f2-9e2f-3725dddaebda 00:23:47.222 21:13:43 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:47.222 21:13:43 -- common/autotest_common.sh@1355 -- # local fc 00:23:47.222 21:13:43 -- common/autotest_common.sh@1356 -- # local cs 00:23:47.222 21:13:43 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:47.480 21:13:43 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:47.480 { 00:23:47.480 "uuid": "aecd3eba-04e9-4ebe-8d60-c9726ae63562", 00:23:47.480 "name": "lvs_0", 00:23:47.480 "base_bdev": "Nvme0n1", 00:23:47.480 "total_data_clusters": 238234, 00:23:47.480 "free_clusters": 233114, 00:23:47.480 "block_size": 512, 00:23:47.480 "cluster_size": 4194304 00:23:47.480 }, 00:23:47.480 { 00:23:47.480 "uuid": "eaf5dc32-4fcf-48f2-9e2f-3725dddaebda", 00:23:47.480 "name": "lvs_n_0", 00:23:47.480 "base_bdev": "15fc6292-1786-42b3-8e0f-b48db91c5513", 00:23:47.480 "total_data_clusters": 5114, 00:23:47.480 "free_clusters": 5114, 00:23:47.480 "block_size": 512, 00:23:47.480 "cluster_size": 4194304 00:23:47.480 } 00:23:47.480 ]' 00:23:47.480 21:13:43 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="eaf5dc32-4fcf-48f2-9e2f-3725dddaebda") .free_clusters' 00:23:47.480 21:13:43 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:47.480 21:13:43 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="eaf5dc32-4fcf-48f2-9e2f-3725dddaebda") .cluster_size' 00:23:47.480 21:13:43 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:47.480 21:13:43 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:47.480 21:13:43 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:47.480 20456 00:23:47.480 21:13:43 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:47.480 21:13:43 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u eaf5dc32-4fcf-48f2-9e2f-3725dddaebda lbd_nest_0 20456 00:23:47.738 21:13:43 -- host/perf.sh@88 -- # lb_nested_guid=a67967f1-8597-4027-8602-5f00c7456a16 00:23:47.738 21:13:43 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:47.996 21:13:44 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:47.996 21:13:44 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 a67967f1-8597-4027-8602-5f00c7456a16 00:23:48.254 21:13:44 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:48.512 21:13:44 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:48.512 21:13:44 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:48.512 21:13:44 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:48.512 21:13:44 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:48.512 21:13:44 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:48.512 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.808 Initializing NVMe Controllers 00:24:00.808 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:00.808 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:00.808 Initialization complete. Launching workers. 00:24:00.808 ======================================================== 00:24:00.808 Latency(us) 00:24:00.808 Device Information : IOPS MiB/s Average min max 00:24:00.808 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.89 0.02 21411.88 185.76 45017.16 00:24:00.808 ======================================================== 00:24:00.808 Total : 46.89 0.02 21411.88 185.76 45017.16 00:24:00.808 00:24:00.808 21:13:54 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:00.808 21:13:54 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:00.808 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.778 Initializing NVMe Controllers 00:24:10.778 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:10.778 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:10.778 Initialization complete. Launching workers. 00:24:10.778 ======================================================== 00:24:10.778 Latency(us) 00:24:10.778 Device Information : IOPS MiB/s Average min max 00:24:10.778 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 71.80 8.97 13934.70 4985.72 55851.52 00:24:10.778 ======================================================== 00:24:10.778 Total : 71.80 8.97 13934.70 4985.72 55851.52 00:24:10.778 00:24:10.778 21:14:05 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:10.778 21:14:05 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:10.778 21:14:05 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:10.778 EAL: No free 2048 kB hugepages reported on node 1 00:24:20.741 Initializing NVMe Controllers 00:24:20.741 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:20.741 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:20.741 Initialization complete. Launching workers. 00:24:20.741 ======================================================== 00:24:20.741 Latency(us) 00:24:20.741 Device Information : IOPS MiB/s Average min max 00:24:20.742 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7847.00 3.83 4077.80 313.67 10454.56 00:24:20.742 ======================================================== 00:24:20.742 Total : 7847.00 3.83 4077.80 313.67 10454.56 00:24:20.742 00:24:20.742 21:14:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:20.742 21:14:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:20.742 EAL: No free 2048 kB hugepages reported on node 1 00:24:30.706 Initializing NVMe Controllers 00:24:30.706 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:30.706 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:30.706 Initialization complete. Launching workers. 00:24:30.706 ======================================================== 00:24:30.706 Latency(us) 00:24:30.706 Device Information : IOPS MiB/s Average min max 00:24:30.706 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4061.47 507.68 7880.58 673.15 16814.36 00:24:30.706 ======================================================== 00:24:30.706 Total : 4061.47 507.68 7880.58 673.15 16814.36 00:24:30.706 00:24:30.706 21:14:25 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:30.706 21:14:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:30.706 21:14:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:30.706 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.667 Initializing NVMe Controllers 00:24:40.667 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:40.667 Controller IO queue size 128, less than required. 00:24:40.667 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:40.667 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:40.667 Initialization complete. Launching workers. 00:24:40.667 ======================================================== 00:24:40.667 Latency(us) 00:24:40.667 Device Information : IOPS MiB/s Average min max 00:24:40.667 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12074.30 5.90 10607.85 1752.57 23408.65 00:24:40.667 ======================================================== 00:24:40.667 Total : 12074.30 5.90 10607.85 1752.57 23408.65 00:24:40.667 00:24:40.667 21:14:36 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:40.667 21:14:36 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:40.667 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.634 Initializing NVMe Controllers 00:24:50.635 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:50.635 Controller IO queue size 128, less than required. 00:24:50.635 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:50.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:50.635 Initialization complete. Launching workers. 00:24:50.635 ======================================================== 00:24:50.635 Latency(us) 00:24:50.635 Device Information : IOPS MiB/s Average min max 00:24:50.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1206.80 150.85 106767.66 16294.68 234173.75 00:24:50.635 ======================================================== 00:24:50.635 Total : 1206.80 150.85 106767.66 16294.68 234173.75 00:24:50.635 00:24:50.635 21:14:46 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:50.892 21:14:46 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a67967f1-8597-4027-8602-5f00c7456a16 00:24:51.826 21:14:47 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:51.826 21:14:48 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 15fc6292-1786-42b3-8e0f-b48db91c5513 00:24:52.085 21:14:48 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:52.343 21:14:48 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:52.343 21:14:48 -- host/perf.sh@114 -- # nvmftestfini 00:24:52.343 21:14:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:52.343 21:14:48 -- nvmf/common.sh@116 -- # sync 00:24:52.343 21:14:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:52.343 21:14:48 -- nvmf/common.sh@119 -- # set +e 00:24:52.343 21:14:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:52.343 21:14:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:52.343 rmmod nvme_tcp 00:24:52.601 rmmod nvme_fabrics 00:24:52.601 rmmod nvme_keyring 00:24:52.601 21:14:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:52.601 21:14:48 -- nvmf/common.sh@123 -- # set -e 00:24:52.601 21:14:48 -- nvmf/common.sh@124 -- # return 0 00:24:52.601 21:14:48 -- nvmf/common.sh@477 -- # '[' -n 4062750 ']' 00:24:52.601 21:14:48 -- nvmf/common.sh@478 -- # killprocess 4062750 00:24:52.601 21:14:48 -- common/autotest_common.sh@936 -- # '[' -z 4062750 ']' 00:24:52.601 21:14:48 -- common/autotest_common.sh@940 -- # kill -0 4062750 00:24:52.601 21:14:48 -- common/autotest_common.sh@941 -- # uname 00:24:52.601 21:14:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:52.601 21:14:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4062750 00:24:52.601 21:14:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:52.601 21:14:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:52.601 21:14:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4062750' 00:24:52.601 killing process with pid 4062750 00:24:52.601 21:14:48 -- common/autotest_common.sh@955 -- # kill 4062750 00:24:52.601 21:14:48 -- common/autotest_common.sh@960 -- # wait 4062750 00:24:54.501 21:14:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:54.501 21:14:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:54.501 21:14:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:54.501 21:14:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:54.501 21:14:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:54.501 21:14:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.501 21:14:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.501 21:14:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.405 21:14:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:56.405 00:24:56.405 real 1m32.400s 00:24:56.405 user 5m39.317s 00:24:56.405 sys 0m15.978s 00:24:56.405 21:14:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:56.405 21:14:52 -- common/autotest_common.sh@10 -- # set +x 00:24:56.405 ************************************ 00:24:56.405 END TEST nvmf_perf 00:24:56.405 ************************************ 00:24:56.405 21:14:52 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:56.405 21:14:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:56.405 21:14:52 -- common/autotest_common.sh@10 -- # set +x 00:24:56.405 ************************************ 00:24:56.405 START TEST nvmf_fio_host 00:24:56.405 ************************************ 00:24:56.405 21:14:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:56.405 * Looking for test storage... 00:24:56.405 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:56.405 21:14:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:56.405 21:14:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:56.405 21:14:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:56.405 21:14:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:56.405 21:14:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:56.405 21:14:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:56.405 21:14:52 -- scripts/common.sh@335 -- # IFS=.-: 00:24:56.405 21:14:52 -- scripts/common.sh@335 -- # read -ra ver1 00:24:56.405 21:14:52 -- scripts/common.sh@336 -- # IFS=.-: 00:24:56.405 21:14:52 -- scripts/common.sh@336 -- # read -ra ver2 00:24:56.405 21:14:52 -- scripts/common.sh@337 -- # local 'op=<' 00:24:56.405 21:14:52 -- scripts/common.sh@339 -- # ver1_l=2 00:24:56.405 21:14:52 -- scripts/common.sh@340 -- # ver2_l=1 00:24:56.405 21:14:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:56.405 21:14:52 -- scripts/common.sh@343 -- # case "$op" in 00:24:56.405 21:14:52 -- scripts/common.sh@344 -- # : 1 00:24:56.405 21:14:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:56.405 21:14:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:56.405 21:14:52 -- scripts/common.sh@364 -- # decimal 1 00:24:56.405 21:14:52 -- scripts/common.sh@352 -- # local d=1 00:24:56.405 21:14:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:56.405 21:14:52 -- scripts/common.sh@354 -- # echo 1 00:24:56.405 21:14:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:56.405 21:14:52 -- scripts/common.sh@365 -- # decimal 2 00:24:56.405 21:14:52 -- scripts/common.sh@352 -- # local d=2 00:24:56.405 21:14:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:56.405 21:14:52 -- scripts/common.sh@354 -- # echo 2 00:24:56.405 21:14:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:56.405 21:14:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:56.405 21:14:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:56.405 21:14:52 -- scripts/common.sh@367 -- # return 0 00:24:56.405 21:14:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:56.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:56.405 --rc genhtml_branch_coverage=1 00:24:56.405 --rc genhtml_function_coverage=1 00:24:56.405 --rc genhtml_legend=1 00:24:56.405 --rc geninfo_all_blocks=1 00:24:56.405 --rc geninfo_unexecuted_blocks=1 00:24:56.405 00:24:56.405 ' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:56.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:56.405 --rc genhtml_branch_coverage=1 00:24:56.405 --rc genhtml_function_coverage=1 00:24:56.405 --rc genhtml_legend=1 00:24:56.405 --rc geninfo_all_blocks=1 00:24:56.405 --rc geninfo_unexecuted_blocks=1 00:24:56.405 00:24:56.405 ' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:56.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:56.405 --rc genhtml_branch_coverage=1 00:24:56.405 --rc genhtml_function_coverage=1 00:24:56.405 --rc genhtml_legend=1 00:24:56.405 --rc geninfo_all_blocks=1 00:24:56.405 --rc geninfo_unexecuted_blocks=1 00:24:56.405 00:24:56.405 ' 00:24:56.405 21:14:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:56.405 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:56.405 --rc genhtml_branch_coverage=1 00:24:56.405 --rc genhtml_function_coverage=1 00:24:56.405 --rc genhtml_legend=1 00:24:56.405 --rc geninfo_all_blocks=1 00:24:56.405 --rc geninfo_unexecuted_blocks=1 00:24:56.405 00:24:56.405 ' 00:24:56.405 21:14:52 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:56.405 21:14:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:56.405 21:14:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:56.405 21:14:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:56.405 21:14:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@5 -- # export PATH 00:24:56.405 21:14:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:56.405 21:14:52 -- nvmf/common.sh@7 -- # uname -s 00:24:56.405 21:14:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:56.405 21:14:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:56.405 21:14:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:56.405 21:14:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:56.405 21:14:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:56.405 21:14:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:56.405 21:14:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:56.405 21:14:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:56.405 21:14:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:56.405 21:14:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:56.405 21:14:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.405 21:14:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.405 21:14:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:56.405 21:14:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:56.405 21:14:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:56.405 21:14:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:56.405 21:14:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:56.405 21:14:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:56.405 21:14:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:56.405 21:14:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.405 21:14:52 -- paths/export.sh@5 -- # export PATH 00:24:56.406 21:14:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.406 21:14:52 -- nvmf/common.sh@46 -- # : 0 00:24:56.406 21:14:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:56.406 21:14:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:56.406 21:14:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:56.406 21:14:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:56.406 21:14:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:56.406 21:14:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:56.406 21:14:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:56.406 21:14:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:56.406 21:14:52 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:56.406 21:14:52 -- host/fio.sh@14 -- # nvmftestinit 00:24:56.406 21:14:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:56.406 21:14:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:56.406 21:14:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:56.406 21:14:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:56.406 21:14:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:56.406 21:14:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.406 21:14:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.406 21:14:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.406 21:14:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:56.406 21:14:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:56.406 21:14:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:56.406 21:14:52 -- common/autotest_common.sh@10 -- # set +x 00:24:58.308 21:14:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:58.308 21:14:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:58.308 21:14:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:58.308 21:14:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:58.308 21:14:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:58.308 21:14:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:58.308 21:14:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:58.308 21:14:54 -- nvmf/common.sh@294 -- # net_devs=() 00:24:58.308 21:14:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:58.308 21:14:54 -- nvmf/common.sh@295 -- # e810=() 00:24:58.308 21:14:54 -- nvmf/common.sh@295 -- # local -ga e810 00:24:58.308 21:14:54 -- nvmf/common.sh@296 -- # x722=() 00:24:58.308 21:14:54 -- nvmf/common.sh@296 -- # local -ga x722 00:24:58.308 21:14:54 -- nvmf/common.sh@297 -- # mlx=() 00:24:58.308 21:14:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:58.308 21:14:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:58.308 21:14:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:58.308 21:14:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:58.308 21:14:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.308 21:14:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:58.308 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:58.308 21:14:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.308 21:14:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:58.308 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:58.308 21:14:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.308 21:14:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.308 21:14:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.308 21:14:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:58.308 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:58.308 21:14:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.308 21:14:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.308 21:14:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.308 21:14:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.308 21:14:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:58.308 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:58.308 21:14:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.308 21:14:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:58.308 21:14:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:58.308 21:14:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:58.308 21:14:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:58.308 21:14:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:58.308 21:14:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:58.308 21:14:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:58.308 21:14:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:58.308 21:14:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:58.308 21:14:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:58.308 21:14:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:58.308 21:14:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:58.308 21:14:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:58.308 21:14:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:58.308 21:14:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:58.308 21:14:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:58.567 21:14:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:58.567 21:14:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:58.567 21:14:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:58.567 21:14:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:58.567 21:14:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:58.567 21:14:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:58.567 21:14:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:58.567 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:58.567 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:24:58.567 00:24:58.567 --- 10.0.0.2 ping statistics --- 00:24:58.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.567 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:24:58.567 21:14:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:58.567 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:58.567 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:24:58.567 00:24:58.567 --- 10.0.0.1 ping statistics --- 00:24:58.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.567 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:24:58.567 21:14:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:58.567 21:14:54 -- nvmf/common.sh@410 -- # return 0 00:24:58.567 21:14:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:58.567 21:14:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:58.567 21:14:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:58.567 21:14:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:58.567 21:14:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:58.567 21:14:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:58.567 21:14:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:58.567 21:14:54 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:58.567 21:14:54 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:58.567 21:14:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:58.567 21:14:54 -- common/autotest_common.sh@10 -- # set +x 00:24:58.567 21:14:54 -- host/fio.sh@24 -- # nvmfpid=4075221 00:24:58.567 21:14:54 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:58.567 21:14:54 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:58.567 21:14:54 -- host/fio.sh@28 -- # waitforlisten 4075221 00:24:58.567 21:14:54 -- common/autotest_common.sh@829 -- # '[' -z 4075221 ']' 00:24:58.567 21:14:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:58.567 21:14:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:58.567 21:14:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:58.567 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:58.567 21:14:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:58.567 21:14:54 -- common/autotest_common.sh@10 -- # set +x 00:24:58.567 [2024-11-27 21:14:54.714739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:58.568 [2024-11-27 21:14:54.714827] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:58.568 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.568 [2024-11-27 21:14:54.782105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:58.826 [2024-11-27 21:14:54.896924] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:58.826 [2024-11-27 21:14:54.897095] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:58.826 [2024-11-27 21:14:54.897114] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:58.826 [2024-11-27 21:14:54.897129] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:58.826 [2024-11-27 21:14:54.897188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:58.826 [2024-11-27 21:14:54.897265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:58.826 [2024-11-27 21:14:54.897347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:58.826 [2024-11-27 21:14:54.897350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.759 21:14:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.759 21:14:55 -- common/autotest_common.sh@862 -- # return 0 00:24:59.759 21:14:55 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:59.759 [2024-11-27 21:14:55.920889] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.759 21:14:55 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:59.759 21:14:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:59.759 21:14:55 -- common/autotest_common.sh@10 -- # set +x 00:24:59.759 21:14:55 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:00.017 Malloc1 00:25:00.017 21:14:56 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:00.275 21:14:56 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:00.532 21:14:56 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:00.790 [2024-11-27 21:14:56.962962] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:00.790 21:14:56 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:01.047 21:14:57 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:01.048 21:14:57 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:01.048 21:14:57 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:01.048 21:14:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:01.048 21:14:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:01.048 21:14:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:01.048 21:14:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:01.048 21:14:57 -- common/autotest_common.sh@1330 -- # shift 00:25:01.048 21:14:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:01.048 21:14:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:01.048 21:14:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:01.048 21:14:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:01.048 21:14:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:01.048 21:14:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:01.048 21:14:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:01.048 21:14:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:01.305 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:01.305 fio-3.35 00:25:01.305 Starting 1 thread 00:25:01.305 EAL: No free 2048 kB hugepages reported on node 1 00:25:03.832 00:25:03.832 test: (groupid=0, jobs=1): err= 0: pid=4075720: Wed Nov 27 21:14:59 2024 00:25:03.832 read: IOPS=9505, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2006msec) 00:25:03.832 slat (nsec): min=1830, max=110846, avg=2298.26, stdev=1422.53 00:25:03.832 clat (usec): min=2405, max=13383, avg=7449.39, stdev=570.78 00:25:03.832 lat (usec): min=2423, max=13385, avg=7451.69, stdev=570.71 00:25:03.832 clat percentiles (usec): 00:25:03.832 | 1.00th=[ 6128], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 6980], 00:25:03.832 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:25:03.832 | 70.00th=[ 7701], 80.00th=[ 7898], 90.00th=[ 8094], 95.00th=[ 8291], 00:25:03.832 | 99.00th=[ 8717], 99.50th=[ 8848], 99.90th=[10814], 99.95th=[12125], 00:25:03.832 | 99.99th=[13304] 00:25:03.832 bw ( KiB/s): min=37016, max=38688, per=99.94%, avg=38002.00, stdev=717.46, samples=4 00:25:03.832 iops : min= 9254, max= 9672, avg=9500.50, stdev=179.36, samples=4 00:25:03.832 write: IOPS=9514, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec); 0 zone resets 00:25:03.832 slat (nsec): min=1967, max=100125, avg=2404.80, stdev=1196.83 00:25:03.832 clat (usec): min=1000, max=11630, avg=5974.08, stdev=498.46 00:25:03.832 lat (usec): min=1006, max=11632, avg=5976.48, stdev=498.42 00:25:03.832 clat percentiles (usec): 00:25:03.832 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5604], 00:25:03.832 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:25:03.832 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6652], 00:25:03.832 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[10159], 99.95th=[10945], 00:25:03.832 | 99.99th=[11600] 00:25:03.832 bw ( KiB/s): min=37824, max=38264, per=99.99%, avg=38054.00, stdev=218.64, samples=4 00:25:03.832 iops : min= 9456, max= 9566, avg=9513.50, stdev=54.66, samples=4 00:25:03.832 lat (msec) : 2=0.03%, 4=0.11%, 10=99.73%, 20=0.13% 00:25:03.832 cpu : usr=65.29%, sys=31.82%, ctx=82, majf=0, minf=41 00:25:03.832 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:03.832 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:03.832 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:03.832 issued rwts: total=19069,19086,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:03.832 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:03.832 00:25:03.832 Run status group 0 (all jobs): 00:25:03.832 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2006-2006msec 00:25:03.832 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:25:03.832 21:14:59 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:03.832 21:14:59 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:03.832 21:14:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:03.832 21:14:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:03.832 21:14:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:03.832 21:14:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.832 21:14:59 -- common/autotest_common.sh@1330 -- # shift 00:25:03.832 21:14:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:03.832 21:14:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.832 21:14:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.832 21:14:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.832 21:14:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.832 21:14:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.832 21:14:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:03.832 21:14:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:04.090 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:04.090 fio-3.35 00:25:04.090 Starting 1 thread 00:25:04.090 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.615 00:25:06.615 test: (groupid=0, jobs=1): err= 0: pid=4076099: Wed Nov 27 21:15:02 2024 00:25:06.615 read: IOPS=8515, BW=133MiB/s (140MB/s)(267MiB/2007msec) 00:25:06.615 slat (usec): min=2, max=112, avg= 3.97, stdev= 2.13 00:25:06.615 clat (usec): min=2319, max=16940, avg=8778.28, stdev=2159.36 00:25:06.615 lat (usec): min=2323, max=16943, avg=8782.26, stdev=2159.40 00:25:06.615 clat percentiles (usec): 00:25:06.615 | 1.00th=[ 4752], 5.00th=[ 5538], 10.00th=[ 6063], 20.00th=[ 6849], 00:25:06.615 | 30.00th=[ 7439], 40.00th=[ 8029], 50.00th=[ 8717], 60.00th=[ 9372], 00:25:06.615 | 70.00th=[ 9896], 80.00th=[10421], 90.00th=[11469], 95.00th=[12518], 00:25:06.615 | 99.00th=[14484], 99.50th=[15270], 99.90th=[16319], 99.95th=[16581], 00:25:06.615 | 99.99th=[16909] 00:25:06.615 bw ( KiB/s): min=59456, max=79456, per=50.45%, avg=68736.00, stdev=8208.03, samples=4 00:25:06.615 iops : min= 3716, max= 4966, avg=4296.00, stdev=513.00, samples=4 00:25:06.615 write: IOPS=4962, BW=77.5MiB/s (81.3MB/s)(141MiB/1815msec); 0 zone resets 00:25:06.615 slat (usec): min=30, max=135, avg=35.70, stdev= 6.31 00:25:06.615 clat (usec): min=4257, max=20502, avg=11205.60, stdev=2057.63 00:25:06.615 lat (usec): min=4290, max=20536, avg=11241.30, stdev=2057.61 00:25:06.615 clat percentiles (usec): 00:25:06.615 | 1.00th=[ 7439], 5.00th=[ 8455], 10.00th=[ 8979], 20.00th=[ 9634], 00:25:06.615 | 30.00th=[10028], 40.00th=[10552], 50.00th=[10945], 60.00th=[11338], 00:25:06.615 | 70.00th=[11863], 80.00th=[12649], 90.00th=[14091], 95.00th=[15139], 00:25:06.615 | 99.00th=[17433], 99.50th=[18744], 99.90th=[19530], 99.95th=[20055], 00:25:06.615 | 99.99th=[20579] 00:25:06.615 bw ( KiB/s): min=63008, max=82400, per=90.13%, avg=71560.00, stdev=8047.70, samples=4 00:25:06.615 iops : min= 3938, max= 5150, avg=4472.50, stdev=502.98, samples=4 00:25:06.615 lat (msec) : 4=0.14%, 10=56.60%, 20=43.23%, 50=0.03% 00:25:06.615 cpu : usr=76.97%, sys=21.09%, ctx=26, majf=0, minf=71 00:25:06.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:25:06.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:06.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:06.615 issued rwts: total=17090,9007,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:06.615 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:06.615 00:25:06.615 Run status group 0 (all jobs): 00:25:06.615 READ: bw=133MiB/s (140MB/s), 133MiB/s-133MiB/s (140MB/s-140MB/s), io=267MiB (280MB), run=2007-2007msec 00:25:06.615 WRITE: bw=77.5MiB/s (81.3MB/s), 77.5MiB/s-77.5MiB/s (81.3MB/s-81.3MB/s), io=141MiB (148MB), run=1815-1815msec 00:25:06.615 21:15:02 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:06.615 21:15:02 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:06.615 21:15:02 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:06.615 21:15:02 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:06.615 21:15:02 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:06.615 21:15:02 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:06.615 21:15:02 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:06.615 21:15:02 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:06.615 21:15:02 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:06.873 21:15:02 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:06.873 21:15:02 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:06.873 21:15:02 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:10.152 Nvme0n1 00:25:10.152 21:15:05 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:12.681 21:15:08 -- host/fio.sh@53 -- # ls_guid=790765b7-57e7-4324-90c8-8f10445f7b54 00:25:12.681 21:15:08 -- host/fio.sh@54 -- # get_lvs_free_mb 790765b7-57e7-4324-90c8-8f10445f7b54 00:25:12.681 21:15:08 -- common/autotest_common.sh@1353 -- # local lvs_uuid=790765b7-57e7-4324-90c8-8f10445f7b54 00:25:12.681 21:15:08 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:12.681 21:15:08 -- common/autotest_common.sh@1355 -- # local fc 00:25:12.681 21:15:08 -- common/autotest_common.sh@1356 -- # local cs 00:25:12.681 21:15:08 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:12.940 21:15:09 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:12.940 { 00:25:12.940 "uuid": "790765b7-57e7-4324-90c8-8f10445f7b54", 00:25:12.940 "name": "lvs_0", 00:25:12.940 "base_bdev": "Nvme0n1", 00:25:12.940 "total_data_clusters": 930, 00:25:12.940 "free_clusters": 930, 00:25:12.940 "block_size": 512, 00:25:12.940 "cluster_size": 1073741824 00:25:12.940 } 00:25:12.940 ]' 00:25:12.940 21:15:09 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="790765b7-57e7-4324-90c8-8f10445f7b54") .free_clusters' 00:25:13.197 21:15:09 -- common/autotest_common.sh@1358 -- # fc=930 00:25:13.197 21:15:09 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="790765b7-57e7-4324-90c8-8f10445f7b54") .cluster_size' 00:25:13.197 21:15:09 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:13.197 21:15:09 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:13.197 21:15:09 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:13.197 952320 00:25:13.197 21:15:09 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:13.453 e1931298-9e23-4734-852c-6e1e13366827 00:25:13.453 21:15:09 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:13.711 21:15:09 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:13.969 21:15:10 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:14.227 21:15:10 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.227 21:15:10 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.227 21:15:10 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:14.227 21:15:10 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:14.227 21:15:10 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:14.227 21:15:10 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.227 21:15:10 -- common/autotest_common.sh@1330 -- # shift 00:25:14.227 21:15:10 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:14.227 21:15:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:14.227 21:15:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:14.227 21:15:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:14.227 21:15:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:14.227 21:15:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:14.227 21:15:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:14.227 21:15:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.484 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:14.484 fio-3.35 00:25:14.484 Starting 1 thread 00:25:14.484 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.011 00:25:17.011 test: (groupid=0, jobs=1): err= 0: pid=4078005: Wed Nov 27 21:15:13 2024 00:25:17.011 read: IOPS=6060, BW=23.7MiB/s (24.8MB/s)(47.5MiB/2007msec) 00:25:17.011 slat (nsec): min=1888, max=155086, avg=2431.03, stdev=2230.15 00:25:17.011 clat (usec): min=912, max=170577, avg=11622.03, stdev=11529.51 00:25:17.011 lat (usec): min=916, max=170616, avg=11624.46, stdev=11529.85 00:25:17.011 clat percentiles (msec): 00:25:17.011 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 11], 00:25:17.011 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12], 00:25:17.011 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 13], 00:25:17.011 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:17.011 | 99.99th=[ 171] 00:25:17.011 bw ( KiB/s): min=17368, max=26816, per=99.75%, avg=24180.00, stdev=4551.72, samples=4 00:25:17.011 iops : min= 4342, max= 6704, avg=6045.00, stdev=1137.93, samples=4 00:25:17.011 write: IOPS=6040, BW=23.6MiB/s (24.7MB/s)(47.4MiB/2007msec); 0 zone resets 00:25:17.011 slat (usec): min=2, max=136, avg= 2.57, stdev= 1.72 00:25:17.011 clat (usec): min=272, max=168910, avg=9380.84, stdev=10857.20 00:25:17.011 lat (usec): min=277, max=168918, avg=9383.42, stdev=10857.56 00:25:17.011 clat percentiles (msec): 00:25:17.011 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:25:17.011 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:17.011 | 70.00th=[ 9], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:25:17.011 | 99.00th=[ 11], 99.50th=[ 17], 99.90th=[ 169], 99.95th=[ 169], 00:25:17.011 | 99.99th=[ 169] 00:25:17.011 bw ( KiB/s): min=18408, max=26560, per=99.90%, avg=24138.00, stdev=3837.47, samples=4 00:25:17.011 iops : min= 4602, max= 6640, avg=6034.50, stdev=959.37, samples=4 00:25:17.011 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:17.011 lat (msec) : 2=0.03%, 4=0.19%, 10=57.35%, 20=41.89%, 250=0.53% 00:25:17.011 cpu : usr=57.13%, sys=40.93%, ctx=128, majf=0, minf=41 00:25:17.011 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:17.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:17.011 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:17.011 issued rwts: total=12163,12123,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:17.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:17.011 00:25:17.011 Run status group 0 (all jobs): 00:25:17.011 READ: bw=23.7MiB/s (24.8MB/s), 23.7MiB/s-23.7MiB/s (24.8MB/s-24.8MB/s), io=47.5MiB (49.8MB), run=2007-2007msec 00:25:17.011 WRITE: bw=23.6MiB/s (24.7MB/s), 23.6MiB/s-23.6MiB/s (24.7MB/s-24.7MB/s), io=47.4MiB (49.7MB), run=2007-2007msec 00:25:17.011 21:15:13 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:17.269 21:15:13 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:18.641 21:15:14 -- host/fio.sh@64 -- # ls_nested_guid=cfe75633-92b3-4ad1-8f19-a9cfd6fcea43 00:25:18.641 21:15:14 -- host/fio.sh@65 -- # get_lvs_free_mb cfe75633-92b3-4ad1-8f19-a9cfd6fcea43 00:25:18.641 21:15:14 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cfe75633-92b3-4ad1-8f19-a9cfd6fcea43 00:25:18.641 21:15:14 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:18.641 21:15:14 -- common/autotest_common.sh@1355 -- # local fc 00:25:18.641 21:15:14 -- common/autotest_common.sh@1356 -- # local cs 00:25:18.641 21:15:14 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:18.641 21:15:14 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:18.641 { 00:25:18.641 "uuid": "790765b7-57e7-4324-90c8-8f10445f7b54", 00:25:18.641 "name": "lvs_0", 00:25:18.641 "base_bdev": "Nvme0n1", 00:25:18.641 "total_data_clusters": 930, 00:25:18.641 "free_clusters": 0, 00:25:18.641 "block_size": 512, 00:25:18.641 "cluster_size": 1073741824 00:25:18.641 }, 00:25:18.641 { 00:25:18.641 "uuid": "cfe75633-92b3-4ad1-8f19-a9cfd6fcea43", 00:25:18.641 "name": "lvs_n_0", 00:25:18.641 "base_bdev": "e1931298-9e23-4734-852c-6e1e13366827", 00:25:18.641 "total_data_clusters": 237847, 00:25:18.641 "free_clusters": 237847, 00:25:18.641 "block_size": 512, 00:25:18.641 "cluster_size": 4194304 00:25:18.641 } 00:25:18.641 ]' 00:25:18.641 21:15:14 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cfe75633-92b3-4ad1-8f19-a9cfd6fcea43") .free_clusters' 00:25:18.899 21:15:14 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:18.899 21:15:14 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cfe75633-92b3-4ad1-8f19-a9cfd6fcea43") .cluster_size' 00:25:18.899 21:15:14 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:18.899 21:15:14 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:18.899 21:15:14 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:18.899 951388 00:25:18.899 21:15:14 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:19.465 faa88b07-da27-4db4-a008-38559353e6dd 00:25:19.465 21:15:15 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:19.722 21:15:15 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:19.980 21:15:16 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:20.238 21:15:16 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.238 21:15:16 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.238 21:15:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:20.238 21:15:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:20.238 21:15:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:20.238 21:15:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.238 21:15:16 -- common/autotest_common.sh@1330 -- # shift 00:25:20.238 21:15:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:20.238 21:15:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:20.238 21:15:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:20.238 21:15:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:20.238 21:15:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:20.238 21:15:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:20.238 21:15:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:20.238 21:15:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.496 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:20.496 fio-3.35 00:25:20.496 Starting 1 thread 00:25:20.496 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.165 00:25:23.165 test: (groupid=0, jobs=1): err= 0: pid=4078848: Wed Nov 27 21:15:18 2024 00:25:23.165 read: IOPS=5909, BW=23.1MiB/s (24.2MB/s)(46.4MiB/2008msec) 00:25:23.165 slat (nsec): min=1889, max=200611, avg=2341.60, stdev=2286.27 00:25:23.165 clat (usec): min=4262, max=19781, avg=11930.69, stdev=1053.82 00:25:23.165 lat (usec): min=4266, max=19783, avg=11933.03, stdev=1053.74 00:25:23.165 clat percentiles (usec): 00:25:23.165 | 1.00th=[ 9372], 5.00th=[10290], 10.00th=[10683], 20.00th=[11076], 00:25:23.165 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11994], 60.00th=[12125], 00:25:23.165 | 70.00th=[12518], 80.00th=[12780], 90.00th=[13173], 95.00th=[13566], 00:25:23.165 | 99.00th=[14222], 99.50th=[14353], 99.90th=[17695], 99.95th=[18744], 00:25:23.165 | 99.99th=[19792] 00:25:23.165 bw ( KiB/s): min=22584, max=24320, per=99.87%, avg=23606.00, stdev=732.55, samples=4 00:25:23.165 iops : min= 5646, max= 6080, avg=5901.50, stdev=183.14, samples=4 00:25:23.165 write: IOPS=5906, BW=23.1MiB/s (24.2MB/s)(46.3MiB/2008msec); 0 zone resets 00:25:23.165 slat (nsec): min=2037, max=90281, avg=2436.27, stdev=1222.13 00:25:23.165 clat (usec): min=1995, max=18749, avg=9562.59, stdev=913.51 00:25:23.165 lat (usec): min=2000, max=18751, avg=9565.03, stdev=913.49 00:25:23.165 clat percentiles (usec): 00:25:23.165 | 1.00th=[ 7439], 5.00th=[ 8160], 10.00th=[ 8455], 20.00th=[ 8848], 00:25:23.165 | 30.00th=[ 9110], 40.00th=[ 9372], 50.00th=[ 9634], 60.00th=[ 9765], 00:25:23.165 | 70.00th=[10028], 80.00th=[10290], 90.00th=[10552], 95.00th=[10945], 00:25:23.165 | 99.00th=[11469], 99.50th=[11863], 99.90th=[15926], 99.95th=[17433], 00:25:23.165 | 99.99th=[18744] 00:25:23.165 bw ( KiB/s): min=23464, max=23920, per=99.86%, avg=23594.00, stdev=218.25, samples=4 00:25:23.165 iops : min= 5866, max= 5980, avg=5898.50, stdev=54.56, samples=4 00:25:23.165 lat (msec) : 2=0.01%, 4=0.04%, 10=36.80%, 20=63.16% 00:25:23.165 cpu : usr=60.59%, sys=37.47%, ctx=101, majf=0, minf=41 00:25:23.165 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:23.165 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:23.165 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:23.165 issued rwts: total=11866,11861,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:23.165 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:23.165 00:25:23.165 Run status group 0 (all jobs): 00:25:23.165 READ: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.4MiB (48.6MB), run=2008-2008msec 00:25:23.165 WRITE: bw=23.1MiB/s (24.2MB/s), 23.1MiB/s-23.1MiB/s (24.2MB/s-24.2MB/s), io=46.3MiB (48.6MB), run=2008-2008msec 00:25:23.165 21:15:18 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:23.165 21:15:19 -- host/fio.sh@74 -- # sync 00:25:23.165 21:15:19 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:27.407 21:15:23 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:27.407 21:15:23 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:30.686 21:15:26 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:30.686 21:15:26 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:32.584 21:15:28 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:32.584 21:15:28 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:32.584 21:15:28 -- host/fio.sh@86 -- # nvmftestfini 00:25:32.584 21:15:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:32.584 21:15:28 -- nvmf/common.sh@116 -- # sync 00:25:32.584 21:15:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:32.584 21:15:28 -- nvmf/common.sh@119 -- # set +e 00:25:32.584 21:15:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:32.584 21:15:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:32.584 rmmod nvme_tcp 00:25:32.584 rmmod nvme_fabrics 00:25:32.584 rmmod nvme_keyring 00:25:32.584 21:15:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:32.584 21:15:28 -- nvmf/common.sh@123 -- # set -e 00:25:32.584 21:15:28 -- nvmf/common.sh@124 -- # return 0 00:25:32.584 21:15:28 -- nvmf/common.sh@477 -- # '[' -n 4075221 ']' 00:25:32.584 21:15:28 -- nvmf/common.sh@478 -- # killprocess 4075221 00:25:32.584 21:15:28 -- common/autotest_common.sh@936 -- # '[' -z 4075221 ']' 00:25:32.584 21:15:28 -- common/autotest_common.sh@940 -- # kill -0 4075221 00:25:32.584 21:15:28 -- common/autotest_common.sh@941 -- # uname 00:25:32.584 21:15:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:32.584 21:15:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4075221 00:25:32.584 21:15:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:32.584 21:15:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:32.584 21:15:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4075221' 00:25:32.584 killing process with pid 4075221 00:25:32.584 21:15:28 -- common/autotest_common.sh@955 -- # kill 4075221 00:25:32.584 21:15:28 -- common/autotest_common.sh@960 -- # wait 4075221 00:25:32.584 21:15:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:32.584 21:15:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:32.584 21:15:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:32.584 21:15:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:32.584 21:15:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:32.584 21:15:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.584 21:15:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.584 21:15:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.115 21:15:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:35.115 00:25:35.115 real 0m38.372s 00:25:35.115 user 2m27.237s 00:25:35.115 sys 0m7.244s 00:25:35.115 21:15:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:35.115 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:25:35.115 ************************************ 00:25:35.115 END TEST nvmf_fio_host 00:25:35.115 ************************************ 00:25:35.115 21:15:30 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:35.115 21:15:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:35.115 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:25:35.115 ************************************ 00:25:35.115 START TEST nvmf_failover 00:25:35.115 ************************************ 00:25:35.115 21:15:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:35.115 * Looking for test storage... 00:25:35.115 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:35.115 21:15:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:35.115 21:15:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:35.115 21:15:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:35.115 21:15:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:35.115 21:15:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:35.115 21:15:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:35.115 21:15:30 -- scripts/common.sh@335 -- # IFS=.-: 00:25:35.115 21:15:30 -- scripts/common.sh@335 -- # read -ra ver1 00:25:35.115 21:15:30 -- scripts/common.sh@336 -- # IFS=.-: 00:25:35.115 21:15:30 -- scripts/common.sh@336 -- # read -ra ver2 00:25:35.115 21:15:30 -- scripts/common.sh@337 -- # local 'op=<' 00:25:35.115 21:15:30 -- scripts/common.sh@339 -- # ver1_l=2 00:25:35.115 21:15:30 -- scripts/common.sh@340 -- # ver2_l=1 00:25:35.115 21:15:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:35.115 21:15:30 -- scripts/common.sh@343 -- # case "$op" in 00:25:35.115 21:15:30 -- scripts/common.sh@344 -- # : 1 00:25:35.115 21:15:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:35.115 21:15:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:35.115 21:15:30 -- scripts/common.sh@364 -- # decimal 1 00:25:35.115 21:15:30 -- scripts/common.sh@352 -- # local d=1 00:25:35.115 21:15:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:35.115 21:15:30 -- scripts/common.sh@354 -- # echo 1 00:25:35.115 21:15:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:35.115 21:15:30 -- scripts/common.sh@365 -- # decimal 2 00:25:35.115 21:15:30 -- scripts/common.sh@352 -- # local d=2 00:25:35.115 21:15:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:35.115 21:15:30 -- scripts/common.sh@354 -- # echo 2 00:25:35.115 21:15:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:35.115 21:15:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:35.115 21:15:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:35.115 21:15:30 -- scripts/common.sh@367 -- # return 0 00:25:35.115 21:15:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:35.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.115 --rc genhtml_branch_coverage=1 00:25:35.115 --rc genhtml_function_coverage=1 00:25:35.115 --rc genhtml_legend=1 00:25:35.115 --rc geninfo_all_blocks=1 00:25:35.115 --rc geninfo_unexecuted_blocks=1 00:25:35.115 00:25:35.115 ' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:35.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.115 --rc genhtml_branch_coverage=1 00:25:35.115 --rc genhtml_function_coverage=1 00:25:35.115 --rc genhtml_legend=1 00:25:35.115 --rc geninfo_all_blocks=1 00:25:35.115 --rc geninfo_unexecuted_blocks=1 00:25:35.115 00:25:35.115 ' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:35.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.115 --rc genhtml_branch_coverage=1 00:25:35.115 --rc genhtml_function_coverage=1 00:25:35.115 --rc genhtml_legend=1 00:25:35.115 --rc geninfo_all_blocks=1 00:25:35.115 --rc geninfo_unexecuted_blocks=1 00:25:35.115 00:25:35.115 ' 00:25:35.115 21:15:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:35.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.115 --rc genhtml_branch_coverage=1 00:25:35.115 --rc genhtml_function_coverage=1 00:25:35.115 --rc genhtml_legend=1 00:25:35.115 --rc geninfo_all_blocks=1 00:25:35.115 --rc geninfo_unexecuted_blocks=1 00:25:35.115 00:25:35.115 ' 00:25:35.115 21:15:30 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:35.116 21:15:30 -- nvmf/common.sh@7 -- # uname -s 00:25:35.116 21:15:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:35.116 21:15:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:35.116 21:15:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:35.116 21:15:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:35.116 21:15:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:35.116 21:15:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:35.116 21:15:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:35.116 21:15:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:35.116 21:15:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:35.116 21:15:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:35.116 21:15:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.116 21:15:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.116 21:15:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:35.116 21:15:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:35.116 21:15:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:35.116 21:15:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:35.116 21:15:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:35.116 21:15:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:35.116 21:15:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:35.116 21:15:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.116 21:15:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.116 21:15:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.116 21:15:30 -- paths/export.sh@5 -- # export PATH 00:25:35.116 21:15:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.116 21:15:30 -- nvmf/common.sh@46 -- # : 0 00:25:35.116 21:15:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:35.116 21:15:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:35.116 21:15:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:35.116 21:15:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:35.116 21:15:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:35.116 21:15:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:35.116 21:15:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:35.116 21:15:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:35.116 21:15:30 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:35.116 21:15:30 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:35.116 21:15:30 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:35.116 21:15:30 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:35.116 21:15:30 -- host/failover.sh@18 -- # nvmftestinit 00:25:35.116 21:15:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:35.116 21:15:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:35.116 21:15:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:35.116 21:15:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:35.116 21:15:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:35.116 21:15:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.116 21:15:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.116 21:15:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.116 21:15:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:35.116 21:15:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:35.116 21:15:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:35.116 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:25:37.018 21:15:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:37.018 21:15:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:37.018 21:15:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:37.018 21:15:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:37.018 21:15:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:37.018 21:15:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:37.018 21:15:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:37.018 21:15:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:37.018 21:15:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:37.018 21:15:32 -- nvmf/common.sh@295 -- # e810=() 00:25:37.018 21:15:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:37.018 21:15:32 -- nvmf/common.sh@296 -- # x722=() 00:25:37.018 21:15:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:37.018 21:15:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:37.018 21:15:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:37.018 21:15:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:37.018 21:15:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:37.018 21:15:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:37.018 21:15:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:37.018 21:15:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.018 21:15:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:37.018 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:37.018 21:15:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.018 21:15:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:37.018 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:37.018 21:15:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:37.018 21:15:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:37.018 21:15:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.018 21:15:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.018 21:15:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.019 21:15:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.019 21:15:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:37.019 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:37.019 21:15:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.019 21:15:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.019 21:15:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.019 21:15:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.019 21:15:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.019 21:15:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:37.019 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:37.019 21:15:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.019 21:15:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:37.019 21:15:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:37.019 21:15:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:37.019 21:15:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:37.019 21:15:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:37.019 21:15:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:37.019 21:15:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:37.019 21:15:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:37.019 21:15:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:37.019 21:15:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:37.019 21:15:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:37.019 21:15:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:37.019 21:15:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:37.019 21:15:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:37.019 21:15:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:37.019 21:15:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:37.019 21:15:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:37.019 21:15:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:37.019 21:15:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:37.019 21:15:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:37.019 21:15:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:37.019 21:15:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:37.019 21:15:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:37.019 21:15:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:37.019 21:15:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:37.019 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:37.019 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:25:37.019 00:25:37.019 --- 10.0.0.2 ping statistics --- 00:25:37.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.019 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:25:37.019 21:15:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:37.019 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:37.019 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:25:37.019 00:25:37.019 --- 10.0.0.1 ping statistics --- 00:25:37.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.019 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:25:37.019 21:15:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:37.019 21:15:32 -- nvmf/common.sh@410 -- # return 0 00:25:37.019 21:15:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:37.019 21:15:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:37.019 21:15:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:37.019 21:15:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:37.019 21:15:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:37.019 21:15:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:37.019 21:15:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:37.019 21:15:32 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:37.019 21:15:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:37.019 21:15:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:37.019 21:15:32 -- common/autotest_common.sh@10 -- # set +x 00:25:37.019 21:15:32 -- nvmf/common.sh@469 -- # nvmfpid=4082197 00:25:37.019 21:15:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:37.019 21:15:32 -- nvmf/common.sh@470 -- # waitforlisten 4082197 00:25:37.019 21:15:32 -- common/autotest_common.sh@829 -- # '[' -z 4082197 ']' 00:25:37.019 21:15:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:37.019 21:15:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:37.019 21:15:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:37.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:37.019 21:15:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:37.019 21:15:32 -- common/autotest_common.sh@10 -- # set +x 00:25:37.019 [2024-11-27 21:15:33.012440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:37.019 [2024-11-27 21:15:33.012508] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:37.019 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.019 [2024-11-27 21:15:33.079655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:37.019 [2024-11-27 21:15:33.201779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:37.019 [2024-11-27 21:15:33.201962] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:37.019 [2024-11-27 21:15:33.201981] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:37.019 [2024-11-27 21:15:33.201994] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:37.019 [2024-11-27 21:15:33.202147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:37.019 [2024-11-27 21:15:33.202274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:37.019 [2024-11-27 21:15:33.202277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:37.953 21:15:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.953 21:15:34 -- common/autotest_common.sh@862 -- # return 0 00:25:37.953 21:15:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:37.953 21:15:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.953 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:25:37.953 21:15:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:37.953 21:15:34 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:38.210 [2024-11-27 21:15:34.274876] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:38.210 21:15:34 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:38.469 Malloc0 00:25:38.469 21:15:34 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:38.727 21:15:34 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:38.985 21:15:35 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:39.242 [2024-11-27 21:15:35.317009] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:39.242 21:15:35 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:39.500 [2024-11-27 21:15:35.565721] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:39.500 21:15:35 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:39.758 [2024-11-27 21:15:35.822634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:39.758 21:15:35 -- host/failover.sh@31 -- # bdevperf_pid=4082498 00:25:39.758 21:15:35 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:39.758 21:15:35 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:39.758 21:15:35 -- host/failover.sh@34 -- # waitforlisten 4082498 /var/tmp/bdevperf.sock 00:25:39.758 21:15:35 -- common/autotest_common.sh@829 -- # '[' -z 4082498 ']' 00:25:39.758 21:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:39.758 21:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:39.758 21:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:39.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:39.758 21:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:39.758 21:15:35 -- common/autotest_common.sh@10 -- # set +x 00:25:40.692 21:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:40.692 21:15:36 -- common/autotest_common.sh@862 -- # return 0 00:25:40.692 21:15:36 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:40.949 NVMe0n1 00:25:40.949 21:15:37 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:41.515 00:25:41.515 21:15:37 -- host/failover.sh@39 -- # run_test_pid=4082772 00:25:41.515 21:15:37 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:41.515 21:15:37 -- host/failover.sh@41 -- # sleep 1 00:25:42.450 21:15:38 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:42.708 [2024-11-27 21:15:38.898770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.898994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.899006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.899018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.899030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.899042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.708 [2024-11-27 21:15:38.899053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 [2024-11-27 21:15:38.899275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x923cb0 is same with the state(5) to be set 00:25:42.709 21:15:38 -- host/failover.sh@45 -- # sleep 3 00:25:45.989 21:15:41 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.248 00:25:46.248 21:15:42 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:46.506 [2024-11-27 21:15:42.559699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.506 [2024-11-27 21:15:42.559857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.559988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 [2024-11-27 21:15:42.560367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9253a0 is same with the state(5) to be set 00:25:46.507 21:15:42 -- host/failover.sh@50 -- # sleep 3 00:25:49.788 21:15:45 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:49.789 [2024-11-27 21:15:45.869648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:49.789 21:15:45 -- host/failover.sh@55 -- # sleep 1 00:25:50.723 21:15:46 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:50.981 [2024-11-27 21:15:47.136945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.981 [2024-11-27 21:15:47.137232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 [2024-11-27 21:15:47.137695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x925a80 is same with the state(5) to be set 00:25:50.982 21:15:47 -- host/failover.sh@59 -- # wait 4082772 00:25:57.552 0 00:25:57.552 21:15:52 -- host/failover.sh@61 -- # killprocess 4082498 00:25:57.552 21:15:52 -- common/autotest_common.sh@936 -- # '[' -z 4082498 ']' 00:25:57.552 21:15:52 -- common/autotest_common.sh@940 -- # kill -0 4082498 00:25:57.552 21:15:52 -- common/autotest_common.sh@941 -- # uname 00:25:57.552 21:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:57.552 21:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4082498 00:25:57.552 21:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:57.552 21:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:57.552 21:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4082498' 00:25:57.552 killing process with pid 4082498 00:25:57.552 21:15:52 -- common/autotest_common.sh@955 -- # kill 4082498 00:25:57.552 21:15:52 -- common/autotest_common.sh@960 -- # wait 4082498 00:25:57.552 21:15:53 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:57.552 [2024-11-27 21:15:35.878596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:57.552 [2024-11-27 21:15:35.878684] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4082498 ] 00:25:57.552 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.552 [2024-11-27 21:15:35.942587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:57.552 [2024-11-27 21:15:36.052444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:57.552 Running I/O for 15 seconds... 00:25:57.552 [2024-11-27 21:15:38.899648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.899972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.899987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.552 [2024-11-27 21:15:38.900481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.552 [2024-11-27 21:15:38.900494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.900951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.900979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.900994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.553 [2024-11-27 21:15:38.901649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.553 [2024-11-27 21:15:38.901663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.553 [2024-11-27 21:15:38.901676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:116688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:116696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.901931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.901960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.901974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.901988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:116744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:116784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:116792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:116800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:116816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.554 [2024-11-27 21:15:38.902759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.554 [2024-11-27 21:15:38.902773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.554 [2024-11-27 21:15:38.902787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.902814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.902842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.902870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:116856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.555 [2024-11-27 21:15:38.902897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.555 [2024-11-27 21:15:38.902925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.902956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.902971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.902985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:116888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.555 [2024-11-27 21:15:38.903013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:116936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.555 [2024-11-27 21:15:38.903182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:38.903384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aba6a0 is same with the state(5) to be set 00:25:57.555 [2024-11-27 21:15:38.903416] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:57.555 [2024-11-27 21:15:38.903427] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:57.555 [2024-11-27 21:15:38.903438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116432 len:8 PRP1 0x0 PRP2 0x0 00:25:57.555 [2024-11-27 21:15:38.903451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903520] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1aba6a0 was disconnected and freed. reset controller. 00:25:57.555 [2024-11-27 21:15:38.903554] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:57.555 [2024-11-27 21:15:38.903593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.555 [2024-11-27 21:15:38.903611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.555 [2024-11-27 21:15:38.903639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.555 [2024-11-27 21:15:38.903665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.555 [2024-11-27 21:15:38.903690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:38.903703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:57.555 [2024-11-27 21:15:38.905920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:57.555 [2024-11-27 21:15:38.905959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a9b870 (9): Bad file descriptor 00:25:57.555 [2024-11-27 21:15:38.938496] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:57.555 [2024-11-27 21:15:42.560503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:107552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:107560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:107568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:107584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:107592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:107600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:107608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:107616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.555 [2024-11-27 21:15:42.560803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.555 [2024-11-27 21:15:42.560819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:107632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.560832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.560863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:107648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.560876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.560891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:107680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.560904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.560918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:107688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.560930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.560945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:107128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.560958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.560972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:107144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.560989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:107160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:107184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:107192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:107200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:107232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:107280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:107696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:107704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:107712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:107720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:107728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:107736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:107744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:107752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:107760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:107768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:107776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:107784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:107792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:107800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:107808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:107816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:107824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:107832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:107840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.556 [2024-11-27 21:15:42.561713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:107848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:107856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.556 [2024-11-27 21:15:42.561774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.556 [2024-11-27 21:15:42.561789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:107864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.561802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:107872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.561846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:107880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.561874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:107888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.561901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:107288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.561928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:107304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.561956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:107312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.561983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.561997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:107320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:107328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:107336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:107360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:107376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:107896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:107904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:107912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:107920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:107928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:107936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:107944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:107952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:107960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:107968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:107976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:107984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:107992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:108000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:108008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:108016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:108024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:108032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:108040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:108048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:108056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:108064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:108072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:108080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.557 [2024-11-27 21:15:42.562843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:108088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:108096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:108104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.557 [2024-11-27 21:15:42.562940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:108112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.557 [2024-11-27 21:15:42.562958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.562973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:108120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.562986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:107392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:107400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:107472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:107480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:107488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:107496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:107504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:107528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:108128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:108136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:108144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:108152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:108160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:108168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:108176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:108184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:108192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:108200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:108208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:108216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:108224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:108232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:108240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:108248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:108256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:108264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:108272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:108280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:108288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:108296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:108304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:108312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:108320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.563916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:108328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:108336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.558 [2024-11-27 21:15:42.563972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.563987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:108344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.564001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.564015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:108352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.564028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.558 [2024-11-27 21:15:42.564043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:108360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.558 [2024-11-27 21:15:42.564056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:107536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:107544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:107576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:107624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:107640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:107656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:107664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:42.564252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac7c90 is same with the state(5) to be set 00:25:57.559 [2024-11-27 21:15:42.564288] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:57.559 [2024-11-27 21:15:42.564299] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:57.559 [2024-11-27 21:15:42.564311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:107672 len:8 PRP1 0x0 PRP2 0x0 00:25:57.559 [2024-11-27 21:15:42.564324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564391] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ac7c90 was disconnected and freed. reset controller. 00:25:57.559 [2024-11-27 21:15:42.564410] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:57.559 [2024-11-27 21:15:42.564445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.559 [2024-11-27 21:15:42.564463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564479] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.559 [2024-11-27 21:15:42.564491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.559 [2024-11-27 21:15:42.564517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.559 [2024-11-27 21:15:42.564552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:42.564565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:57.559 [2024-11-27 21:15:42.564620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a9b870 (9): Bad file descriptor 00:25:57.559 [2024-11-27 21:15:42.566772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:57.559 [2024-11-27 21:15:42.601924] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:57.559 [2024-11-27 21:15:47.137836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:68648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.137880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.137911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:68672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.137927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.137944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:68680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.137958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.137973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:68688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.137987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:68696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:68704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:68712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:68744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:69232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:69240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:69248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:69256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:69264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:69272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:69280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:69288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:69304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:69312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:69320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:69336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:69352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:69376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:69408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.559 [2024-11-27 21:15:47.138575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:69424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.559 [2024-11-27 21:15:47.138587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:69448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:69456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:68768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:68776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:68808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:68824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:68832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:68840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:68856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:68872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:69480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:69504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.138953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:69512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.560 [2024-11-27 21:15:47.138980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.138994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:69520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:69528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:69536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:69544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.560 [2024-11-27 21:15:47.139087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:69552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:69560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.560 [2024-11-27 21:15:47.139146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:69568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:69576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:69584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:68880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:68904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:68928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:68936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:68952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:68968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:69000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:69008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:69592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:69600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:69608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:69616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.560 [2024-11-27 21:15:47.139580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:69624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.560 [2024-11-27 21:15:47.139608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:69632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:69640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:69024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:69048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.560 [2024-11-27 21:15:47.139719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.560 [2024-11-27 21:15:47.139734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:69064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:69072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:69080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:69096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:69104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:69112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:69648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:69656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.561 [2024-11-27 21:15:47.139961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.139975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:69664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.139987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:69672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:69680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:69688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:69696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:69704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:69712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.561 [2024-11-27 21:15:47.140149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:69720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:69728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:69736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.561 [2024-11-27 21:15:47.140236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:69744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:69752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:69760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.561 [2024-11-27 21:15:47.140317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:69768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:69776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:69784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:69128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:69136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:69152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:69160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:69176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:69184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:69192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:69208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:69792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.561 [2024-11-27 21:15:47.140671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.561 [2024-11-27 21:15:47.140686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:69800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.561 [2024-11-27 21:15:47.140700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:69808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.140728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:69816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.140756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:69824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.140783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:69224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:69296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:69328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:69344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:69360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:69368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:69384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.140983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.140998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:69392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:69832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:69840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:69848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:69856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.141121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:69864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:69872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.141185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:69880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:69888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:69896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:69904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.141300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:69912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:69920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:57.562 [2024-11-27 21:15:47.141356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:69400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:69416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:69432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:69440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:69464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:69472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:69488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:57.562 [2024-11-27 21:15:47.141557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aa7d10 is same with the state(5) to be set 00:25:57.562 [2024-11-27 21:15:47.141589] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:57.562 [2024-11-27 21:15:47.141600] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:57.562 [2024-11-27 21:15:47.141611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:69496 len:8 PRP1 0x0 PRP2 0x0 00:25:57.562 [2024-11-27 21:15:47.141623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141690] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1aa7d10 was disconnected and freed. reset controller. 00:25:57.562 [2024-11-27 21:15:47.141709] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:57.562 [2024-11-27 21:15:47.141749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.562 [2024-11-27 21:15:47.141767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141782] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.562 [2024-11-27 21:15:47.141795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.562 [2024-11-27 21:15:47.141808] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.563 [2024-11-27 21:15:47.141820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.563 [2024-11-27 21:15:47.141833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:57.563 [2024-11-27 21:15:47.141845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:57.563 [2024-11-27 21:15:47.141858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:57.563 [2024-11-27 21:15:47.141911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a9b870 (9): Bad file descriptor 00:25:57.563 [2024-11-27 21:15:47.144129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:57.563 [2024-11-27 21:15:47.173665] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:57.563 00:25:57.563 Latency(us) 00:25:57.563 [2024-11-27T20:15:53.804Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:57.563 [2024-11-27T20:15:53.804Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:57.563 Verification LBA range: start 0x0 length 0x4000 00:25:57.563 NVMe0n1 : 15.01 12241.94 47.82 359.05 0.00 10140.76 731.21 15340.28 00:25:57.563 [2024-11-27T20:15:53.804Z] =================================================================================================================== 00:25:57.563 [2024-11-27T20:15:53.804Z] Total : 12241.94 47.82 359.05 0.00 10140.76 731.21 15340.28 00:25:57.563 Received shutdown signal, test time was about 15.000000 seconds 00:25:57.563 00:25:57.563 Latency(us) 00:25:57.563 [2024-11-27T20:15:53.804Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:57.563 [2024-11-27T20:15:53.804Z] =================================================================================================================== 00:25:57.563 [2024-11-27T20:15:53.804Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:57.563 21:15:53 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:57.563 21:15:53 -- host/failover.sh@65 -- # count=3 00:25:57.563 21:15:53 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:57.563 21:15:53 -- host/failover.sh@73 -- # bdevperf_pid=4084665 00:25:57.563 21:15:53 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:57.563 21:15:53 -- host/failover.sh@75 -- # waitforlisten 4084665 /var/tmp/bdevperf.sock 00:25:57.563 21:15:53 -- common/autotest_common.sh@829 -- # '[' -z 4084665 ']' 00:25:57.563 21:15:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:57.563 21:15:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:57.563 21:15:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:57.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:57.563 21:15:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:57.563 21:15:53 -- common/autotest_common.sh@10 -- # set +x 00:25:58.130 21:15:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:58.130 21:15:54 -- common/autotest_common.sh@862 -- # return 0 00:25:58.130 21:15:54 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:58.427 [2024-11-27 21:15:54.388160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:58.427 21:15:54 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:58.427 [2024-11-27 21:15:54.636865] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:58.710 21:15:54 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:58.968 NVMe0n1 00:25:58.968 21:15:55 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:59.226 00:25:59.226 21:15:55 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:59.484 00:25:59.742 21:15:55 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:59.742 21:15:55 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:00.000 21:15:55 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:00.000 21:15:56 -- host/failover.sh@87 -- # sleep 3 00:26:03.281 21:15:59 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.281 21:15:59 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:03.281 21:15:59 -- host/failover.sh@90 -- # run_test_pid=4085372 00:26:03.281 21:15:59 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:03.281 21:15:59 -- host/failover.sh@92 -- # wait 4085372 00:26:04.656 0 00:26:04.656 21:16:00 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:04.656 [2024-11-27 21:15:53.174016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:04.656 [2024-11-27 21:15:53.174104] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4084665 ] 00:26:04.656 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.656 [2024-11-27 21:15:53.234590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.656 [2024-11-27 21:15:53.339425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:04.656 [2024-11-27 21:15:56.210616] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:04.656 [2024-11-27 21:15:56.210689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:04.656 [2024-11-27 21:15:56.210713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:04.656 [2024-11-27 21:15:56.210730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:04.656 [2024-11-27 21:15:56.210744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:04.656 [2024-11-27 21:15:56.210758] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:04.656 [2024-11-27 21:15:56.210772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:04.656 [2024-11-27 21:15:56.210785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:04.656 [2024-11-27 21:15:56.210798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:04.656 [2024-11-27 21:15:56.210822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.656 [2024-11-27 21:15:56.210858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.656 [2024-11-27 21:15:56.210898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x602870 (9): Bad file descriptor 00:26:04.656 [2024-11-27 21:15:56.302676] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:04.656 Running I/O for 1 seconds... 00:26:04.656 00:26:04.656 Latency(us) 00:26:04.656 [2024-11-27T20:16:00.897Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:04.656 [2024-11-27T20:16:00.897Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:04.656 Verification LBA range: start 0x0 length 0x4000 00:26:04.656 NVMe0n1 : 1.01 12735.70 49.75 0.00 0.00 10005.00 1426.01 15631.55 00:26:04.656 [2024-11-27T20:16:00.897Z] =================================================================================================================== 00:26:04.656 [2024-11-27T20:16:00.897Z] Total : 12735.70 49.75 0.00 0.00 10005.00 1426.01 15631.55 00:26:04.656 21:16:00 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:04.656 21:16:00 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:04.656 21:16:00 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.913 21:16:01 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:04.913 21:16:01 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:05.169 21:16:01 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:05.427 21:16:01 -- host/failover.sh@101 -- # sleep 3 00:26:08.706 21:16:04 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:08.706 21:16:04 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:08.706 21:16:04 -- host/failover.sh@108 -- # killprocess 4084665 00:26:08.706 21:16:04 -- common/autotest_common.sh@936 -- # '[' -z 4084665 ']' 00:26:08.706 21:16:04 -- common/autotest_common.sh@940 -- # kill -0 4084665 00:26:08.706 21:16:04 -- common/autotest_common.sh@941 -- # uname 00:26:08.706 21:16:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:08.706 21:16:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4084665 00:26:08.706 21:16:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:08.706 21:16:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:08.706 21:16:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4084665' 00:26:08.706 killing process with pid 4084665 00:26:08.706 21:16:04 -- common/autotest_common.sh@955 -- # kill 4084665 00:26:08.706 21:16:04 -- common/autotest_common.sh@960 -- # wait 4084665 00:26:08.963 21:16:05 -- host/failover.sh@110 -- # sync 00:26:09.221 21:16:05 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:09.478 21:16:05 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:09.478 21:16:05 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:09.478 21:16:05 -- host/failover.sh@116 -- # nvmftestfini 00:26:09.478 21:16:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:09.478 21:16:05 -- nvmf/common.sh@116 -- # sync 00:26:09.478 21:16:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:09.478 21:16:05 -- nvmf/common.sh@119 -- # set +e 00:26:09.478 21:16:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:09.479 21:16:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:09.479 rmmod nvme_tcp 00:26:09.479 rmmod nvme_fabrics 00:26:09.479 rmmod nvme_keyring 00:26:09.479 21:16:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:09.479 21:16:05 -- nvmf/common.sh@123 -- # set -e 00:26:09.479 21:16:05 -- nvmf/common.sh@124 -- # return 0 00:26:09.479 21:16:05 -- nvmf/common.sh@477 -- # '[' -n 4082197 ']' 00:26:09.479 21:16:05 -- nvmf/common.sh@478 -- # killprocess 4082197 00:26:09.479 21:16:05 -- common/autotest_common.sh@936 -- # '[' -z 4082197 ']' 00:26:09.479 21:16:05 -- common/autotest_common.sh@940 -- # kill -0 4082197 00:26:09.479 21:16:05 -- common/autotest_common.sh@941 -- # uname 00:26:09.479 21:16:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:09.479 21:16:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4082197 00:26:09.479 21:16:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:09.479 21:16:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:09.479 21:16:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4082197' 00:26:09.479 killing process with pid 4082197 00:26:09.479 21:16:05 -- common/autotest_common.sh@955 -- # kill 4082197 00:26:09.479 21:16:05 -- common/autotest_common.sh@960 -- # wait 4082197 00:26:09.737 21:16:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:09.737 21:16:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:09.737 21:16:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:09.737 21:16:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:09.737 21:16:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:09.737 21:16:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:09.737 21:16:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:09.737 21:16:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:12.266 21:16:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:12.266 00:26:12.266 real 0m37.122s 00:26:12.266 user 2m10.981s 00:26:12.266 sys 0m6.236s 00:26:12.266 21:16:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:12.266 21:16:07 -- common/autotest_common.sh@10 -- # set +x 00:26:12.266 ************************************ 00:26:12.266 END TEST nvmf_failover 00:26:12.266 ************************************ 00:26:12.266 21:16:07 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:12.266 21:16:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:12.266 21:16:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:12.266 21:16:07 -- common/autotest_common.sh@10 -- # set +x 00:26:12.266 ************************************ 00:26:12.266 START TEST nvmf_discovery 00:26:12.266 ************************************ 00:26:12.266 21:16:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:12.266 * Looking for test storage... 00:26:12.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:12.266 21:16:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:12.266 21:16:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:12.266 21:16:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:12.266 21:16:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:12.266 21:16:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:12.266 21:16:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:12.266 21:16:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:12.266 21:16:08 -- scripts/common.sh@335 -- # IFS=.-: 00:26:12.266 21:16:08 -- scripts/common.sh@335 -- # read -ra ver1 00:26:12.266 21:16:08 -- scripts/common.sh@336 -- # IFS=.-: 00:26:12.266 21:16:08 -- scripts/common.sh@336 -- # read -ra ver2 00:26:12.266 21:16:08 -- scripts/common.sh@337 -- # local 'op=<' 00:26:12.266 21:16:08 -- scripts/common.sh@339 -- # ver1_l=2 00:26:12.266 21:16:08 -- scripts/common.sh@340 -- # ver2_l=1 00:26:12.266 21:16:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:12.266 21:16:08 -- scripts/common.sh@343 -- # case "$op" in 00:26:12.266 21:16:08 -- scripts/common.sh@344 -- # : 1 00:26:12.266 21:16:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:12.266 21:16:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:12.266 21:16:08 -- scripts/common.sh@364 -- # decimal 1 00:26:12.266 21:16:08 -- scripts/common.sh@352 -- # local d=1 00:26:12.266 21:16:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:12.266 21:16:08 -- scripts/common.sh@354 -- # echo 1 00:26:12.266 21:16:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:12.266 21:16:08 -- scripts/common.sh@365 -- # decimal 2 00:26:12.266 21:16:08 -- scripts/common.sh@352 -- # local d=2 00:26:12.266 21:16:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:12.266 21:16:08 -- scripts/common.sh@354 -- # echo 2 00:26:12.266 21:16:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:12.266 21:16:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:12.266 21:16:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:12.266 21:16:08 -- scripts/common.sh@367 -- # return 0 00:26:12.266 21:16:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:12.266 21:16:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:12.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.266 --rc genhtml_branch_coverage=1 00:26:12.266 --rc genhtml_function_coverage=1 00:26:12.266 --rc genhtml_legend=1 00:26:12.266 --rc geninfo_all_blocks=1 00:26:12.266 --rc geninfo_unexecuted_blocks=1 00:26:12.266 00:26:12.266 ' 00:26:12.266 21:16:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:12.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.266 --rc genhtml_branch_coverage=1 00:26:12.266 --rc genhtml_function_coverage=1 00:26:12.266 --rc genhtml_legend=1 00:26:12.266 --rc geninfo_all_blocks=1 00:26:12.266 --rc geninfo_unexecuted_blocks=1 00:26:12.266 00:26:12.266 ' 00:26:12.266 21:16:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:12.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.266 --rc genhtml_branch_coverage=1 00:26:12.266 --rc genhtml_function_coverage=1 00:26:12.266 --rc genhtml_legend=1 00:26:12.266 --rc geninfo_all_blocks=1 00:26:12.266 --rc geninfo_unexecuted_blocks=1 00:26:12.266 00:26:12.266 ' 00:26:12.266 21:16:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:12.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:12.266 --rc genhtml_branch_coverage=1 00:26:12.266 --rc genhtml_function_coverage=1 00:26:12.266 --rc genhtml_legend=1 00:26:12.266 --rc geninfo_all_blocks=1 00:26:12.266 --rc geninfo_unexecuted_blocks=1 00:26:12.266 00:26:12.266 ' 00:26:12.266 21:16:08 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:12.266 21:16:08 -- nvmf/common.sh@7 -- # uname -s 00:26:12.266 21:16:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:12.266 21:16:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:12.266 21:16:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:12.266 21:16:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:12.266 21:16:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:12.266 21:16:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:12.266 21:16:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:12.266 21:16:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:12.266 21:16:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:12.266 21:16:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:12.266 21:16:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:12.266 21:16:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:12.266 21:16:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:12.266 21:16:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:12.266 21:16:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:12.266 21:16:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:12.266 21:16:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:12.266 21:16:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:12.266 21:16:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:12.266 21:16:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.266 21:16:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.266 21:16:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.266 21:16:08 -- paths/export.sh@5 -- # export PATH 00:26:12.266 21:16:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.266 21:16:08 -- nvmf/common.sh@46 -- # : 0 00:26:12.266 21:16:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:12.266 21:16:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:12.266 21:16:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:12.266 21:16:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:12.266 21:16:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:12.266 21:16:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:12.266 21:16:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:12.266 21:16:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:12.266 21:16:08 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:12.266 21:16:08 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:12.267 21:16:08 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:12.267 21:16:08 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:12.267 21:16:08 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:12.267 21:16:08 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:12.267 21:16:08 -- host/discovery.sh@25 -- # nvmftestinit 00:26:12.267 21:16:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:12.267 21:16:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:12.267 21:16:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:12.267 21:16:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:12.267 21:16:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:12.267 21:16:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.267 21:16:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.267 21:16:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:12.267 21:16:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:12.267 21:16:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:12.267 21:16:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:12.267 21:16:08 -- common/autotest_common.sh@10 -- # set +x 00:26:14.167 21:16:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:14.167 21:16:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:14.167 21:16:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:14.167 21:16:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:14.167 21:16:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:14.167 21:16:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:14.167 21:16:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:14.167 21:16:10 -- nvmf/common.sh@294 -- # net_devs=() 00:26:14.167 21:16:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:14.167 21:16:10 -- nvmf/common.sh@295 -- # e810=() 00:26:14.167 21:16:10 -- nvmf/common.sh@295 -- # local -ga e810 00:26:14.167 21:16:10 -- nvmf/common.sh@296 -- # x722=() 00:26:14.167 21:16:10 -- nvmf/common.sh@296 -- # local -ga x722 00:26:14.167 21:16:10 -- nvmf/common.sh@297 -- # mlx=() 00:26:14.167 21:16:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:14.167 21:16:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:14.167 21:16:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:14.167 21:16:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:14.167 21:16:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.167 21:16:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:14.167 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:14.167 21:16:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:14.167 21:16:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:14.167 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:14.167 21:16:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.167 21:16:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.167 21:16:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.167 21:16:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:14.167 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:14.167 21:16:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.167 21:16:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:14.167 21:16:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:14.167 21:16:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:14.167 21:16:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:14.167 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:14.167 21:16:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:14.167 21:16:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:14.167 21:16:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:14.167 21:16:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:14.167 21:16:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:14.167 21:16:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:14.167 21:16:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:14.167 21:16:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:14.167 21:16:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:14.167 21:16:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:14.167 21:16:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:14.167 21:16:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:14.167 21:16:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:14.167 21:16:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:14.167 21:16:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:14.167 21:16:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:14.167 21:16:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:14.167 21:16:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:14.167 21:16:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:14.167 21:16:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:14.167 21:16:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:14.167 21:16:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:14.167 21:16:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:14.167 21:16:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:14.167 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:14.167 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:26:14.167 00:26:14.167 --- 10.0.0.2 ping statistics --- 00:26:14.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:14.168 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:26:14.168 21:16:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:14.168 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:14.168 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:26:14.168 00:26:14.168 --- 10.0.0.1 ping statistics --- 00:26:14.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:14.168 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:26:14.168 21:16:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:14.168 21:16:10 -- nvmf/common.sh@410 -- # return 0 00:26:14.168 21:16:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:14.168 21:16:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:14.168 21:16:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:14.168 21:16:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:14.168 21:16:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:14.168 21:16:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:14.168 21:16:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:14.168 21:16:10 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:14.168 21:16:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:14.168 21:16:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:14.168 21:16:10 -- common/autotest_common.sh@10 -- # set +x 00:26:14.168 21:16:10 -- nvmf/common.sh@469 -- # nvmfpid=4088126 00:26:14.168 21:16:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:14.168 21:16:10 -- nvmf/common.sh@470 -- # waitforlisten 4088126 00:26:14.168 21:16:10 -- common/autotest_common.sh@829 -- # '[' -z 4088126 ']' 00:26:14.168 21:16:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:14.168 21:16:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:14.168 21:16:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:14.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:14.168 21:16:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:14.168 21:16:10 -- common/autotest_common.sh@10 -- # set +x 00:26:14.168 [2024-11-27 21:16:10.223961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:14.168 [2024-11-27 21:16:10.224037] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:14.168 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.168 [2024-11-27 21:16:10.292592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:14.426 [2024-11-27 21:16:10.411229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:14.426 [2024-11-27 21:16:10.411389] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:14.426 [2024-11-27 21:16:10.411409] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:14.426 [2024-11-27 21:16:10.411423] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:14.426 [2024-11-27 21:16:10.411454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:14.993 21:16:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:14.993 21:16:11 -- common/autotest_common.sh@862 -- # return 0 00:26:14.993 21:16:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:14.993 21:16:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:14.993 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:14.993 21:16:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:14.993 21:16:11 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:14.993 21:16:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.993 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:14.993 [2024-11-27 21:16:11.227474] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:14.993 21:16:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.993 21:16:11 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:14.993 21:16:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.993 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.251 [2024-11-27 21:16:11.235691] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:15.251 21:16:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.251 21:16:11 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:15.251 21:16:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.251 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.251 null0 00:26:15.251 21:16:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.251 21:16:11 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:15.251 21:16:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.251 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.251 null1 00:26:15.251 21:16:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.251 21:16:11 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:15.251 21:16:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.251 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.251 21:16:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.251 21:16:11 -- host/discovery.sh@45 -- # hostpid=4088281 00:26:15.251 21:16:11 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:15.251 21:16:11 -- host/discovery.sh@46 -- # waitforlisten 4088281 /tmp/host.sock 00:26:15.251 21:16:11 -- common/autotest_common.sh@829 -- # '[' -z 4088281 ']' 00:26:15.251 21:16:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:15.251 21:16:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:15.251 21:16:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:15.251 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:15.251 21:16:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:15.251 21:16:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.251 [2024-11-27 21:16:11.306924] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:15.251 [2024-11-27 21:16:11.307002] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4088281 ] 00:26:15.251 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.251 [2024-11-27 21:16:11.373576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:15.251 [2024-11-27 21:16:11.489139] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:15.251 [2024-11-27 21:16:11.489318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:16.187 21:16:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:16.187 21:16:12 -- common/autotest_common.sh@862 -- # return 0 00:26:16.187 21:16:12 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:16.187 21:16:12 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:16.187 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.187 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.187 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.187 21:16:12 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:16.187 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.187 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.187 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.187 21:16:12 -- host/discovery.sh@72 -- # notify_id=0 00:26:16.187 21:16:12 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:16.187 21:16:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.187 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.187 21:16:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.187 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.187 21:16:12 -- host/discovery.sh@59 -- # sort 00:26:16.187 21:16:12 -- host/discovery.sh@59 -- # xargs 00:26:16.187 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.187 21:16:12 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:16.187 21:16:12 -- host/discovery.sh@79 -- # get_bdev_list 00:26:16.187 21:16:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.187 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.187 21:16:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.187 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.187 21:16:12 -- host/discovery.sh@55 -- # sort 00:26:16.187 21:16:12 -- host/discovery.sh@55 -- # xargs 00:26:16.187 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@83 -- # get_bdev_list 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@87 -- # get_bdev_list 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 [2024-11-27 21:16:12.623551] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@59 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.445 21:16:12 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:16.445 21:16:12 -- host/discovery.sh@93 -- # get_bdev_list 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.445 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.445 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # sort 00:26:16.445 21:16:12 -- host/discovery.sh@55 -- # xargs 00:26:16.445 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.703 21:16:12 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:16.703 21:16:12 -- host/discovery.sh@94 -- # get_notification_count 00:26:16.703 21:16:12 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:16.703 21:16:12 -- host/discovery.sh@74 -- # jq '. | length' 00:26:16.703 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.703 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.703 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.703 21:16:12 -- host/discovery.sh@74 -- # notification_count=0 00:26:16.703 21:16:12 -- host/discovery.sh@75 -- # notify_id=0 00:26:16.703 21:16:12 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:16.703 21:16:12 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:16.703 21:16:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.703 21:16:12 -- common/autotest_common.sh@10 -- # set +x 00:26:16.703 21:16:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.703 21:16:12 -- host/discovery.sh@100 -- # sleep 1 00:26:17.268 [2024-11-27 21:16:13.396688] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:17.268 [2024-11-27 21:16:13.396718] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:17.268 [2024-11-27 21:16:13.396753] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:17.268 [2024-11-27 21:16:13.484055] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:17.526 [2024-11-27 21:16:13.547737] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:17.526 [2024-11-27 21:16:13.547760] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:17.526 21:16:13 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:17.526 21:16:13 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:17.526 21:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.526 21:16:13 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:17.526 21:16:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.526 21:16:13 -- host/discovery.sh@59 -- # sort 00:26:17.526 21:16:13 -- host/discovery.sh@59 -- # xargs 00:26:17.784 21:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.784 21:16:13 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:17.784 21:16:13 -- host/discovery.sh@102 -- # get_bdev_list 00:26:17.784 21:16:13 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:17.784 21:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.784 21:16:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.785 21:16:13 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:17.785 21:16:13 -- host/discovery.sh@55 -- # sort 00:26:17.785 21:16:13 -- host/discovery.sh@55 -- # xargs 00:26:17.785 21:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:17.785 21:16:13 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:17.785 21:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.785 21:16:13 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:17.785 21:16:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.785 21:16:13 -- host/discovery.sh@63 -- # sort -n 00:26:17.785 21:16:13 -- host/discovery.sh@63 -- # xargs 00:26:17.785 21:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@104 -- # get_notification_count 00:26:17.785 21:16:13 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:17.785 21:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.785 21:16:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.785 21:16:13 -- host/discovery.sh@74 -- # jq '. | length' 00:26:17.785 21:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@74 -- # notification_count=1 00:26:17.785 21:16:13 -- host/discovery.sh@75 -- # notify_id=1 00:26:17.785 21:16:13 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:17.785 21:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.785 21:16:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.785 21:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.785 21:16:13 -- host/discovery.sh@109 -- # sleep 1 00:26:18.719 21:16:14 -- host/discovery.sh@110 -- # get_bdev_list 00:26:18.719 21:16:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.719 21:16:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.719 21:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.719 21:16:14 -- host/discovery.sh@55 -- # sort 00:26:18.719 21:16:14 -- common/autotest_common.sh@10 -- # set +x 00:26:18.719 21:16:14 -- host/discovery.sh@55 -- # xargs 00:26:18.719 21:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.977 21:16:14 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:18.977 21:16:14 -- host/discovery.sh@111 -- # get_notification_count 00:26:18.977 21:16:14 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:18.977 21:16:14 -- host/discovery.sh@74 -- # jq '. | length' 00:26:18.977 21:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.977 21:16:14 -- common/autotest_common.sh@10 -- # set +x 00:26:18.977 21:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.977 21:16:15 -- host/discovery.sh@74 -- # notification_count=1 00:26:18.977 21:16:15 -- host/discovery.sh@75 -- # notify_id=2 00:26:18.977 21:16:15 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:18.977 21:16:15 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:18.977 21:16:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.977 21:16:15 -- common/autotest_common.sh@10 -- # set +x 00:26:18.977 [2024-11-27 21:16:15.022709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:18.977 [2024-11-27 21:16:15.023310] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:18.977 [2024-11-27 21:16:15.023346] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:18.977 21:16:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.977 21:16:15 -- host/discovery.sh@117 -- # sleep 1 00:26:18.977 [2024-11-27 21:16:15.110641] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:18.977 [2024-11-27 21:16:15.213317] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:18.977 [2024-11-27 21:16:15.213343] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:18.977 [2024-11-27 21:16:15.213353] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:19.909 21:16:16 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:19.909 21:16:16 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.909 21:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.909 21:16:16 -- common/autotest_common.sh@10 -- # set +x 00:26:19.909 21:16:16 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.909 21:16:16 -- host/discovery.sh@59 -- # sort 00:26:19.909 21:16:16 -- host/discovery.sh@59 -- # xargs 00:26:19.909 21:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.909 21:16:16 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:19.909 21:16:16 -- host/discovery.sh@119 -- # get_bdev_list 00:26:19.909 21:16:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.909 21:16:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.909 21:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.909 21:16:16 -- host/discovery.sh@55 -- # sort 00:26:19.909 21:16:16 -- common/autotest_common.sh@10 -- # set +x 00:26:19.909 21:16:16 -- host/discovery.sh@55 -- # xargs 00:26:19.909 21:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.909 21:16:16 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:19.909 21:16:16 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:19.909 21:16:16 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:19.909 21:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.909 21:16:16 -- common/autotest_common.sh@10 -- # set +x 00:26:19.909 21:16:16 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:19.909 21:16:16 -- host/discovery.sh@63 -- # sort -n 00:26:19.909 21:16:16 -- host/discovery.sh@63 -- # xargs 00:26:19.909 21:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.167 21:16:16 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:20.167 21:16:16 -- host/discovery.sh@121 -- # get_notification_count 00:26:20.167 21:16:16 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:20.167 21:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.167 21:16:16 -- host/discovery.sh@74 -- # jq '. | length' 00:26:20.167 21:16:16 -- common/autotest_common.sh@10 -- # set +x 00:26:20.167 21:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.167 21:16:16 -- host/discovery.sh@74 -- # notification_count=0 00:26:20.167 21:16:16 -- host/discovery.sh@75 -- # notify_id=2 00:26:20.167 21:16:16 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:20.167 21:16:16 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:20.167 21:16:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.167 21:16:16 -- common/autotest_common.sh@10 -- # set +x 00:26:20.167 [2024-11-27 21:16:16.198377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:20.167 [2024-11-27 21:16:16.198418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:20.167 [2024-11-27 21:16:16.198436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:20.167 [2024-11-27 21:16:16.198450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:20.167 [2024-11-27 21:16:16.198464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:20.167 [2024-11-27 21:16:16.198477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:20.167 [2024-11-27 21:16:16.198490] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:20.167 [2024-11-27 21:16:16.198503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:20.167 [2024-11-27 21:16:16.198517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.167 [2024-11-27 21:16:16.198657] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:20.167 [2024-11-27 21:16:16.198682] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:20.167 21:16:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.167 21:16:16 -- host/discovery.sh@127 -- # sleep 1 00:26:20.167 [2024-11-27 21:16:16.208381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.167 [2024-11-27 21:16:16.218431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.167 [2024-11-27 21:16:16.218643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.167 [2024-11-27 21:16:16.218749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.167 [2024-11-27 21:16:16.218774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.167 [2024-11-27 21:16:16.218790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.167 [2024-11-27 21:16:16.218812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.167 [2024-11-27 21:16:16.218876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.167 [2024-11-27 21:16:16.218897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.167 [2024-11-27 21:16:16.218924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.167 [2024-11-27 21:16:16.218959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.167 [2024-11-27 21:16:16.228511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.167 [2024-11-27 21:16:16.228743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.167 [2024-11-27 21:16:16.228898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.167 [2024-11-27 21:16:16.228940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.167 [2024-11-27 21:16:16.228956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.167 [2024-11-27 21:16:16.228978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.167 [2024-11-27 21:16:16.229011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.167 [2024-11-27 21:16:16.229032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.167 [2024-11-27 21:16:16.229047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.167 [2024-11-27 21:16:16.229066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.238592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.238811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.238981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.239009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.239025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.239049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.239095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.239116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.239131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.239152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.248660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.248836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.249009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.249035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.249050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.249072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.249091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.249104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.249117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.249149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.258744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.258968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.259107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.259135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.259152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.259176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.259223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.259244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.259264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.259286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.268834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.268997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.269131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.269159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.269176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.269200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.269222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.269236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.269250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.269285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.278909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.279072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.279225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.279250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.279265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.279287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.279329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.279347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.279360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.279379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.288985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.289184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.289281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.289305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.289320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.289341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.289373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.289390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.289419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.289441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.299065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.299227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.299339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.299367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.299384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.299408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.299455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.299475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.299489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.299510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.309141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.309276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.309419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.309446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.309462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.309486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.309521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.309550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.309565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.309600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.319216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:20.168 [2024-11-27 21:16:16.319412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.319536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.168 [2024-11-27 21:16:16.319565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfd9810 with addr=10.0.0.2, port=4420 00:26:20.168 [2024-11-27 21:16:16.319598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfd9810 is same with the state(5) to be set 00:26:20.168 [2024-11-27 21:16:16.319620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd9810 (9): Bad file descriptor 00:26:20.168 [2024-11-27 21:16:16.319663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:20.168 [2024-11-27 21:16:16.319681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:20.168 [2024-11-27 21:16:16.319694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:20.168 [2024-11-27 21:16:16.319713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:20.168 [2024-11-27 21:16:16.325687] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:20.168 [2024-11-27 21:16:16.325723] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:21.100 21:16:17 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:21.100 21:16:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:21.100 21:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.100 21:16:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:21.100 21:16:17 -- common/autotest_common.sh@10 -- # set +x 00:26:21.100 21:16:17 -- host/discovery.sh@59 -- # sort 00:26:21.100 21:16:17 -- host/discovery.sh@59 -- # xargs 00:26:21.100 21:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@129 -- # get_bdev_list 00:26:21.100 21:16:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:21.100 21:16:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:21.100 21:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.100 21:16:17 -- host/discovery.sh@55 -- # sort 00:26:21.100 21:16:17 -- common/autotest_common.sh@10 -- # set +x 00:26:21.100 21:16:17 -- host/discovery.sh@55 -- # xargs 00:26:21.100 21:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:21.100 21:16:17 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:21.100 21:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.100 21:16:17 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:21.100 21:16:17 -- common/autotest_common.sh@10 -- # set +x 00:26:21.100 21:16:17 -- host/discovery.sh@63 -- # sort -n 00:26:21.100 21:16:17 -- host/discovery.sh@63 -- # xargs 00:26:21.100 21:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:21.100 21:16:17 -- host/discovery.sh@131 -- # get_notification_count 00:26:21.357 21:16:17 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:21.357 21:16:17 -- host/discovery.sh@74 -- # jq '. | length' 00:26:21.357 21:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.357 21:16:17 -- common/autotest_common.sh@10 -- # set +x 00:26:21.357 21:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.357 21:16:17 -- host/discovery.sh@74 -- # notification_count=0 00:26:21.357 21:16:17 -- host/discovery.sh@75 -- # notify_id=2 00:26:21.357 21:16:17 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:21.357 21:16:17 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:21.357 21:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.357 21:16:17 -- common/autotest_common.sh@10 -- # set +x 00:26:21.357 21:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.357 21:16:17 -- host/discovery.sh@135 -- # sleep 1 00:26:22.289 21:16:18 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:22.289 21:16:18 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.289 21:16:18 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.289 21:16:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.289 21:16:18 -- host/discovery.sh@59 -- # sort 00:26:22.289 21:16:18 -- common/autotest_common.sh@10 -- # set +x 00:26:22.289 21:16:18 -- host/discovery.sh@59 -- # xargs 00:26:22.289 21:16:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.289 21:16:18 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:22.289 21:16:18 -- host/discovery.sh@137 -- # get_bdev_list 00:26:22.289 21:16:18 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.289 21:16:18 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.289 21:16:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.289 21:16:18 -- common/autotest_common.sh@10 -- # set +x 00:26:22.289 21:16:18 -- host/discovery.sh@55 -- # sort 00:26:22.289 21:16:18 -- host/discovery.sh@55 -- # xargs 00:26:22.289 21:16:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.289 21:16:18 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:22.289 21:16:18 -- host/discovery.sh@138 -- # get_notification_count 00:26:22.289 21:16:18 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:22.289 21:16:18 -- host/discovery.sh@74 -- # jq '. | length' 00:26:22.289 21:16:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.289 21:16:18 -- common/autotest_common.sh@10 -- # set +x 00:26:22.289 21:16:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.289 21:16:18 -- host/discovery.sh@74 -- # notification_count=2 00:26:22.289 21:16:18 -- host/discovery.sh@75 -- # notify_id=4 00:26:22.289 21:16:18 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:22.289 21:16:18 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.289 21:16:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.289 21:16:18 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 [2024-11-27 21:16:19.583221] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:23.662 [2024-11-27 21:16:19.583250] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:23.662 [2024-11-27 21:16:19.583276] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:23.662 [2024-11-27 21:16:19.670548] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:23.662 [2024-11-27 21:16:19.777771] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:23.662 [2024-11-27 21:16:19.777803] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.662 21:16:19 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@650 -- # local es=0 00:26:23.662 21:16:19 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.662 21:16:19 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.662 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 request: 00:26:23.662 { 00:26:23.662 "name": "nvme", 00:26:23.662 "trtype": "tcp", 00:26:23.662 "traddr": "10.0.0.2", 00:26:23.662 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:23.662 "adrfam": "ipv4", 00:26:23.662 "trsvcid": "8009", 00:26:23.662 "wait_for_attach": true, 00:26:23.662 "method": "bdev_nvme_start_discovery", 00:26:23.662 "req_id": 1 00:26:23.662 } 00:26:23.662 Got JSON-RPC error response 00:26:23.662 response: 00:26:23.662 { 00:26:23.662 "code": -17, 00:26:23.662 "message": "File exists" 00:26:23.662 } 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:23.662 21:16:19 -- common/autotest_common.sh@653 -- # es=1 00:26:23.662 21:16:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:23.662 21:16:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:23.662 21:16:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:23.662 21:16:19 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:23.662 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:23.662 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # sort 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # xargs 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.662 21:16:19 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:23.662 21:16:19 -- host/discovery.sh@147 -- # get_bdev_list 00:26:23.662 21:16:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.662 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.662 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 21:16:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.662 21:16:19 -- host/discovery.sh@55 -- # sort 00:26:23.662 21:16:19 -- host/discovery.sh@55 -- # xargs 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.662 21:16:19 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.662 21:16:19 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@650 -- # local es=0 00:26:23.662 21:16:19 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:23.662 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.662 21:16:19 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:23.662 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.662 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 request: 00:26:23.662 { 00:26:23.662 "name": "nvme_second", 00:26:23.662 "trtype": "tcp", 00:26:23.662 "traddr": "10.0.0.2", 00:26:23.662 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:23.662 "adrfam": "ipv4", 00:26:23.662 "trsvcid": "8009", 00:26:23.662 "wait_for_attach": true, 00:26:23.662 "method": "bdev_nvme_start_discovery", 00:26:23.662 "req_id": 1 00:26:23.662 } 00:26:23.662 Got JSON-RPC error response 00:26:23.662 response: 00:26:23.662 { 00:26:23.662 "code": -17, 00:26:23.662 "message": "File exists" 00:26:23.662 } 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:23.662 21:16:19 -- common/autotest_common.sh@653 -- # es=1 00:26:23.662 21:16:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:23.662 21:16:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:23.662 21:16:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:23.662 21:16:19 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:23.662 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.662 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # sort 00:26:23.662 21:16:19 -- host/discovery.sh@67 -- # xargs 00:26:23.662 21:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.920 21:16:19 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:23.920 21:16:19 -- host/discovery.sh@153 -- # get_bdev_list 00:26:23.920 21:16:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.920 21:16:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.920 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.920 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:23.920 21:16:19 -- host/discovery.sh@55 -- # sort 00:26:23.920 21:16:19 -- host/discovery.sh@55 -- # xargs 00:26:23.920 21:16:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.920 21:16:19 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:23.920 21:16:19 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:23.920 21:16:19 -- common/autotest_common.sh@650 -- # local es=0 00:26:23.920 21:16:19 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:23.920 21:16:19 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:23.920 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.920 21:16:19 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:23.920 21:16:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:23.920 21:16:19 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:23.920 21:16:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.920 21:16:19 -- common/autotest_common.sh@10 -- # set +x 00:26:24.852 [2024-11-27 21:16:20.973201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.852 [2024-11-27 21:16:20.973372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.852 [2024-11-27 21:16:20.973411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfe50a0 with addr=10.0.0.2, port=8010 00:26:24.852 [2024-11-27 21:16:20.973443] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:24.852 [2024-11-27 21:16:20.973459] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:24.852 [2024-11-27 21:16:20.973474] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:25.785 [2024-11-27 21:16:21.975626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.785 [2024-11-27 21:16:21.975748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:25.785 [2024-11-27 21:16:21.975775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xfe50a0 with addr=10.0.0.2, port=8010 00:26:25.785 [2024-11-27 21:16:21.975794] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:25.785 [2024-11-27 21:16:21.975807] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:25.785 [2024-11-27 21:16:21.975819] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:27.158 [2024-11-27 21:16:22.977877] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:27.158 request: 00:26:27.158 { 00:26:27.158 "name": "nvme_second", 00:26:27.158 "trtype": "tcp", 00:26:27.158 "traddr": "10.0.0.2", 00:26:27.159 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:27.159 "adrfam": "ipv4", 00:26:27.159 "trsvcid": "8010", 00:26:27.159 "attach_timeout_ms": 3000, 00:26:27.159 "method": "bdev_nvme_start_discovery", 00:26:27.159 "req_id": 1 00:26:27.159 } 00:26:27.159 Got JSON-RPC error response 00:26:27.159 response: 00:26:27.159 { 00:26:27.159 "code": -110, 00:26:27.159 "message": "Connection timed out" 00:26:27.159 } 00:26:27.159 21:16:22 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:27.159 21:16:22 -- common/autotest_common.sh@653 -- # es=1 00:26:27.159 21:16:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:27.159 21:16:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:27.159 21:16:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:27.159 21:16:22 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:27.159 21:16:22 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:27.159 21:16:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.159 21:16:22 -- common/autotest_common.sh@10 -- # set +x 00:26:27.159 21:16:22 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:27.159 21:16:22 -- host/discovery.sh@67 -- # sort 00:26:27.159 21:16:22 -- host/discovery.sh@67 -- # xargs 00:26:27.159 21:16:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.159 21:16:23 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:27.159 21:16:23 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:27.159 21:16:23 -- host/discovery.sh@162 -- # kill 4088281 00:26:27.159 21:16:23 -- host/discovery.sh@163 -- # nvmftestfini 00:26:27.159 21:16:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:27.159 21:16:23 -- nvmf/common.sh@116 -- # sync 00:26:27.159 21:16:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:27.159 21:16:23 -- nvmf/common.sh@119 -- # set +e 00:26:27.159 21:16:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:27.159 21:16:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:27.159 rmmod nvme_tcp 00:26:27.159 rmmod nvme_fabrics 00:26:27.159 rmmod nvme_keyring 00:26:27.159 21:16:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:27.159 21:16:23 -- nvmf/common.sh@123 -- # set -e 00:26:27.159 21:16:23 -- nvmf/common.sh@124 -- # return 0 00:26:27.159 21:16:23 -- nvmf/common.sh@477 -- # '[' -n 4088126 ']' 00:26:27.159 21:16:23 -- nvmf/common.sh@478 -- # killprocess 4088126 00:26:27.159 21:16:23 -- common/autotest_common.sh@936 -- # '[' -z 4088126 ']' 00:26:27.159 21:16:23 -- common/autotest_common.sh@940 -- # kill -0 4088126 00:26:27.159 21:16:23 -- common/autotest_common.sh@941 -- # uname 00:26:27.159 21:16:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:27.159 21:16:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4088126 00:26:27.159 21:16:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:27.159 21:16:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:27.159 21:16:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4088126' 00:26:27.159 killing process with pid 4088126 00:26:27.159 21:16:23 -- common/autotest_common.sh@955 -- # kill 4088126 00:26:27.159 21:16:23 -- common/autotest_common.sh@960 -- # wait 4088126 00:26:27.159 21:16:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:27.159 21:16:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:27.159 21:16:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:27.159 21:16:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:27.159 21:16:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:27.159 21:16:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:27.159 21:16:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:27.159 21:16:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:29.697 21:16:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:29.697 00:26:29.697 real 0m17.496s 00:26:29.697 user 0m27.286s 00:26:29.697 sys 0m2.869s 00:26:29.697 21:16:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:29.697 21:16:25 -- common/autotest_common.sh@10 -- # set +x 00:26:29.697 ************************************ 00:26:29.697 END TEST nvmf_discovery 00:26:29.697 ************************************ 00:26:29.697 21:16:25 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:29.697 21:16:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:29.697 21:16:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:29.697 21:16:25 -- common/autotest_common.sh@10 -- # set +x 00:26:29.697 ************************************ 00:26:29.697 START TEST nvmf_discovery_remove_ifc 00:26:29.697 ************************************ 00:26:29.697 21:16:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:29.697 * Looking for test storage... 00:26:29.697 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:29.697 21:16:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:29.697 21:16:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:29.697 21:16:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:29.697 21:16:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:29.697 21:16:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:29.697 21:16:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:29.697 21:16:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:29.697 21:16:25 -- scripts/common.sh@335 -- # IFS=.-: 00:26:29.697 21:16:25 -- scripts/common.sh@335 -- # read -ra ver1 00:26:29.697 21:16:25 -- scripts/common.sh@336 -- # IFS=.-: 00:26:29.697 21:16:25 -- scripts/common.sh@336 -- # read -ra ver2 00:26:29.697 21:16:25 -- scripts/common.sh@337 -- # local 'op=<' 00:26:29.697 21:16:25 -- scripts/common.sh@339 -- # ver1_l=2 00:26:29.697 21:16:25 -- scripts/common.sh@340 -- # ver2_l=1 00:26:29.697 21:16:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:29.697 21:16:25 -- scripts/common.sh@343 -- # case "$op" in 00:26:29.697 21:16:25 -- scripts/common.sh@344 -- # : 1 00:26:29.698 21:16:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:29.698 21:16:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:29.698 21:16:25 -- scripts/common.sh@364 -- # decimal 1 00:26:29.698 21:16:25 -- scripts/common.sh@352 -- # local d=1 00:26:29.698 21:16:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:29.698 21:16:25 -- scripts/common.sh@354 -- # echo 1 00:26:29.698 21:16:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:29.698 21:16:25 -- scripts/common.sh@365 -- # decimal 2 00:26:29.698 21:16:25 -- scripts/common.sh@352 -- # local d=2 00:26:29.698 21:16:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:29.698 21:16:25 -- scripts/common.sh@354 -- # echo 2 00:26:29.698 21:16:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:29.698 21:16:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:29.698 21:16:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:29.698 21:16:25 -- scripts/common.sh@367 -- # return 0 00:26:29.698 21:16:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:29.698 21:16:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:29.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:29.698 --rc genhtml_branch_coverage=1 00:26:29.698 --rc genhtml_function_coverage=1 00:26:29.698 --rc genhtml_legend=1 00:26:29.698 --rc geninfo_all_blocks=1 00:26:29.698 --rc geninfo_unexecuted_blocks=1 00:26:29.698 00:26:29.698 ' 00:26:29.698 21:16:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:29.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:29.698 --rc genhtml_branch_coverage=1 00:26:29.698 --rc genhtml_function_coverage=1 00:26:29.698 --rc genhtml_legend=1 00:26:29.698 --rc geninfo_all_blocks=1 00:26:29.698 --rc geninfo_unexecuted_blocks=1 00:26:29.698 00:26:29.698 ' 00:26:29.698 21:16:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:29.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:29.698 --rc genhtml_branch_coverage=1 00:26:29.698 --rc genhtml_function_coverage=1 00:26:29.698 --rc genhtml_legend=1 00:26:29.698 --rc geninfo_all_blocks=1 00:26:29.698 --rc geninfo_unexecuted_blocks=1 00:26:29.698 00:26:29.698 ' 00:26:29.698 21:16:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:29.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:29.698 --rc genhtml_branch_coverage=1 00:26:29.698 --rc genhtml_function_coverage=1 00:26:29.698 --rc genhtml_legend=1 00:26:29.698 --rc geninfo_all_blocks=1 00:26:29.698 --rc geninfo_unexecuted_blocks=1 00:26:29.698 00:26:29.698 ' 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:29.698 21:16:25 -- nvmf/common.sh@7 -- # uname -s 00:26:29.698 21:16:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:29.698 21:16:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:29.698 21:16:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:29.698 21:16:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:29.698 21:16:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:29.698 21:16:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:29.698 21:16:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:29.698 21:16:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:29.698 21:16:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:29.698 21:16:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:29.698 21:16:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:29.698 21:16:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:29.698 21:16:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:29.698 21:16:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:29.698 21:16:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:29.698 21:16:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:29.698 21:16:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:29.698 21:16:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:29.698 21:16:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:29.698 21:16:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:29.698 21:16:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:29.698 21:16:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:29.698 21:16:25 -- paths/export.sh@5 -- # export PATH 00:26:29.698 21:16:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:29.698 21:16:25 -- nvmf/common.sh@46 -- # : 0 00:26:29.698 21:16:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:29.698 21:16:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:29.698 21:16:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:29.698 21:16:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:29.698 21:16:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:29.698 21:16:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:29.698 21:16:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:29.698 21:16:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:29.698 21:16:25 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:29.698 21:16:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:29.698 21:16:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:29.698 21:16:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:29.698 21:16:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:29.698 21:16:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:29.698 21:16:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:29.698 21:16:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:29.698 21:16:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:29.698 21:16:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:29.698 21:16:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:29.698 21:16:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:29.698 21:16:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.601 21:16:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:31.601 21:16:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:31.601 21:16:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:31.601 21:16:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:31.601 21:16:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:31.601 21:16:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:31.601 21:16:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:31.601 21:16:27 -- nvmf/common.sh@294 -- # net_devs=() 00:26:31.601 21:16:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:31.601 21:16:27 -- nvmf/common.sh@295 -- # e810=() 00:26:31.601 21:16:27 -- nvmf/common.sh@295 -- # local -ga e810 00:26:31.601 21:16:27 -- nvmf/common.sh@296 -- # x722=() 00:26:31.601 21:16:27 -- nvmf/common.sh@296 -- # local -ga x722 00:26:31.601 21:16:27 -- nvmf/common.sh@297 -- # mlx=() 00:26:31.601 21:16:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:31.601 21:16:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:31.601 21:16:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:31.601 21:16:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:31.601 21:16:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:31.601 21:16:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:31.601 21:16:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:31.601 21:16:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:31.601 21:16:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:31.601 21:16:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:31.601 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:31.601 21:16:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:31.602 21:16:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:31.602 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:31.602 21:16:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:31.602 21:16:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:31.602 21:16:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:31.602 21:16:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:31.602 21:16:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:31.602 21:16:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:31.602 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:31.602 21:16:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:31.602 21:16:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:31.602 21:16:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:31.602 21:16:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:31.602 21:16:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:31.602 21:16:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:31.602 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:31.602 21:16:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:31.602 21:16:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:31.602 21:16:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:31.602 21:16:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:31.602 21:16:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:31.602 21:16:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:31.602 21:16:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:31.602 21:16:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:31.602 21:16:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:31.602 21:16:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:31.602 21:16:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:31.602 21:16:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:31.602 21:16:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:31.602 21:16:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:31.602 21:16:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:31.602 21:16:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:31.602 21:16:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:31.602 21:16:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:31.602 21:16:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:31.602 21:16:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:31.602 21:16:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:31.602 21:16:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:31.602 21:16:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:31.602 21:16:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:31.602 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:31.602 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.323 ms 00:26:31.602 00:26:31.602 --- 10.0.0.2 ping statistics --- 00:26:31.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:31.602 rtt min/avg/max/mdev = 0.323/0.323/0.323/0.000 ms 00:26:31.602 21:16:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:31.602 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:31.602 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:26:31.602 00:26:31.602 --- 10.0.0.1 ping statistics --- 00:26:31.602 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:31.602 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:26:31.602 21:16:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:31.602 21:16:27 -- nvmf/common.sh@410 -- # return 0 00:26:31.602 21:16:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:31.602 21:16:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:31.602 21:16:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:31.602 21:16:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:31.602 21:16:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:31.602 21:16:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:31.602 21:16:27 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:31.602 21:16:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:31.602 21:16:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:31.602 21:16:27 -- common/autotest_common.sh@10 -- # set +x 00:26:31.602 21:16:27 -- nvmf/common.sh@469 -- # nvmfpid=4091765 00:26:31.602 21:16:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:31.602 21:16:27 -- nvmf/common.sh@470 -- # waitforlisten 4091765 00:26:31.602 21:16:27 -- common/autotest_common.sh@829 -- # '[' -z 4091765 ']' 00:26:31.602 21:16:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:31.860 21:16:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:31.860 21:16:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:31.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:31.860 21:16:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:31.860 21:16:27 -- common/autotest_common.sh@10 -- # set +x 00:26:31.860 [2024-11-27 21:16:27.883624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:31.860 [2024-11-27 21:16:27.883699] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:31.860 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.860 [2024-11-27 21:16:27.952323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.860 [2024-11-27 21:16:28.066462] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:31.860 [2024-11-27 21:16:28.066647] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:31.860 [2024-11-27 21:16:28.066666] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:31.860 [2024-11-27 21:16:28.066679] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:31.860 [2024-11-27 21:16:28.066706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:32.795 21:16:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:32.795 21:16:28 -- common/autotest_common.sh@862 -- # return 0 00:26:32.795 21:16:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:32.795 21:16:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:32.795 21:16:28 -- common/autotest_common.sh@10 -- # set +x 00:26:32.795 21:16:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:32.795 21:16:28 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:32.795 21:16:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.795 21:16:28 -- common/autotest_common.sh@10 -- # set +x 00:26:32.795 [2024-11-27 21:16:28.875209] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:32.795 [2024-11-27 21:16:28.883372] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:32.795 null0 00:26:32.795 [2024-11-27 21:16:28.915355] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:32.795 21:16:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.795 21:16:28 -- host/discovery_remove_ifc.sh@59 -- # hostpid=4091922 00:26:32.795 21:16:28 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:32.795 21:16:28 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 4091922 /tmp/host.sock 00:26:32.795 21:16:28 -- common/autotest_common.sh@829 -- # '[' -z 4091922 ']' 00:26:32.795 21:16:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:32.795 21:16:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:32.795 21:16:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:32.795 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:32.795 21:16:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:32.795 21:16:28 -- common/autotest_common.sh@10 -- # set +x 00:26:32.795 [2024-11-27 21:16:28.975343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:32.795 [2024-11-27 21:16:28.975403] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4091922 ] 00:26:32.795 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.795 [2024-11-27 21:16:29.035763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.054 [2024-11-27 21:16:29.149428] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:33.054 [2024-11-27 21:16:29.149632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:33.054 21:16:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:33.054 21:16:29 -- common/autotest_common.sh@862 -- # return 0 00:26:33.054 21:16:29 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:33.054 21:16:29 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:33.054 21:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.054 21:16:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.054 21:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.054 21:16:29 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:33.054 21:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.054 21:16:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.313 21:16:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.313 21:16:29 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:33.313 21:16:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.313 21:16:29 -- common/autotest_common.sh@10 -- # set +x 00:26:34.247 [2024-11-27 21:16:30.312283] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:34.247 [2024-11-27 21:16:30.312323] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:34.247 [2024-11-27 21:16:30.312357] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:34.247 [2024-11-27 21:16:30.440770] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:34.506 [2024-11-27 21:16:30.584664] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:34.506 [2024-11-27 21:16:30.584712] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:34.506 [2024-11-27 21:16:30.584760] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:34.506 [2024-11-27 21:16:30.584782] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:34.506 [2024-11-27 21:16:30.584816] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:34.506 21:16:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.506 21:16:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.506 21:16:30 -- common/autotest_common.sh@10 -- # set +x 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.506 [2024-11-27 21:16:30.591345] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xde4d40 was disconnected and freed. delete nvme_qpair. 00:26:34.506 21:16:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.506 21:16:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.506 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.506 21:16:30 -- common/autotest_common.sh@10 -- # set +x 00:26:34.507 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.507 21:16:30 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.507 21:16:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.507 21:16:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:34.507 21:16:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.886 21:16:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:35.887 21:16:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:35.887 21:16:31 -- common/autotest_common.sh@10 -- # set +x 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:35.887 21:16:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:35.887 21:16:31 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.821 21:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.821 21:16:32 -- common/autotest_common.sh@10 -- # set +x 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.821 21:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:36.821 21:16:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.821 21:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.821 21:16:33 -- common/autotest_common.sh@10 -- # set +x 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.821 21:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.821 21:16:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.756 21:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.756 21:16:34 -- common/autotest_common.sh@10 -- # set +x 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.756 21:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.756 21:16:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.691 21:16:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.691 21:16:35 -- common/autotest_common.sh@10 -- # set +x 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.691 21:16:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:39.691 21:16:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.950 [2024-11-27 21:16:36.025930] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:39.950 [2024-11-27 21:16:36.026007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:39.950 [2024-11-27 21:16:36.026047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:39.950 [2024-11-27 21:16:36.026074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:39.950 [2024-11-27 21:16:36.026087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:39.950 [2024-11-27 21:16:36.026100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:39.950 [2024-11-27 21:16:36.026112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:39.950 [2024-11-27 21:16:36.026125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:39.950 [2024-11-27 21:16:36.026138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:39.950 [2024-11-27 21:16:36.026173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:39.950 [2024-11-27 21:16:36.026185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:39.950 [2024-11-27 21:16:36.026196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdab430 is same with the state(5) to be set 00:26:39.950 [2024-11-27 21:16:36.035949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdab430 (9): Bad file descriptor 00:26:39.950 [2024-11-27 21:16:36.046003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:40.883 21:16:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:40.883 21:16:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:40.883 21:16:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:40.883 21:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.883 21:16:36 -- common/autotest_common.sh@10 -- # set +x 00:26:40.883 21:16:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:40.883 21:16:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:40.883 [2024-11-27 21:16:37.076555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:42.255 [2024-11-27 21:16:38.100571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:42.255 [2024-11-27 21:16:38.100632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdab430 with addr=10.0.0.2, port=4420 00:26:42.255 [2024-11-27 21:16:38.100660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdab430 is same with the state(5) to be set 00:26:42.255 [2024-11-27 21:16:38.100711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:42.255 [2024-11-27 21:16:38.100736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:42.255 [2024-11-27 21:16:38.100750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:42.255 [2024-11-27 21:16:38.100765] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:42.255 [2024-11-27 21:16:38.101145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdab430 (9): Bad file descriptor 00:26:42.255 [2024-11-27 21:16:38.101182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:42.255 [2024-11-27 21:16:38.101223] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:42.255 [2024-11-27 21:16:38.101273] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.255 [2024-11-27 21:16:38.101295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.255 [2024-11-27 21:16:38.101313] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.255 [2024-11-27 21:16:38.101326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.255 [2024-11-27 21:16:38.101339] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.255 [2024-11-27 21:16:38.101351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.255 [2024-11-27 21:16:38.101364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.255 [2024-11-27 21:16:38.101377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.255 [2024-11-27 21:16:38.101390] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:42.255 [2024-11-27 21:16:38.101402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:42.255 [2024-11-27 21:16:38.101414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:42.255 [2024-11-27 21:16:38.101710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdab840 (9): Bad file descriptor 00:26:42.255 [2024-11-27 21:16:38.102730] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:42.255 [2024-11-27 21:16:38.102751] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:42.255 21:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.255 21:16:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.255 21:16:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.200 21:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.200 21:16:39 -- common/autotest_common.sh@10 -- # set +x 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.200 21:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.200 21:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.200 21:16:39 -- common/autotest_common.sh@10 -- # set +x 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.200 21:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:43.200 21:16:39 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:44.136 [2024-11-27 21:16:40.158733] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:44.136 [2024-11-27 21:16:40.158776] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:44.136 [2024-11-27 21:16:40.158801] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:44.136 21:16:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:44.136 21:16:40 -- common/autotest_common.sh@10 -- # set +x 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:44.136 [2024-11-27 21:16:40.245135] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:44.136 21:16:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:44.136 21:16:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:44.394 [2024-11-27 21:16:40.421571] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:44.394 [2024-11-27 21:16:40.421620] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:44.394 [2024-11-27 21:16:40.421655] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:44.394 [2024-11-27 21:16:40.421678] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:44.394 [2024-11-27 21:16:40.421691] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:44.394 [2024-11-27 21:16:40.427930] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xdb9f60 was disconnected and freed. delete nvme_qpair. 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.328 21:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.328 21:16:41 -- common/autotest_common.sh@10 -- # set +x 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.328 21:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:45.328 21:16:41 -- host/discovery_remove_ifc.sh@90 -- # killprocess 4091922 00:26:45.328 21:16:41 -- common/autotest_common.sh@936 -- # '[' -z 4091922 ']' 00:26:45.328 21:16:41 -- common/autotest_common.sh@940 -- # kill -0 4091922 00:26:45.328 21:16:41 -- common/autotest_common.sh@941 -- # uname 00:26:45.328 21:16:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:45.328 21:16:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4091922 00:26:45.328 21:16:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:45.328 21:16:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:45.328 21:16:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4091922' 00:26:45.328 killing process with pid 4091922 00:26:45.328 21:16:41 -- common/autotest_common.sh@955 -- # kill 4091922 00:26:45.328 21:16:41 -- common/autotest_common.sh@960 -- # wait 4091922 00:26:45.586 21:16:41 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:45.586 21:16:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:45.586 21:16:41 -- nvmf/common.sh@116 -- # sync 00:26:45.586 21:16:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:45.586 21:16:41 -- nvmf/common.sh@119 -- # set +e 00:26:45.586 21:16:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:45.586 21:16:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:45.586 rmmod nvme_tcp 00:26:45.586 rmmod nvme_fabrics 00:26:45.586 rmmod nvme_keyring 00:26:45.587 21:16:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:45.587 21:16:41 -- nvmf/common.sh@123 -- # set -e 00:26:45.587 21:16:41 -- nvmf/common.sh@124 -- # return 0 00:26:45.587 21:16:41 -- nvmf/common.sh@477 -- # '[' -n 4091765 ']' 00:26:45.587 21:16:41 -- nvmf/common.sh@478 -- # killprocess 4091765 00:26:45.587 21:16:41 -- common/autotest_common.sh@936 -- # '[' -z 4091765 ']' 00:26:45.587 21:16:41 -- common/autotest_common.sh@940 -- # kill -0 4091765 00:26:45.587 21:16:41 -- common/autotest_common.sh@941 -- # uname 00:26:45.587 21:16:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:45.587 21:16:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4091765 00:26:45.587 21:16:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:45.587 21:16:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:45.587 21:16:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4091765' 00:26:45.587 killing process with pid 4091765 00:26:45.587 21:16:41 -- common/autotest_common.sh@955 -- # kill 4091765 00:26:45.587 21:16:41 -- common/autotest_common.sh@960 -- # wait 4091765 00:26:45.845 21:16:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:45.845 21:16:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:45.845 21:16:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:45.845 21:16:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:45.845 21:16:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:45.845 21:16:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:45.845 21:16:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:45.845 21:16:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:48.376 21:16:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:48.376 00:26:48.376 real 0m18.547s 00:26:48.376 user 0m25.675s 00:26:48.376 sys 0m2.952s 00:26:48.376 21:16:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:48.376 21:16:44 -- common/autotest_common.sh@10 -- # set +x 00:26:48.376 ************************************ 00:26:48.376 END TEST nvmf_discovery_remove_ifc 00:26:48.376 ************************************ 00:26:48.376 21:16:44 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:48.376 21:16:44 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:48.376 21:16:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:48.376 21:16:44 -- common/autotest_common.sh@10 -- # set +x 00:26:48.376 ************************************ 00:26:48.376 START TEST nvmf_digest 00:26:48.376 ************************************ 00:26:48.376 21:16:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:48.376 * Looking for test storage... 00:26:48.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:48.376 21:16:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:48.376 21:16:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:48.376 21:16:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:48.376 21:16:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:48.376 21:16:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:48.376 21:16:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:48.376 21:16:44 -- scripts/common.sh@335 -- # IFS=.-: 00:26:48.376 21:16:44 -- scripts/common.sh@335 -- # read -ra ver1 00:26:48.376 21:16:44 -- scripts/common.sh@336 -- # IFS=.-: 00:26:48.376 21:16:44 -- scripts/common.sh@336 -- # read -ra ver2 00:26:48.376 21:16:44 -- scripts/common.sh@337 -- # local 'op=<' 00:26:48.376 21:16:44 -- scripts/common.sh@339 -- # ver1_l=2 00:26:48.376 21:16:44 -- scripts/common.sh@340 -- # ver2_l=1 00:26:48.376 21:16:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:48.376 21:16:44 -- scripts/common.sh@343 -- # case "$op" in 00:26:48.376 21:16:44 -- scripts/common.sh@344 -- # : 1 00:26:48.376 21:16:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:48.376 21:16:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:48.376 21:16:44 -- scripts/common.sh@364 -- # decimal 1 00:26:48.376 21:16:44 -- scripts/common.sh@352 -- # local d=1 00:26:48.376 21:16:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:48.376 21:16:44 -- scripts/common.sh@354 -- # echo 1 00:26:48.376 21:16:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:48.376 21:16:44 -- scripts/common.sh@365 -- # decimal 2 00:26:48.376 21:16:44 -- scripts/common.sh@352 -- # local d=2 00:26:48.376 21:16:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:48.376 21:16:44 -- scripts/common.sh@354 -- # echo 2 00:26:48.376 21:16:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:48.376 21:16:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:48.376 21:16:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:48.376 21:16:44 -- scripts/common.sh@367 -- # return 0 00:26:48.376 21:16:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:48.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:48.376 --rc genhtml_branch_coverage=1 00:26:48.376 --rc genhtml_function_coverage=1 00:26:48.376 --rc genhtml_legend=1 00:26:48.376 --rc geninfo_all_blocks=1 00:26:48.376 --rc geninfo_unexecuted_blocks=1 00:26:48.376 00:26:48.376 ' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:48.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:48.376 --rc genhtml_branch_coverage=1 00:26:48.376 --rc genhtml_function_coverage=1 00:26:48.376 --rc genhtml_legend=1 00:26:48.376 --rc geninfo_all_blocks=1 00:26:48.376 --rc geninfo_unexecuted_blocks=1 00:26:48.376 00:26:48.376 ' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:48.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:48.376 --rc genhtml_branch_coverage=1 00:26:48.376 --rc genhtml_function_coverage=1 00:26:48.376 --rc genhtml_legend=1 00:26:48.376 --rc geninfo_all_blocks=1 00:26:48.376 --rc geninfo_unexecuted_blocks=1 00:26:48.376 00:26:48.376 ' 00:26:48.376 21:16:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:48.377 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:48.377 --rc genhtml_branch_coverage=1 00:26:48.377 --rc genhtml_function_coverage=1 00:26:48.377 --rc genhtml_legend=1 00:26:48.377 --rc geninfo_all_blocks=1 00:26:48.377 --rc geninfo_unexecuted_blocks=1 00:26:48.377 00:26:48.377 ' 00:26:48.377 21:16:44 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:48.377 21:16:44 -- nvmf/common.sh@7 -- # uname -s 00:26:48.377 21:16:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:48.377 21:16:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:48.377 21:16:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:48.377 21:16:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:48.377 21:16:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:48.377 21:16:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:48.377 21:16:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:48.377 21:16:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:48.377 21:16:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:48.377 21:16:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:48.377 21:16:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:48.377 21:16:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:48.377 21:16:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:48.377 21:16:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:48.377 21:16:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:48.377 21:16:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:48.377 21:16:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:48.377 21:16:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:48.377 21:16:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:48.377 21:16:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.377 21:16:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.377 21:16:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.377 21:16:44 -- paths/export.sh@5 -- # export PATH 00:26:48.377 21:16:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.377 21:16:44 -- nvmf/common.sh@46 -- # : 0 00:26:48.377 21:16:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:48.377 21:16:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:48.377 21:16:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:48.377 21:16:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:48.377 21:16:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:48.377 21:16:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:48.377 21:16:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:48.377 21:16:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:48.377 21:16:44 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:48.377 21:16:44 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:48.377 21:16:44 -- host/digest.sh@16 -- # runtime=2 00:26:48.377 21:16:44 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:48.377 21:16:44 -- host/digest.sh@132 -- # nvmftestinit 00:26:48.377 21:16:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:48.377 21:16:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:48.377 21:16:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:48.377 21:16:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:48.377 21:16:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:48.377 21:16:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:48.377 21:16:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:48.377 21:16:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:48.377 21:16:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:48.377 21:16:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:48.377 21:16:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:48.377 21:16:44 -- common/autotest_common.sh@10 -- # set +x 00:26:50.280 21:16:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:50.280 21:16:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:50.281 21:16:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:50.281 21:16:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:50.281 21:16:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:50.281 21:16:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:50.281 21:16:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:50.281 21:16:46 -- nvmf/common.sh@294 -- # net_devs=() 00:26:50.281 21:16:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:50.281 21:16:46 -- nvmf/common.sh@295 -- # e810=() 00:26:50.281 21:16:46 -- nvmf/common.sh@295 -- # local -ga e810 00:26:50.281 21:16:46 -- nvmf/common.sh@296 -- # x722=() 00:26:50.281 21:16:46 -- nvmf/common.sh@296 -- # local -ga x722 00:26:50.281 21:16:46 -- nvmf/common.sh@297 -- # mlx=() 00:26:50.281 21:16:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:50.281 21:16:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:50.281 21:16:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:50.281 21:16:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:50.281 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:50.281 21:16:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:50.281 21:16:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:50.281 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:50.281 21:16:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:50.281 21:16:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.281 21:16:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.281 21:16:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:50.281 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:50.281 21:16:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:50.281 21:16:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.281 21:16:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.281 21:16:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:50.281 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:50.281 21:16:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:50.281 21:16:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:50.281 21:16:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:50.281 21:16:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:50.281 21:16:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:50.281 21:16:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:50.281 21:16:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:50.281 21:16:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:50.281 21:16:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:50.281 21:16:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:50.281 21:16:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:50.281 21:16:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:50.281 21:16:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:50.281 21:16:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:50.281 21:16:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:50.281 21:16:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:50.281 21:16:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:50.281 21:16:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:50.281 21:16:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:50.281 21:16:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:50.281 21:16:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:50.281 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:50.281 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:26:50.281 00:26:50.281 --- 10.0.0.2 ping statistics --- 00:26:50.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:50.281 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:26:50.281 21:16:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:50.281 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:50.281 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:26:50.281 00:26:50.281 --- 10.0.0.1 ping statistics --- 00:26:50.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:50.281 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:26:50.281 21:16:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:50.281 21:16:46 -- nvmf/common.sh@410 -- # return 0 00:26:50.281 21:16:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:50.281 21:16:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:50.281 21:16:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:50.281 21:16:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:50.281 21:16:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:50.281 21:16:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:50.540 21:16:46 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:50.540 21:16:46 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:50.540 21:16:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:50.540 21:16:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:50.540 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.540 ************************************ 00:26:50.540 START TEST nvmf_digest_clean 00:26:50.540 ************************************ 00:26:50.540 21:16:46 -- common/autotest_common.sh@1114 -- # run_digest 00:26:50.540 21:16:46 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:50.540 21:16:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:50.540 21:16:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:50.540 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.540 21:16:46 -- nvmf/common.sh@469 -- # nvmfpid=4095564 00:26:50.540 21:16:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:50.540 21:16:46 -- nvmf/common.sh@470 -- # waitforlisten 4095564 00:26:50.540 21:16:46 -- common/autotest_common.sh@829 -- # '[' -z 4095564 ']' 00:26:50.540 21:16:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:50.540 21:16:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:50.540 21:16:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:50.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:50.540 21:16:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:50.540 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.540 [2024-11-27 21:16:46.588264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:50.540 [2024-11-27 21:16:46.588356] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:50.540 EAL: No free 2048 kB hugepages reported on node 1 00:26:50.540 [2024-11-27 21:16:46.653895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:50.540 [2024-11-27 21:16:46.758076] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:50.540 [2024-11-27 21:16:46.758230] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:50.540 [2024-11-27 21:16:46.758247] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:50.540 [2024-11-27 21:16:46.758259] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:50.540 [2024-11-27 21:16:46.758285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:50.799 21:16:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:50.799 21:16:46 -- common/autotest_common.sh@862 -- # return 0 00:26:50.799 21:16:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:50.799 21:16:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:50.799 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.799 21:16:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:50.799 21:16:46 -- host/digest.sh@120 -- # common_target_config 00:26:50.799 21:16:46 -- host/digest.sh@43 -- # rpc_cmd 00:26:50.799 21:16:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:50.799 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.799 null0 00:26:50.799 [2024-11-27 21:16:46.942567] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:50.799 [2024-11-27 21:16:46.966796] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:50.799 21:16:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:50.799 21:16:46 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:50.799 21:16:46 -- host/digest.sh@77 -- # local rw bs qd 00:26:50.799 21:16:46 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:50.799 21:16:46 -- host/digest.sh@80 -- # rw=randread 00:26:50.799 21:16:46 -- host/digest.sh@80 -- # bs=4096 00:26:50.799 21:16:46 -- host/digest.sh@80 -- # qd=128 00:26:50.799 21:16:46 -- host/digest.sh@82 -- # bperfpid=4095599 00:26:50.799 21:16:46 -- host/digest.sh@83 -- # waitforlisten 4095599 /var/tmp/bperf.sock 00:26:50.799 21:16:46 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:50.799 21:16:46 -- common/autotest_common.sh@829 -- # '[' -z 4095599 ']' 00:26:50.799 21:16:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:50.799 21:16:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:50.799 21:16:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:50.799 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:50.799 21:16:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:50.799 21:16:46 -- common/autotest_common.sh@10 -- # set +x 00:26:50.799 [2024-11-27 21:16:47.011945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:50.799 [2024-11-27 21:16:47.012017] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4095599 ] 00:26:51.057 EAL: No free 2048 kB hugepages reported on node 1 00:26:51.057 [2024-11-27 21:16:47.078382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:51.057 [2024-11-27 21:16:47.193259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:51.057 21:16:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:51.057 21:16:47 -- common/autotest_common.sh@862 -- # return 0 00:26:51.057 21:16:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:51.057 21:16:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:51.057 21:16:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:51.624 21:16:47 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:51.624 21:16:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:51.882 nvme0n1 00:26:51.882 21:16:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:51.882 21:16:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:51.882 Running I/O for 2 seconds... 00:26:54.410 00:26:54.410 Latency(us) 00:26:54.410 [2024-11-27T20:16:50.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:54.410 [2024-11-27T20:16:50.651Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:54.410 nvme0n1 : 2.00 15160.04 59.22 0.00 0.00 8436.20 3786.52 23884.23 00:26:54.410 [2024-11-27T20:16:50.651Z] =================================================================================================================== 00:26:54.410 [2024-11-27T20:16:50.651Z] Total : 15160.04 59.22 0.00 0.00 8436.20 3786.52 23884.23 00:26:54.410 0 00:26:54.410 21:16:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:54.410 21:16:50 -- host/digest.sh@92 -- # get_accel_stats 00:26:54.410 21:16:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:54.410 21:16:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:54.410 | select(.opcode=="crc32c") 00:26:54.410 | "\(.module_name) \(.executed)"' 00:26:54.410 21:16:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:54.410 21:16:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:54.410 21:16:50 -- host/digest.sh@93 -- # exp_module=software 00:26:54.410 21:16:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:54.410 21:16:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:54.410 21:16:50 -- host/digest.sh@97 -- # killprocess 4095599 00:26:54.410 21:16:50 -- common/autotest_common.sh@936 -- # '[' -z 4095599 ']' 00:26:54.410 21:16:50 -- common/autotest_common.sh@940 -- # kill -0 4095599 00:26:54.410 21:16:50 -- common/autotest_common.sh@941 -- # uname 00:26:54.410 21:16:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:54.410 21:16:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4095599 00:26:54.410 21:16:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:54.410 21:16:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:54.410 21:16:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4095599' 00:26:54.410 killing process with pid 4095599 00:26:54.410 21:16:50 -- common/autotest_common.sh@955 -- # kill 4095599 00:26:54.410 Received shutdown signal, test time was about 2.000000 seconds 00:26:54.410 00:26:54.410 Latency(us) 00:26:54.410 [2024-11-27T20:16:50.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:54.410 [2024-11-27T20:16:50.651Z] =================================================================================================================== 00:26:54.410 [2024-11-27T20:16:50.651Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:54.410 21:16:50 -- common/autotest_common.sh@960 -- # wait 4095599 00:26:54.669 21:16:50 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:54.669 21:16:50 -- host/digest.sh@77 -- # local rw bs qd 00:26:54.669 21:16:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:54.669 21:16:50 -- host/digest.sh@80 -- # rw=randread 00:26:54.669 21:16:50 -- host/digest.sh@80 -- # bs=131072 00:26:54.669 21:16:50 -- host/digest.sh@80 -- # qd=16 00:26:54.669 21:16:50 -- host/digest.sh@82 -- # bperfpid=4096016 00:26:54.669 21:16:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:54.669 21:16:50 -- host/digest.sh@83 -- # waitforlisten 4096016 /var/tmp/bperf.sock 00:26:54.669 21:16:50 -- common/autotest_common.sh@829 -- # '[' -z 4096016 ']' 00:26:54.669 21:16:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:54.669 21:16:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:54.669 21:16:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:54.669 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:54.669 21:16:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:54.669 21:16:50 -- common/autotest_common.sh@10 -- # set +x 00:26:54.669 [2024-11-27 21:16:50.763707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:54.669 [2024-11-27 21:16:50.763785] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4096016 ] 00:26:54.669 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:54.669 Zero copy mechanism will not be used. 00:26:54.669 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.669 [2024-11-27 21:16:50.821601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:54.927 [2024-11-27 21:16:50.934154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:54.927 21:16:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:54.927 21:16:50 -- common/autotest_common.sh@862 -- # return 0 00:26:54.927 21:16:50 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:54.927 21:16:50 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:54.927 21:16:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:55.185 21:16:51 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:55.186 21:16:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:55.751 nvme0n1 00:26:55.751 21:16:51 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:55.751 21:16:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:55.751 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:55.751 Zero copy mechanism will not be used. 00:26:55.751 Running I/O for 2 seconds... 00:26:58.280 00:26:58.280 Latency(us) 00:26:58.280 [2024-11-27T20:16:54.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:58.280 [2024-11-27T20:16:54.521Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:58.280 nvme0n1 : 2.00 5179.46 647.43 0.00 0.00 3084.58 1183.29 6747.78 00:26:58.280 [2024-11-27T20:16:54.521Z] =================================================================================================================== 00:26:58.280 [2024-11-27T20:16:54.521Z] Total : 5179.46 647.43 0.00 0.00 3084.58 1183.29 6747.78 00:26:58.280 0 00:26:58.280 21:16:53 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:58.280 21:16:53 -- host/digest.sh@92 -- # get_accel_stats 00:26:58.280 21:16:53 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:58.280 21:16:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:58.280 21:16:53 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:58.280 | select(.opcode=="crc32c") 00:26:58.280 | "\(.module_name) \(.executed)"' 00:26:58.280 21:16:54 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:58.280 21:16:54 -- host/digest.sh@93 -- # exp_module=software 00:26:58.280 21:16:54 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:58.280 21:16:54 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:58.280 21:16:54 -- host/digest.sh@97 -- # killprocess 4096016 00:26:58.280 21:16:54 -- common/autotest_common.sh@936 -- # '[' -z 4096016 ']' 00:26:58.280 21:16:54 -- common/autotest_common.sh@940 -- # kill -0 4096016 00:26:58.280 21:16:54 -- common/autotest_common.sh@941 -- # uname 00:26:58.280 21:16:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:58.280 21:16:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4096016 00:26:58.280 21:16:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:58.280 21:16:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:58.280 21:16:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4096016' 00:26:58.280 killing process with pid 4096016 00:26:58.280 21:16:54 -- common/autotest_common.sh@955 -- # kill 4096016 00:26:58.280 Received shutdown signal, test time was about 2.000000 seconds 00:26:58.280 00:26:58.280 Latency(us) 00:26:58.280 [2024-11-27T20:16:54.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:58.280 [2024-11-27T20:16:54.521Z] =================================================================================================================== 00:26:58.280 [2024-11-27T20:16:54.521Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:58.280 21:16:54 -- common/autotest_common.sh@960 -- # wait 4096016 00:26:58.539 21:16:54 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:58.539 21:16:54 -- host/digest.sh@77 -- # local rw bs qd 00:26:58.539 21:16:54 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:58.539 21:16:54 -- host/digest.sh@80 -- # rw=randwrite 00:26:58.539 21:16:54 -- host/digest.sh@80 -- # bs=4096 00:26:58.539 21:16:54 -- host/digest.sh@80 -- # qd=128 00:26:58.539 21:16:54 -- host/digest.sh@82 -- # bperfpid=4096557 00:26:58.539 21:16:54 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:58.539 21:16:54 -- host/digest.sh@83 -- # waitforlisten 4096557 /var/tmp/bperf.sock 00:26:58.539 21:16:54 -- common/autotest_common.sh@829 -- # '[' -z 4096557 ']' 00:26:58.539 21:16:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:58.539 21:16:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:58.539 21:16:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:58.539 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:58.539 21:16:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:58.539 21:16:54 -- common/autotest_common.sh@10 -- # set +x 00:26:58.539 [2024-11-27 21:16:54.562971] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:58.539 [2024-11-27 21:16:54.563048] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4096557 ] 00:26:58.539 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.539 [2024-11-27 21:16:54.620437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:58.539 [2024-11-27 21:16:54.727215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.797 21:16:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.797 21:16:54 -- common/autotest_common.sh@862 -- # return 0 00:26:58.797 21:16:54 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:58.797 21:16:54 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:58.797 21:16:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:59.055 21:16:55 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:59.055 21:16:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:59.313 nvme0n1 00:26:59.313 21:16:55 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:59.313 21:16:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:59.571 Running I/O for 2 seconds... 00:27:01.469 00:27:01.469 Latency(us) 00:27:01.469 [2024-11-27T20:16:57.710Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.469 [2024-11-27T20:16:57.710Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:01.469 nvme0n1 : 2.01 19483.44 76.11 0.00 0.00 6555.62 2657.85 13301.38 00:27:01.469 [2024-11-27T20:16:57.710Z] =================================================================================================================== 00:27:01.469 [2024-11-27T20:16:57.710Z] Total : 19483.44 76.11 0.00 0.00 6555.62 2657.85 13301.38 00:27:01.469 0 00:27:01.469 21:16:57 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:01.469 21:16:57 -- host/digest.sh@92 -- # get_accel_stats 00:27:01.469 21:16:57 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:01.469 21:16:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:01.469 21:16:57 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:01.469 | select(.opcode=="crc32c") 00:27:01.469 | "\(.module_name) \(.executed)"' 00:27:01.727 21:16:57 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:01.727 21:16:57 -- host/digest.sh@93 -- # exp_module=software 00:27:01.727 21:16:57 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:01.727 21:16:57 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:01.727 21:16:57 -- host/digest.sh@97 -- # killprocess 4096557 00:27:01.727 21:16:57 -- common/autotest_common.sh@936 -- # '[' -z 4096557 ']' 00:27:01.727 21:16:57 -- common/autotest_common.sh@940 -- # kill -0 4096557 00:27:01.727 21:16:57 -- common/autotest_common.sh@941 -- # uname 00:27:01.727 21:16:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.727 21:16:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4096557 00:27:01.727 21:16:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.727 21:16:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.727 21:16:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4096557' 00:27:01.727 killing process with pid 4096557 00:27:01.727 21:16:57 -- common/autotest_common.sh@955 -- # kill 4096557 00:27:01.727 Received shutdown signal, test time was about 2.000000 seconds 00:27:01.727 00:27:01.727 Latency(us) 00:27:01.727 [2024-11-27T20:16:57.968Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.727 [2024-11-27T20:16:57.968Z] =================================================================================================================== 00:27:01.727 [2024-11-27T20:16:57.968Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.727 21:16:57 -- common/autotest_common.sh@960 -- # wait 4096557 00:27:01.985 21:16:58 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:01.985 21:16:58 -- host/digest.sh@77 -- # local rw bs qd 00:27:01.985 21:16:58 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:01.985 21:16:58 -- host/digest.sh@80 -- # rw=randwrite 00:27:01.985 21:16:58 -- host/digest.sh@80 -- # bs=131072 00:27:01.985 21:16:58 -- host/digest.sh@80 -- # qd=16 00:27:01.985 21:16:58 -- host/digest.sh@82 -- # bperfpid=4096979 00:27:01.985 21:16:58 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:01.985 21:16:58 -- host/digest.sh@83 -- # waitforlisten 4096979 /var/tmp/bperf.sock 00:27:01.985 21:16:58 -- common/autotest_common.sh@829 -- # '[' -z 4096979 ']' 00:27:01.985 21:16:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:01.985 21:16:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:01.985 21:16:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:01.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:01.985 21:16:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:01.985 21:16:58 -- common/autotest_common.sh@10 -- # set +x 00:27:02.242 [2024-11-27 21:16:58.239498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.242 [2024-11-27 21:16:58.239604] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4096979 ] 00:27:02.242 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.242 Zero copy mechanism will not be used. 00:27:02.242 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.242 [2024-11-27 21:16:58.298930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.242 [2024-11-27 21:16:58.405932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:02.242 21:16:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:02.242 21:16:58 -- common/autotest_common.sh@862 -- # return 0 00:27:02.242 21:16:58 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:02.242 21:16:58 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:02.242 21:16:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:02.807 21:16:58 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.808 21:16:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.066 nvme0n1 00:27:03.066 21:16:59 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:03.066 21:16:59 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:03.066 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:03.066 Zero copy mechanism will not be used. 00:27:03.066 Running I/O for 2 seconds... 00:27:05.593 00:27:05.593 Latency(us) 00:27:05.593 [2024-11-27T20:17:01.834Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.593 [2024-11-27T20:17:01.834Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:05.593 nvme0n1 : 2.00 6706.42 838.30 0.00 0.00 2379.05 1820.44 8349.77 00:27:05.593 [2024-11-27T20:17:01.834Z] =================================================================================================================== 00:27:05.593 [2024-11-27T20:17:01.834Z] Total : 6706.42 838.30 0.00 0.00 2379.05 1820.44 8349.77 00:27:05.593 0 00:27:05.593 21:17:01 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:05.593 21:17:01 -- host/digest.sh@92 -- # get_accel_stats 00:27:05.593 21:17:01 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:05.593 21:17:01 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:05.593 | select(.opcode=="crc32c") 00:27:05.593 | "\(.module_name) \(.executed)"' 00:27:05.593 21:17:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:05.593 21:17:01 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:05.593 21:17:01 -- host/digest.sh@93 -- # exp_module=software 00:27:05.593 21:17:01 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:05.593 21:17:01 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:05.593 21:17:01 -- host/digest.sh@97 -- # killprocess 4096979 00:27:05.593 21:17:01 -- common/autotest_common.sh@936 -- # '[' -z 4096979 ']' 00:27:05.593 21:17:01 -- common/autotest_common.sh@940 -- # kill -0 4096979 00:27:05.593 21:17:01 -- common/autotest_common.sh@941 -- # uname 00:27:05.593 21:17:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:05.593 21:17:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4096979 00:27:05.593 21:17:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:05.593 21:17:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:05.593 21:17:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4096979' 00:27:05.593 killing process with pid 4096979 00:27:05.593 21:17:01 -- common/autotest_common.sh@955 -- # kill 4096979 00:27:05.593 Received shutdown signal, test time was about 2.000000 seconds 00:27:05.593 00:27:05.593 Latency(us) 00:27:05.594 [2024-11-27T20:17:01.835Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.594 [2024-11-27T20:17:01.835Z] =================================================================================================================== 00:27:05.594 [2024-11-27T20:17:01.835Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:05.594 21:17:01 -- common/autotest_common.sh@960 -- # wait 4096979 00:27:05.852 21:17:01 -- host/digest.sh@126 -- # killprocess 4095564 00:27:05.852 21:17:01 -- common/autotest_common.sh@936 -- # '[' -z 4095564 ']' 00:27:05.852 21:17:01 -- common/autotest_common.sh@940 -- # kill -0 4095564 00:27:05.852 21:17:01 -- common/autotest_common.sh@941 -- # uname 00:27:05.852 21:17:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:05.852 21:17:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4095564 00:27:05.852 21:17:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:05.852 21:17:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:05.852 21:17:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4095564' 00:27:05.852 killing process with pid 4095564 00:27:05.852 21:17:01 -- common/autotest_common.sh@955 -- # kill 4095564 00:27:05.852 21:17:01 -- common/autotest_common.sh@960 -- # wait 4095564 00:27:06.110 00:27:06.110 real 0m15.623s 00:27:06.110 user 0m31.188s 00:27:06.110 sys 0m4.170s 00:27:06.110 21:17:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:06.110 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.110 ************************************ 00:27:06.110 END TEST nvmf_digest_clean 00:27:06.110 ************************************ 00:27:06.110 21:17:02 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:06.110 21:17:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:06.110 21:17:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:06.110 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.110 ************************************ 00:27:06.110 START TEST nvmf_digest_error 00:27:06.110 ************************************ 00:27:06.110 21:17:02 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:06.110 21:17:02 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:06.110 21:17:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:06.110 21:17:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:06.110 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.110 21:17:02 -- nvmf/common.sh@469 -- # nvmfpid=4097539 00:27:06.110 21:17:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:06.110 21:17:02 -- nvmf/common.sh@470 -- # waitforlisten 4097539 00:27:06.110 21:17:02 -- common/autotest_common.sh@829 -- # '[' -z 4097539 ']' 00:27:06.110 21:17:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:06.110 21:17:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.110 21:17:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:06.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:06.110 21:17:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.110 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.110 [2024-11-27 21:17:02.238797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.110 [2024-11-27 21:17:02.238916] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:06.110 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.110 [2024-11-27 21:17:02.302058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:06.369 [2024-11-27 21:17:02.409227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:06.369 [2024-11-27 21:17:02.409397] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:06.369 [2024-11-27 21:17:02.409414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:06.369 [2024-11-27 21:17:02.409425] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:06.369 [2024-11-27 21:17:02.409453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:06.369 21:17:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:06.369 21:17:02 -- common/autotest_common.sh@862 -- # return 0 00:27:06.369 21:17:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:06.369 21:17:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:06.369 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.369 21:17:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:06.369 21:17:02 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:06.369 21:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.369 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.369 [2024-11-27 21:17:02.486118] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:06.369 21:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.369 21:17:02 -- host/digest.sh@104 -- # common_target_config 00:27:06.369 21:17:02 -- host/digest.sh@43 -- # rpc_cmd 00:27:06.369 21:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.369 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.369 null0 00:27:06.369 [2024-11-27 21:17:02.607779] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:06.627 [2024-11-27 21:17:02.632068] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:06.627 21:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.627 21:17:02 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:06.627 21:17:02 -- host/digest.sh@54 -- # local rw bs qd 00:27:06.627 21:17:02 -- host/digest.sh@56 -- # rw=randread 00:27:06.627 21:17:02 -- host/digest.sh@56 -- # bs=4096 00:27:06.627 21:17:02 -- host/digest.sh@56 -- # qd=128 00:27:06.627 21:17:02 -- host/digest.sh@58 -- # bperfpid=4097570 00:27:06.627 21:17:02 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:06.627 21:17:02 -- host/digest.sh@60 -- # waitforlisten 4097570 /var/tmp/bperf.sock 00:27:06.627 21:17:02 -- common/autotest_common.sh@829 -- # '[' -z 4097570 ']' 00:27:06.627 21:17:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:06.627 21:17:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.627 21:17:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:06.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:06.627 21:17:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.627 21:17:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.627 [2024-11-27 21:17:02.675324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.628 [2024-11-27 21:17:02.675384] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4097570 ] 00:27:06.628 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.628 [2024-11-27 21:17:02.736172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:06.628 [2024-11-27 21:17:02.850682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.561 21:17:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.561 21:17:03 -- common/autotest_common.sh@862 -- # return 0 00:27:07.561 21:17:03 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.561 21:17:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.819 21:17:03 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:07.819 21:17:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.819 21:17:03 -- common/autotest_common.sh@10 -- # set +x 00:27:07.819 21:17:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.819 21:17:03 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.819 21:17:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:08.078 nvme0n1 00:27:08.078 21:17:04 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:08.078 21:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.078 21:17:04 -- common/autotest_common.sh@10 -- # set +x 00:27:08.078 21:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.078 21:17:04 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:08.078 21:17:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.337 Running I/O for 2 seconds... 00:27:08.337 [2024-11-27 21:17:04.383703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.383765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.383788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.400106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.400152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.400173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.417599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.417630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:13425 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.417661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.435437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.435472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:11305 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.435491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.446752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.446783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:10707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.446819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.463240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.463276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:20805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.463295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.479495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.479541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:5749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.479577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.491114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.491149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:18622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.491168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.509817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.509850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:23297 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.509886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.526164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.526199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:15847 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.526218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.543511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.543554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.543596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.337 [2024-11-27 21:17:04.560646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.337 [2024-11-27 21:17:04.560675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:16386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.337 [2024-11-27 21:17:04.560705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.577665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.577695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.577725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.594759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.594790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:23849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.594820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.612097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.612131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20224 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.612150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.628956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.628991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:19523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.629009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.644965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.645001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.645020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.656734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.656763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:7666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.656794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.673942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.673977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:15453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.674003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.690971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.691006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.691025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.708019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.708053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.708072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.725031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.725065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:20187 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.725084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.742764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.742792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:13567 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.596 [2024-11-27 21:17:04.742808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.596 [2024-11-27 21:17:04.759019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.596 [2024-11-27 21:17:04.759053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:6767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.597 [2024-11-27 21:17:04.759072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.597 [2024-11-27 21:17:04.776250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.597 [2024-11-27 21:17:04.776285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:3976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.597 [2024-11-27 21:17:04.776304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.597 [2024-11-27 21:17:04.793293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.597 [2024-11-27 21:17:04.793327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:9259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.597 [2024-11-27 21:17:04.793346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.597 [2024-11-27 21:17:04.817430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.597 [2024-11-27 21:17:04.817464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.597 [2024-11-27 21:17:04.817483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.597 [2024-11-27 21:17:04.834297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.597 [2024-11-27 21:17:04.834332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18535 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.597 [2024-11-27 21:17:04.834351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.851204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.851238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.851257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.868568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.868596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.868612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.885679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.885707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.885738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.902729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.902758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.902789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.919977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.920012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.920031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.936925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.936960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.936978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.953864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.953899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.953917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.969740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.969771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.969793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.981588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.981616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24366 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.981645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:04.998547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:04.998593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:04.998608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:05.015627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:05.015656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9677 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:05.015688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:05.032705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:05.032733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:19112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:05.032763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.855 [2024-11-27 21:17:05.049754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.855 [2024-11-27 21:17:05.049782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:21133 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.855 [2024-11-27 21:17:05.049813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.856 [2024-11-27 21:17:05.066816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.856 [2024-11-27 21:17:05.066858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:11795 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.856 [2024-11-27 21:17:05.066872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.856 [2024-11-27 21:17:05.083866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:08.856 [2024-11-27 21:17:05.083913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.856 [2024-11-27 21:17:05.083932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.101796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.101845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:4174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.101864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.118182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.118225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.118245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.142782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.142829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:19621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.142845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.160041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.160076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.160094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.177158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.177193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.177212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.194410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.194445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:20518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.194463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.211485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.211519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:23738 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.211547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.228762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.228789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:24376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.228820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.245876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.245910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:11464 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.245929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.263059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.263093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.263112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.278750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.278781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:10860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.278798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.291124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.291158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.291176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.307170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.307204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.307223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.331311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.331346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:3314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.331364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.114 [2024-11-27 21:17:05.348762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.114 [2024-11-27 21:17:05.348791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:16256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.114 [2024-11-27 21:17:05.348807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.365764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.365792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:9415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.365833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.382416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.382451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14741 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.382470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.393425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.393459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:17414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.393479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.409135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.409168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.409193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.426660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.426688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:24680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.426720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.443360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.443393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:2617 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.443412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.455097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.455130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.455149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.472787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.472814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:11103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.472847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.490221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.490255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:24549 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.490274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.373 [2024-11-27 21:17:05.506050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.373 [2024-11-27 21:17:05.506084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9331 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.373 [2024-11-27 21:17:05.506103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.518028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.518056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:16164 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.518087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.533274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.533309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:3111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.533327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.550565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.550617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:20912 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.550633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.567705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.567733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:22070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.567764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.584755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.584783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:2964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.584813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.374 [2024-11-27 21:17:05.601919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.374 [2024-11-27 21:17:05.601953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.374 [2024-11-27 21:17:05.601972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.619217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.619251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:14190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.619269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.637456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.637490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:12830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.637509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.653561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.653606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:12763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.653621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.670853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.670881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:21524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.670914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.688652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.688696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:14321 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.688714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.704967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.705001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.705020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.721737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.721765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.721797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.739009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.739043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:9558 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.739062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.755980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.756015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:11581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.756034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.772655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.772683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.772715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.789694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.789722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.789753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.806491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.806533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25008 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.806554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.823581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.823610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:25222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.823641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.839115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.839156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1353 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.839181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.851072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.851105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:15190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.851123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.633 [2024-11-27 21:17:05.869443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.633 [2024-11-27 21:17:05.869477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9320 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.633 [2024-11-27 21:17:05.869495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.885450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.885484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:2606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.885504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.896889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.896923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:21447 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.896942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.914000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.914035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:10120 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.914053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.931059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.931094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:2167 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.931113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.947878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.947912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.947930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.965058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.965092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.965111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.981853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.981888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:3272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.981906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:05.998767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:05.998796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:05.998830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.015671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.015699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:23072 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.015729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.032755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.032784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:10302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.032814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.049817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.049865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.049884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.066759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.066789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:15078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.066820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.084331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.084371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.084390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.100257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.100292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.100311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.892 [2024-11-27 21:17:06.117304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:09.892 [2024-11-27 21:17:06.117338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:15638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.892 [2024-11-27 21:17:06.117364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.134298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.134333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:9124 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.134352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.151396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.151430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.151449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.168579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.168607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:24689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.168637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.185624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.185652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.185683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.203357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.203391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:11895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.203409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.219689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.219719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:16089 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.219749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.236701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.236731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.236762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.254241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.151 [2024-11-27 21:17:06.254275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:14172 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.151 [2024-11-27 21:17:06.254294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.151 [2024-11-27 21:17:06.271193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.271239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.271259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.288921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.288957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.288977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.304897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.304932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.304951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.322570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.322608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:21447 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.322625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.338723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.338751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.338782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.355575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.355606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.355637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 [2024-11-27 21:17:06.373136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x226cbb0) 00:27:10.152 [2024-11-27 21:17:06.373171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:2923 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.152 [2024-11-27 21:17:06.373189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.152 00:27:10.152 Latency(us) 00:27:10.152 [2024-11-27T20:17:06.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.152 [2024-11-27T20:17:06.393Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:10.152 nvme0n1 : 2.01 15292.79 59.74 0.00 0.00 8361.28 3543.80 33204.91 00:27:10.152 [2024-11-27T20:17:06.393Z] =================================================================================================================== 00:27:10.152 [2024-11-27T20:17:06.393Z] Total : 15292.79 59.74 0.00 0.00 8361.28 3543.80 33204.91 00:27:10.152 0 00:27:10.411 21:17:06 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:10.411 21:17:06 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:10.411 21:17:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:10.411 21:17:06 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:10.411 | .driver_specific 00:27:10.411 | .nvme_error 00:27:10.411 | .status_code 00:27:10.411 | .command_transient_transport_error' 00:27:10.411 21:17:06 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:27:10.411 21:17:06 -- host/digest.sh@73 -- # killprocess 4097570 00:27:10.698 21:17:06 -- common/autotest_common.sh@936 -- # '[' -z 4097570 ']' 00:27:10.698 21:17:06 -- common/autotest_common.sh@940 -- # kill -0 4097570 00:27:10.698 21:17:06 -- common/autotest_common.sh@941 -- # uname 00:27:10.698 21:17:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.698 21:17:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4097570 00:27:10.698 21:17:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.698 21:17:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.698 21:17:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4097570' 00:27:10.698 killing process with pid 4097570 00:27:10.698 21:17:06 -- common/autotest_common.sh@955 -- # kill 4097570 00:27:10.698 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.698 00:27:10.698 Latency(us) 00:27:10.698 [2024-11-27T20:17:06.939Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.698 [2024-11-27T20:17:06.939Z] =================================================================================================================== 00:27:10.698 [2024-11-27T20:17:06.939Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.698 21:17:06 -- common/autotest_common.sh@960 -- # wait 4097570 00:27:10.957 21:17:06 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:10.957 21:17:06 -- host/digest.sh@54 -- # local rw bs qd 00:27:10.957 21:17:06 -- host/digest.sh@56 -- # rw=randread 00:27:10.957 21:17:06 -- host/digest.sh@56 -- # bs=131072 00:27:10.957 21:17:06 -- host/digest.sh@56 -- # qd=16 00:27:10.957 21:17:06 -- host/digest.sh@58 -- # bperfpid=4098125 00:27:10.957 21:17:06 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:10.957 21:17:06 -- host/digest.sh@60 -- # waitforlisten 4098125 /var/tmp/bperf.sock 00:27:10.957 21:17:06 -- common/autotest_common.sh@829 -- # '[' -z 4098125 ']' 00:27:10.957 21:17:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:10.957 21:17:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:10.957 21:17:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:10.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:10.957 21:17:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:10.957 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:27:10.957 [2024-11-27 21:17:06.999927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:10.957 [2024-11-27 21:17:07.000004] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4098125 ] 00:27:10.957 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.957 Zero copy mechanism will not be used. 00:27:10.957 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.957 [2024-11-27 21:17:07.056866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:10.957 [2024-11-27 21:17:07.164105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:11.890 21:17:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.890 21:17:07 -- common/autotest_common.sh@862 -- # return 0 00:27:11.890 21:17:07 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.890 21:17:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:12.148 21:17:08 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:12.148 21:17:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.148 21:17:08 -- common/autotest_common.sh@10 -- # set +x 00:27:12.148 21:17:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.148 21:17:08 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.148 21:17:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.714 nvme0n1 00:27:12.714 21:17:08 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:12.714 21:17:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.714 21:17:08 -- common/autotest_common.sh@10 -- # set +x 00:27:12.714 21:17:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.714 21:17:08 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:12.714 21:17:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:12.714 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:12.714 Zero copy mechanism will not be used. 00:27:12.714 Running I/O for 2 seconds... 00:27:12.714 [2024-11-27 21:17:08.829066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.829137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.829161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.835544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.835582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.835603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.843245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.843276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.843312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.849474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.849538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.849560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.856161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.856193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.856227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.862966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.862999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.863017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.869285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.869322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.869351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.874736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.874771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.874794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.880007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.880043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.880061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.885386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.885419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.885439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.890594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.890626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.890643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.895655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.714 [2024-11-27 21:17:08.895689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.714 [2024-11-27 21:17:08.895707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.714 [2024-11-27 21:17:08.901472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.901505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.901530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.906711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.906746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.906768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.912364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.912411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.912434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.919925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.919957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.919974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.928238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.928273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.928293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.937388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.937425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.937445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.944556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.944590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.944611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.715 [2024-11-27 21:17:08.951697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.715 [2024-11-27 21:17:08.951730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.715 [2024-11-27 21:17:08.951752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.959383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.959416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.959435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.967433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.967465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.967481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.975704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.975751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.975769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.983274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.983306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.983329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.990417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.990449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.990481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:08.998208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:08.998239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:08.998257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.005985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.006016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.006051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.012877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.012910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.012927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.020101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.020130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.020163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.025440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.025470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.025487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.033413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.033445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.033463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.040421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.040467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.040484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.046817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.046857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.046878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.053966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.053996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.054028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.060088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.060123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.060143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.066538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.066572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.066605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.073244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.073278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.073298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.079970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.080005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.080025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.086897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.086930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.086962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.974 [2024-11-27 21:17:09.093625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.974 [2024-11-27 21:17:09.093671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.974 [2024-11-27 21:17:09.093689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.099952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.099987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.100006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.107120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.107154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.107174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.113549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.113594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.113610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.119925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.119959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.119979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.126091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.126122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.126140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.131844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.131892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.131912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.139237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.139267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.139299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.145576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.145625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.145641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.152325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.152358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.152377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.157620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.157651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.157675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.162908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.162940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.162958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.169989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.170019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.170052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.176947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.176993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.177014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.184921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.184951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.184968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.192587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.192631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.192647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.200374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.200409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.200429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.975 [2024-11-27 21:17:09.207349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:12.975 [2024-11-27 21:17:09.207398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.975 [2024-11-27 21:17:09.207417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.215796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.215841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.215858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.224114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.224164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.224182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.232102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.232148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.232166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.240543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.240571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.240606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.248093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.248142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.248158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.256596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.256641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.256658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.265218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.265263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.265279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.273388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.273437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.273454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.281257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.281292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.281311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.289860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.289889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.289922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.297195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.297243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.297260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.305262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.305309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.305326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.313511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.313551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.313584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.320388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.320421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.320439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.326902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.326934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.326967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.332703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.332734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.332767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.339302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.339334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.339351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.345932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.345964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.345982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.352455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.352504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.352543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.358740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.358771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.358788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.365207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.365253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.365271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.370832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.370877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.370894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.376825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.376870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.376887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.383628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.232 [2024-11-27 21:17:09.383659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.232 [2024-11-27 21:17:09.383677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.232 [2024-11-27 21:17:09.390003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.390035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.390052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.396352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.396384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.396403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.401856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.401886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.401919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.407228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.407259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.407276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.412738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.412769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.412786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.418405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.418436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.418453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.424102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.424132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.424150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.429720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.429752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.429770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.435265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.435296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.435314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.441835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.441866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.441883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.447669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.447699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.447730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.453139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.453172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.453195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.458997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.459028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.459045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.464829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.464860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.464892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.233 [2024-11-27 21:17:09.470387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.233 [2024-11-27 21:17:09.470419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.233 [2024-11-27 21:17:09.470436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.476054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.476085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.476102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.481458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.481489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.481506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.487054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.487084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.487100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.493801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.493846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.493863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.501137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.501168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.501200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.508392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.508428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.508446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.515671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.515717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.515735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.522083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.522129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.522146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.528585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.528615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.528632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.535084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.491 [2024-11-27 21:17:09.535116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.491 [2024-11-27 21:17:09.535133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.491 [2024-11-27 21:17:09.541338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.541368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.541385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.548010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.548040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.548071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.554703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.554747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.554763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.560102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.560134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.560151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.565284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.565316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.565350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.570392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.570424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.570442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.575051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.575083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.575100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.579712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.579742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.579759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.584666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.584697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.584734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.589646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.589678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.589695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.593928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.593958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.593977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.598474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.598505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.598530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.603028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.603059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.603097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.607795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.607827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.607848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.612275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.612305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.612341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.617060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.617090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.617107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.621721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.621751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.621768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.625852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.625881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.625913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.629293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.629322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.629339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.632847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.632876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.632909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.637298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.637326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.637358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.641452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.641489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.641522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.645943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.645972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.645989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.650325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.650355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.650387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.655145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.655179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.655199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.660919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.660966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.660985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.492 [2024-11-27 21:17:09.666546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.492 [2024-11-27 21:17:09.666590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.492 [2024-11-27 21:17:09.666607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.672568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.672612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.672628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.678163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.678211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.678230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.683870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.683904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.683923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.689461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.689505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.689533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.695031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.695061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.695094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.700609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.700639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.700656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.706036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.706081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.706097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.711598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.711628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.711645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.717059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.717088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.717118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.722637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.722665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.722681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.493 [2024-11-27 21:17:09.728388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.493 [2024-11-27 21:17:09.728434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.493 [2024-11-27 21:17:09.728451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.734322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.734351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.734389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.740104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.740134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.740166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.745632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.745662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.745679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.751303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.751333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.751363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.756651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.756680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.756712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.762211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.762255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.762272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.767759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.767802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.767818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.773226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.773271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.773288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.778922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.778950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.778980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.784502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.784555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.784574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.790233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.790280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.790299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.796023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.796053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.796085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.801596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.801626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.801644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.807107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.807136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.807153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.812580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.812610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.752 [2024-11-27 21:17:09.812627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.752 [2024-11-27 21:17:09.817894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.752 [2024-11-27 21:17:09.817924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.817940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.823463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.823492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.823533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.828889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.828919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.828942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.834487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.834519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.834545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.840152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.840182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.840200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.845694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.845725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.845742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.851359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.851403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.851423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.857300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.857345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.857361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.862832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.862862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.862894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.868578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.868626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.868642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.873998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.874044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.874061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.879740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.879798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.879815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.885171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.885200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.885217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.890708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.890739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.890771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.896219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.896264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.896280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.902066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.902099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.902118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.907466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.907494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.907510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.913322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.913367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.913384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.918935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.918965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.918995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.924441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.924471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.924488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.930123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.930167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.930188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.935618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.935646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.935663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.941167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.941197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.941213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.946677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.946707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.946724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.952465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.952499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.952518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.958094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.958123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.958155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.963618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.753 [2024-11-27 21:17:09.963647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.753 [2024-11-27 21:17:09.963678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.753 [2024-11-27 21:17:09.969364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.754 [2024-11-27 21:17:09.969392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.754 [2024-11-27 21:17:09.969425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.754 [2024-11-27 21:17:09.975155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.754 [2024-11-27 21:17:09.975182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.754 [2024-11-27 21:17:09.975220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.754 [2024-11-27 21:17:09.980420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.754 [2024-11-27 21:17:09.980452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.754 [2024-11-27 21:17:09.980469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.754 [2024-11-27 21:17:09.985679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:13.754 [2024-11-27 21:17:09.985708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.754 [2024-11-27 21:17:09.985726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:09.991600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:09.991632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:09.991650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:09.997295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:09.997331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:09.997350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.002988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.003023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.003041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.009345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.009389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.009408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.014799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.014832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.014850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.020633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.020666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.020683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.026085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.026135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.026153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.031821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.031852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.031869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.037786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.037834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.037852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.043477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.043534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.043557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.049592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.049637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.049663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.055905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.013 [2024-11-27 21:17:10.055956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.013 [2024-11-27 21:17:10.055977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.013 [2024-11-27 21:17:10.063249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.063286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.063306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.071218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.071252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.071271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.077852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.077885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.077903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.085040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.085072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.085089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.091589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.091622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.091640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.098755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.098800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.098820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.104866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.104897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.104914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.111501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.111549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.111593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.116971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.117003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.117021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.124327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.124360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.124378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.131392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.131424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.131442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.138007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.138039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.138063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.144593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.144624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.144663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.150142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.150175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.150193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.155415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.155447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.155467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.161661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.161703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.161720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.168815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.168859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.168875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.175511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.175566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.175584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.181520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.181563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.181582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.188421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.188466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.188484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.194981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.195012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.195030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.200708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.200740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.200758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.207899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.207930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.207947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.214855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.214888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.214910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.222261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.222291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.222308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.229345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.229381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.229414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.236092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.014 [2024-11-27 21:17:10.236127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.014 [2024-11-27 21:17:10.236147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.014 [2024-11-27 21:17:10.242323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.015 [2024-11-27 21:17:10.242356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.015 [2024-11-27 21:17:10.242393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.015 [2024-11-27 21:17:10.249027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.015 [2024-11-27 21:17:10.249059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.015 [2024-11-27 21:17:10.249082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.255565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.255600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.255621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.264036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.264068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.264087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.271884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.271930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.271948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.279917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.279949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.279966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.288461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.288493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.288511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.296591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.296624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.296642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.303146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.303179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.303215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.309499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.309542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.309565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.316863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.316916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.316934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.323433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.323464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.323482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.329833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.329865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.329883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.336589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.336621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.336639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.342154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.342202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.342222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.348011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.348057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.348075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.354141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.354172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.354204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.358208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.358242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.358261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.364448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.364483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.364502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.370688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.370720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.370737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.376336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.376370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.376390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.382187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.382221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.382242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.387723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.387754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.387771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.393310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.393339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.393371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.399003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.399038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.399058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.404656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.404688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.404705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.410321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.410355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.410375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.274 [2024-11-27 21:17:10.416466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.274 [2024-11-27 21:17:10.416510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.274 [2024-11-27 21:17:10.416544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.421999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.422033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.422052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.427845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.427874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.427905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.433763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.433798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.433817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.439540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.439571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.439588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.444936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.444985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.445005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.450501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.450543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.450580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.457002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.457038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.457058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.463294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.463341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.463361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.469784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.469820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.469838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.475606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.475637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.475656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.481345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.481389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.481404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.487158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.487203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.487220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.493201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.493232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.493250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.498868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.498899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.498932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.503980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.504011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.504028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.508397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.508427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.508458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.275 [2024-11-27 21:17:10.512985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.275 [2024-11-27 21:17:10.513016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.275 [2024-11-27 21:17:10.513033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.517432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.517462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.517497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.521745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.521773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.521805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.526589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.526619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.526636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.532227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.532256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.532290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.537991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.538020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.538035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.543443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.543489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.543508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.548966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.549011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.549027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.554521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.554580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.554597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.559891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.559937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.559963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.565322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.565351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.565381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.570955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.570999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.571018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.576522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.576577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.576597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.581623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.581653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.581669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.586553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.586582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.586598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.592112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.592143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.592159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.597566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.597595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.597612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.603101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.603130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.603163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.535 [2024-11-27 21:17:10.608628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.535 [2024-11-27 21:17:10.608658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.535 [2024-11-27 21:17:10.608675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.614155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.614201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.614217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.619784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.619812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.619828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.625268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.625313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.625332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.630578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.630607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.630624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.636271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.636299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.636329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.641997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.642024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.642041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.647696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.647726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.647742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.653155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.653185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.653222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.658659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.658689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.658706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.664157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.664188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.664220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.669835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.669865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.669882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.675707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.675754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.675771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.681235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.681265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.681298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.686750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.686795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.686811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.692331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.692375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.692391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.697987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.698017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.698034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.703634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.703683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.703701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.709116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.709162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.709179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.714697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.714727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.714759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.720221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.720265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.720282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.726361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.726404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.726421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.733976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.734020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.734037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.741411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.741441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.741458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.748248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.748278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.748294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.755768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.755797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.755830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.761985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.762017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.536 [2024-11-27 21:17:10.762034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.536 [2024-11-27 21:17:10.768244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.536 [2024-11-27 21:17:10.768276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.537 [2024-11-27 21:17:10.768309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.775044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.775091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.775111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.781333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.781365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.781387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.787663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.787695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.787718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.794763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.794794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.794812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.801299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.801342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.801362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.807749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.807781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.807798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.815131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.815161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.815200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.821688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.821719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.821756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.795 [2024-11-27 21:17:10.830223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1512bb0) 00:27:14.795 [2024-11-27 21:17:10.830254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.795 [2024-11-27 21:17:10.830286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.795 00:27:14.795 Latency(us) 00:27:14.795 [2024-11-27T20:17:11.036Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.795 [2024-11-27T20:17:11.036Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:14.795 nvme0n1 : 2.00 5081.21 635.15 0.00 0.00 3143.71 670.53 9126.49 00:27:14.795 [2024-11-27T20:17:11.036Z] =================================================================================================================== 00:27:14.795 [2024-11-27T20:17:11.036Z] Total : 5081.21 635.15 0.00 0.00 3143.71 670.53 9126.49 00:27:14.795 0 00:27:14.795 21:17:10 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:14.795 21:17:10 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:14.795 21:17:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:14.795 21:17:10 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:14.795 | .driver_specific 00:27:14.795 | .nvme_error 00:27:14.795 | .status_code 00:27:14.795 | .command_transient_transport_error' 00:27:15.053 21:17:11 -- host/digest.sh@71 -- # (( 328 > 0 )) 00:27:15.053 21:17:11 -- host/digest.sh@73 -- # killprocess 4098125 00:27:15.053 21:17:11 -- common/autotest_common.sh@936 -- # '[' -z 4098125 ']' 00:27:15.053 21:17:11 -- common/autotest_common.sh@940 -- # kill -0 4098125 00:27:15.053 21:17:11 -- common/autotest_common.sh@941 -- # uname 00:27:15.053 21:17:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.053 21:17:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4098125 00:27:15.053 21:17:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:15.053 21:17:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:15.053 21:17:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4098125' 00:27:15.053 killing process with pid 4098125 00:27:15.053 21:17:11 -- common/autotest_common.sh@955 -- # kill 4098125 00:27:15.053 Received shutdown signal, test time was about 2.000000 seconds 00:27:15.053 00:27:15.053 Latency(us) 00:27:15.053 [2024-11-27T20:17:11.294Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:15.053 [2024-11-27T20:17:11.294Z] =================================================================================================================== 00:27:15.053 [2024-11-27T20:17:11.294Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:15.053 21:17:11 -- common/autotest_common.sh@960 -- # wait 4098125 00:27:15.311 21:17:11 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:15.311 21:17:11 -- host/digest.sh@54 -- # local rw bs qd 00:27:15.311 21:17:11 -- host/digest.sh@56 -- # rw=randwrite 00:27:15.311 21:17:11 -- host/digest.sh@56 -- # bs=4096 00:27:15.311 21:17:11 -- host/digest.sh@56 -- # qd=128 00:27:15.311 21:17:11 -- host/digest.sh@58 -- # bperfpid=4098683 00:27:15.311 21:17:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:15.311 21:17:11 -- host/digest.sh@60 -- # waitforlisten 4098683 /var/tmp/bperf.sock 00:27:15.311 21:17:11 -- common/autotest_common.sh@829 -- # '[' -z 4098683 ']' 00:27:15.311 21:17:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:15.311 21:17:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:15.311 21:17:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:15.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:15.311 21:17:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:15.311 21:17:11 -- common/autotest_common.sh@10 -- # set +x 00:27:15.311 [2024-11-27 21:17:11.447719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:15.311 [2024-11-27 21:17:11.447800] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4098683 ] 00:27:15.311 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.311 [2024-11-27 21:17:11.508200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:15.570 [2024-11-27 21:17:11.620014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:16.504 21:17:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:16.504 21:17:12 -- common/autotest_common.sh@862 -- # return 0 00:27:16.504 21:17:12 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:16.504 21:17:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:16.504 21:17:12 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:16.504 21:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:16.504 21:17:12 -- common/autotest_common.sh@10 -- # set +x 00:27:16.504 21:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:16.504 21:17:12 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:16.504 21:17:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:17.070 nvme0n1 00:27:17.070 21:17:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:17.070 21:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:17.070 21:17:13 -- common/autotest_common.sh@10 -- # set +x 00:27:17.070 21:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:17.070 21:17:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:17.070 21:17:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:17.070 Running I/O for 2 seconds... 00:27:17.070 [2024-11-27 21:17:13.268732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eea00 00:27:17.070 [2024-11-27 21:17:13.269731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.070 [2024-11-27 21:17:13.269770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.070 [2024-11-27 21:17:13.282667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f1868 00:27:17.070 [2024-11-27 21:17:13.283863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.070 [2024-11-27 21:17:13.283913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:17.070 [2024-11-27 21:17:13.296054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2510 00:27:17.070 [2024-11-27 21:17:13.297414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:4112 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.070 [2024-11-27 21:17:13.297456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:17.070 [2024-11-27 21:17:13.309634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f6890 00:27:17.070 [2024-11-27 21:17:13.310966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.070 [2024-11-27 21:17:13.310996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.323487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ef270 00:27:17.330 [2024-11-27 21:17:13.324841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.324887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.337116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0ff8 00:27:17.330 [2024-11-27 21:17:13.338444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:16265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.338477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.350616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ef6a8 00:27:17.330 [2024-11-27 21:17:13.351962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:2417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.351995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.364032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2510 00:27:17.330 [2024-11-27 21:17:13.365390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24390 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.365420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.377398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f5378 00:27:17.330 [2024-11-27 21:17:13.378702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:23890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.378731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.391033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7970 00:27:17.330 [2024-11-27 21:17:13.392347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.392397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.404518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f96f8 00:27:17.330 [2024-11-27 21:17:13.405846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.405891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.418078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6b70 00:27:17.330 [2024-11-27 21:17:13.419563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:23642 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.419611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.431677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7538 00:27:17.330 [2024-11-27 21:17:13.432994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.330 [2024-11-27 21:17:13.433027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:17.330 [2024-11-27 21:17:13.445375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ef6a8 00:27:17.330 [2024-11-27 21:17:13.446651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.446681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.458989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4b08 00:27:17.331 [2024-11-27 21:17:13.460278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:11124 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.460311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.472545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e3498 00:27:17.331 [2024-11-27 21:17:13.473807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.473854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.486017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e3d08 00:27:17.331 [2024-11-27 21:17:13.487252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.487284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.499042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eaab8 00:27:17.331 [2024-11-27 21:17:13.499664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11617 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.499706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.516555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5a90 00:27:17.331 [2024-11-27 21:17:13.518391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:7095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.518423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.530141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ed0b0 00:27:17.331 [2024-11-27 21:17:13.532024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.532056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.544047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eea00 00:27:17.331 [2024-11-27 21:17:13.544998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:7058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.545029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.557451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e4de8 00:27:17.331 [2024-11-27 21:17:13.559285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:23648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.331 [2024-11-27 21:17:13.559317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:17.331 [2024-11-27 21:17:13.569671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e01f8 00:27:17.590 [2024-11-27 21:17:13.570769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:5471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.570797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.585024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f1430 00:27:17.590 [2024-11-27 21:17:13.586874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:23784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.586905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.598501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190edd58 00:27:17.590 [2024-11-27 21:17:13.600332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:9289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.600365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.611831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0350 00:27:17.590 [2024-11-27 21:17:13.613708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:18532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.613736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.625108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fa3a0 00:27:17.590 [2024-11-27 21:17:13.626899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:22644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.626932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.638330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee190 00:27:17.590 [2024-11-27 21:17:13.640150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:20319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.640182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.651692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f20d8 00:27:17.590 [2024-11-27 21:17:13.653506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:18162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.653551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.665097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6b70 00:27:17.590 [2024-11-27 21:17:13.666889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.666921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:17.590 [2024-11-27 21:17:13.678420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f3a28 00:27:17.590 [2024-11-27 21:17:13.680232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:17582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.590 [2024-11-27 21:17:13.680264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.691847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6b70 00:27:17.591 [2024-11-27 21:17:13.693660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:14729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.693688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.705250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e9e10 00:27:17.591 [2024-11-27 21:17:13.707037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:18525 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.707069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.718651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7970 00:27:17.591 [2024-11-27 21:17:13.720415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.720447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.732065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5220 00:27:17.591 [2024-11-27 21:17:13.733843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:22387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.733889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.745522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e01f8 00:27:17.591 [2024-11-27 21:17:13.747294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:12519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.747326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.758861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190dece0 00:27:17.591 [2024-11-27 21:17:13.760606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:7690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.760635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.772289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6b70 00:27:17.591 [2024-11-27 21:17:13.774036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:13659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.774074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.785630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e3060 00:27:17.591 [2024-11-27 21:17:13.787359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:24027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.787391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.799643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ea248 00:27:17.591 [2024-11-27 21:17:13.801300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:17453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.801332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.812970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7538 00:27:17.591 [2024-11-27 21:17:13.814660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:10280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.814688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:17.591 [2024-11-27 21:17:13.826410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fb048 00:27:17.591 [2024-11-27 21:17:13.828036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:6445 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.591 [2024-11-27 21:17:13.828065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.839975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190de8a8 00:27:17.850 [2024-11-27 21:17:13.841640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:13998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.841667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.853274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190df550 00:27:17.850 [2024-11-27 21:17:13.854924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:12609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.854956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.866732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fac10 00:27:17.850 [2024-11-27 21:17:13.868388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:7062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.868419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.880266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7100 00:27:17.850 [2024-11-27 21:17:13.881896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:11726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.881925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.893678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e9168 00:27:17.850 [2024-11-27 21:17:13.895317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:14436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.895349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.907144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e3060 00:27:17.850 [2024-11-27 21:17:13.908780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:1842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.908808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.920643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f20d8 00:27:17.850 [2024-11-27 21:17:13.922253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.922285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.934035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eb328 00:27:17.850 [2024-11-27 21:17:13.935647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.935675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.947545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ed4e8 00:27:17.850 [2024-11-27 21:17:13.949107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:19235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.949139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.960980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e73e0 00:27:17.850 [2024-11-27 21:17:13.962539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:10312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.962584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.974271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5220 00:27:17.850 [2024-11-27 21:17:13.975876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.975908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:13.987840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4298 00:27:17.850 [2024-11-27 21:17:13.989414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:15199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:13.989446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:14.001216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1710 00:27:17.850 [2024-11-27 21:17:14.002794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:10947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:14.002840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:14.014683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e0a68 00:27:17.850 [2024-11-27 21:17:14.015906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:14.015938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:14.028490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0bc0 00:27:17.850 [2024-11-27 21:17:14.029968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:1745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.850 [2024-11-27 21:17:14.030000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:17.850 [2024-11-27 21:17:14.041726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1710 00:27:17.850 [2024-11-27 21:17:14.043267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:4789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.851 [2024-11-27 21:17:14.043299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:17.851 [2024-11-27 21:17:14.055124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e27f0 00:27:17.851 [2024-11-27 21:17:14.056648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.851 [2024-11-27 21:17:14.056677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:17.851 [2024-11-27 21:17:14.068415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0ff8 00:27:17.851 [2024-11-27 21:17:14.069886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.851 [2024-11-27 21:17:14.069929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:17.851 [2024-11-27 21:17:14.081890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f1430 00:27:17.851 [2024-11-27 21:17:14.083379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:16380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.851 [2024-11-27 21:17:14.083411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.095858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f20d8 00:27:18.110 [2024-11-27 21:17:14.097324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:7081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.097356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.109231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f1868 00:27:18.110 [2024-11-27 21:17:14.110743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:2679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.110786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.122777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4298 00:27:18.110 [2024-11-27 21:17:14.124247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.124286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.136427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e84c0 00:27:18.110 [2024-11-27 21:17:14.137892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.137939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.149857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e8d30 00:27:18.110 [2024-11-27 21:17:14.151296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:24039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.151328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.163257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190dfdc0 00:27:18.110 [2024-11-27 21:17:14.164703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.164732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.176612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e9e10 00:27:18.110 [2024-11-27 21:17:14.178006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:1238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.178037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.190001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0350 00:27:18.110 [2024-11-27 21:17:14.191420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:4941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.191452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.203410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eee38 00:27:18.110 [2024-11-27 21:17:14.204795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:11081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.204841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.216942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6fa8 00:27:18.110 [2024-11-27 21:17:14.218344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:10233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.218376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.230476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee190 00:27:18.110 [2024-11-27 21:17:14.231680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.231708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.243417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e4140 00:27:18.110 [2024-11-27 21:17:14.244146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:12833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.244177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.257882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190edd58 00:27:18.110 [2024-11-27 21:17:14.259171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:23004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.259202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.271678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eff18 00:27:18.110 [2024-11-27 21:17:14.271972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:18097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.272001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.284935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ecc78 00:27:18.110 [2024-11-27 21:17:14.286260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:12562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.286292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.298769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f3e60 00:27:18.110 [2024-11-27 21:17:14.299054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:8705 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.299087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.312434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eb760 00:27:18.110 [2024-11-27 21:17:14.312728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:1499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.312756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.325968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f20d8 00:27:18.110 [2024-11-27 21:17:14.326379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:22215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.326410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:18.110 [2024-11-27 21:17:14.339403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4298 00:27:18.110 [2024-11-27 21:17:14.339911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:4928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.110 [2024-11-27 21:17:14.339942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.356168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5658 00:27:18.370 [2024-11-27 21:17:14.358030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:6143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.358061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.369668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5220 00:27:18.370 [2024-11-27 21:17:14.371508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:21424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.371549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.382807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5a90 00:27:18.370 [2024-11-27 21:17:14.383829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:19938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.383870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.396657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fc560 00:27:18.370 [2024-11-27 21:17:14.398172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.398203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.409107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190de470 00:27:18.370 [2024-11-27 21:17:14.410147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:18903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.410177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.422290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eff18 00:27:18.370 [2024-11-27 21:17:14.423693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:5625 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.423733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.435698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e84c0 00:27:18.370 [2024-11-27 21:17:14.437102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:17755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.437134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.449166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1b48 00:27:18.370 [2024-11-27 21:17:14.450596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:1165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.450628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.463396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ed4e8 00:27:18.370 [2024-11-27 21:17:14.464352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:16379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.464385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.476517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fd640 00:27:18.370 [2024-11-27 21:17:14.477862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.477908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.489972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e95a0 00:27:18.370 [2024-11-27 21:17:14.491318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:22585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.491351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.503802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f1868 00:27:18.370 [2024-11-27 21:17:14.504774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:12483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.504802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.516934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fe2e8 00:27:18.370 [2024-11-27 21:17:14.518231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:22408 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.518273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.529744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4b08 00:27:18.370 [2024-11-27 21:17:14.531046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:14658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.531082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.542968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ed4e8 00:27:18.370 [2024-11-27 21:17:14.544270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:4403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.544303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.556496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190dece0 00:27:18.370 [2024-11-27 21:17:14.557782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:9059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.557811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.569602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f4f40 00:27:18.370 [2024-11-27 21:17:14.570926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:18512 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.570956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.582918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2d80 00:27:18.370 [2024-11-27 21:17:14.584197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:13417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.584240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:18.370 [2024-11-27 21:17:14.596359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e5658 00:27:18.370 [2024-11-27 21:17:14.597660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:1202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.370 [2024-11-27 21:17:14.597690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.610223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2510 00:27:18.630 [2024-11-27 21:17:14.611473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:23792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.611502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.623892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e4578 00:27:18.630 [2024-11-27 21:17:14.625153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:1746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.625184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.637509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e84c0 00:27:18.630 [2024-11-27 21:17:14.638774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:14418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.638803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.651228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e73e0 00:27:18.630 [2024-11-27 21:17:14.652461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:18122 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.652490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.664735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f81e0 00:27:18.630 [2024-11-27 21:17:14.665979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:1821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.666011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.678208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f7538 00:27:18.630 [2024-11-27 21:17:14.679429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:3644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.679461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.691745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f3a28 00:27:18.630 [2024-11-27 21:17:14.692960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:22661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.692992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.705120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6738 00:27:18.630 [2024-11-27 21:17:14.706335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.706367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.721575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee5c8 00:27:18.630 [2024-11-27 21:17:14.722481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5839 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.722512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.735029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f6020 00:27:18.630 [2024-11-27 21:17:14.735895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.735925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.748428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fe720 00:27:18.630 [2024-11-27 21:17:14.749334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:20161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.749365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.761924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fd640 00:27:18.630 [2024-11-27 21:17:14.762824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:2461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.762852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.775348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1b48 00:27:18.630 [2024-11-27 21:17:14.776187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:2585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.776217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.788782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e0a68 00:27:18.630 [2024-11-27 21:17:14.789587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:12795 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.789615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.802262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6300 00:27:18.630 [2024-11-27 21:17:14.803026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:23793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.803057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.815707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f3e60 00:27:18.630 [2024-11-27 21:17:14.816445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:17141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.816475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.829262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190de8a8 00:27:18.630 [2024-11-27 21:17:14.829989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.830025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.842705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e8d30 00:27:18.630 [2024-11-27 21:17:14.843436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:4125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.843466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.856201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2510 00:27:18.630 [2024-11-27 21:17:14.856911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:22319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.630 [2024-11-27 21:17:14.856942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:18.630 [2024-11-27 21:17:14.869746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f3a28 00:27:18.890 [2024-11-27 21:17:14.870540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.870570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.883319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eea00 00:27:18.890 [2024-11-27 21:17:14.883967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:17841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.883997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.896705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee5c8 00:27:18.890 [2024-11-27 21:17:14.897372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:19144 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.897402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.910092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e84c0 00:27:18.890 [2024-11-27 21:17:14.910769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10697 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.910797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.923458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1b48 00:27:18.890 [2024-11-27 21:17:14.924145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.924175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.936786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fe2e8 00:27:18.890 [2024-11-27 21:17:14.937474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.937504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.950328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fcdd0 00:27:18.890 [2024-11-27 21:17:14.950957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:4248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.950988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.963732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eaef0 00:27:18.890 [2024-11-27 21:17:14.964344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.964375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.977166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f6cc8 00:27:18.890 [2024-11-27 21:17:14.977918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.977948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:14.990668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190dece0 00:27:18.890 [2024-11-27 21:17:14.991374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:14.991404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.004961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f31b8 00:27:18.890 [2024-11-27 21:17:15.006077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:19166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.006108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.018501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee5c8 00:27:18.890 [2024-11-27 21:17:15.019242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.019273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.031733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e73e0 00:27:18.890 [2024-11-27 21:17:15.033416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.033448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.045659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e6b70 00:27:18.890 [2024-11-27 21:17:15.046398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:17461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.046429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.059117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e1710 00:27:18.890 [2024-11-27 21:17:15.059957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:25499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.059989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.072612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e99d8 00:27:18.890 [2024-11-27 21:17:15.073433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:14197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.073465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.086009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fbcf0 00:27:18.890 [2024-11-27 21:17:15.086975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:13646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.087005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.101810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eea00 00:27:18.890 [2024-11-27 21:17:15.103159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:5925 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.103190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.112253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fcdd0 00:27:18.890 [2024-11-27 21:17:15.113439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:9084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.113471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:18.890 [2024-11-27 21:17:15.125919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fda78 00:27:18.890 [2024-11-27 21:17:15.126974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:5163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:18.890 [2024-11-27 21:17:15.127006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.141515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fb8b8 00:27:19.149 [2024-11-27 21:17:15.143289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:1391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.143321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.154978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f2510 00:27:19.149 [2024-11-27 21:17:15.156752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:10615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.156794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.168311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190fa7d8 00:27:19.149 [2024-11-27 21:17:15.170066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:21473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.170098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.181642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190eaef0 00:27:19.149 [2024-11-27 21:17:15.183380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.183421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.193552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190ee190 00:27:19.149 [2024-11-27 21:17:15.194626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.194652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.208882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f31b8 00:27:19.149 [2024-11-27 21:17:15.209874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:1723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.209921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.220093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f8e88 00:27:19.149 [2024-11-27 21:17:15.221285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:16603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.221318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.233585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190e23b8 00:27:19.149 [2024-11-27 21:17:15.234733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:8429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.234761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.246971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f0350 00:27:19.149 [2024-11-27 21:17:15.248127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.248159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:19.149 [2024-11-27 21:17:15.260183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dad0) with pdu=0x2000190f6458 00:27:19.149 [2024-11-27 21:17:15.260889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:20920 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:19.149 [2024-11-27 21:17:15.260921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:19.149 00:27:19.149 Latency(us) 00:27:19.149 [2024-11-27T20:17:15.390Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:19.149 [2024-11-27T20:17:15.390Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:19.149 nvme0n1 : 2.01 18827.87 73.55 0.00 0.00 6791.19 3592.34 17670.45 00:27:19.149 [2024-11-27T20:17:15.390Z] =================================================================================================================== 00:27:19.149 [2024-11-27T20:17:15.390Z] Total : 18827.87 73.55 0.00 0.00 6791.19 3592.34 17670.45 00:27:19.149 0 00:27:19.149 21:17:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:19.149 21:17:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:19.149 21:17:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:19.149 | .driver_specific 00:27:19.149 | .nvme_error 00:27:19.149 | .status_code 00:27:19.149 | .command_transient_transport_error' 00:27:19.149 21:17:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:19.407 21:17:15 -- host/digest.sh@71 -- # (( 148 > 0 )) 00:27:19.407 21:17:15 -- host/digest.sh@73 -- # killprocess 4098683 00:27:19.407 21:17:15 -- common/autotest_common.sh@936 -- # '[' -z 4098683 ']' 00:27:19.407 21:17:15 -- common/autotest_common.sh@940 -- # kill -0 4098683 00:27:19.407 21:17:15 -- common/autotest_common.sh@941 -- # uname 00:27:19.407 21:17:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:19.407 21:17:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4098683 00:27:19.407 21:17:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:19.407 21:17:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:19.407 21:17:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4098683' 00:27:19.407 killing process with pid 4098683 00:27:19.407 21:17:15 -- common/autotest_common.sh@955 -- # kill 4098683 00:27:19.407 Received shutdown signal, test time was about 2.000000 seconds 00:27:19.407 00:27:19.407 Latency(us) 00:27:19.407 [2024-11-27T20:17:15.648Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:19.407 [2024-11-27T20:17:15.648Z] =================================================================================================================== 00:27:19.407 [2024-11-27T20:17:15.648Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:19.407 21:17:15 -- common/autotest_common.sh@960 -- # wait 4098683 00:27:19.665 21:17:15 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:19.665 21:17:15 -- host/digest.sh@54 -- # local rw bs qd 00:27:19.665 21:17:15 -- host/digest.sh@56 -- # rw=randwrite 00:27:19.665 21:17:15 -- host/digest.sh@56 -- # bs=131072 00:27:19.665 21:17:15 -- host/digest.sh@56 -- # qd=16 00:27:19.665 21:17:15 -- host/digest.sh@58 -- # bperfpid=4099232 00:27:19.665 21:17:15 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:19.665 21:17:15 -- host/digest.sh@60 -- # waitforlisten 4099232 /var/tmp/bperf.sock 00:27:19.665 21:17:15 -- common/autotest_common.sh@829 -- # '[' -z 4099232 ']' 00:27:19.665 21:17:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:19.665 21:17:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:19.665 21:17:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:19.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:19.665 21:17:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:19.665 21:17:15 -- common/autotest_common.sh@10 -- # set +x 00:27:19.665 [2024-11-27 21:17:15.873448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.665 [2024-11-27 21:17:15.873537] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099232 ] 00:27:19.665 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:19.665 Zero copy mechanism will not be used. 00:27:19.665 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.923 [2024-11-27 21:17:15.934128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:19.923 [2024-11-27 21:17:16.048058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:20.858 21:17:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:20.858 21:17:16 -- common/autotest_common.sh@862 -- # return 0 00:27:20.858 21:17:16 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:20.858 21:17:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:21.117 21:17:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:21.117 21:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.117 21:17:17 -- common/autotest_common.sh@10 -- # set +x 00:27:21.117 21:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.117 21:17:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:21.117 21:17:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:21.375 nvme0n1 00:27:21.375 21:17:17 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:21.375 21:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.375 21:17:17 -- common/autotest_common.sh@10 -- # set +x 00:27:21.375 21:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.375 21:17:17 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:21.375 21:17:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:21.375 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:21.375 Zero copy mechanism will not be used. 00:27:21.375 Running I/O for 2 seconds... 00:27:21.375 [2024-11-27 21:17:17.613469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.376 [2024-11-27 21:17:17.614067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.376 [2024-11-27 21:17:17.614116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.619182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.619685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.636 [2024-11-27 21:17:17.619716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.624447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.624764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.636 [2024-11-27 21:17:17.624795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.630323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.630543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.636 [2024-11-27 21:17:17.630647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.635314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.635609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.636 [2024-11-27 21:17:17.635684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.640137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.640462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.636 [2024-11-27 21:17:17.640557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.636 [2024-11-27 21:17:17.645067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.636 [2024-11-27 21:17:17.645469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.645502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.649843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.650321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.650411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.654738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.654989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.655072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.659543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.659898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.659976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.664458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.664832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.664928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.669327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.669812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.669846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.674149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.674630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.674702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.679073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.679398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.679431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.683931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.684322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.684355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.688852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.689384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.689475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.693756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.694288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.694379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.698761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.699189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.699221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.703663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.703907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.704001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.708535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.709057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.709138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.713400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.713809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.713842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.718256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.718673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.718729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.723242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.723487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.723604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.728097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.728565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.728611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.732993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.733448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.733480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.737882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.738308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.738364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.742748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.743189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.743290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.637 [2024-11-27 21:17:17.747770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.637 [2024-11-27 21:17:17.748178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.637 [2024-11-27 21:17:17.748254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.752618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.752916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.752950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.757500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.757817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.757914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.762285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.762617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.762701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.767316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.767724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.767795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.772327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.772704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.772781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.777202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.777837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.777909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.782179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.782620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.782653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.787025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.787601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.787631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.791856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.792253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.792285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.796643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.796984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.797079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.801598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.801969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.802002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.806487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.806962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.807047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.811252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.811687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.811717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.816167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.816657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.816720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.820957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.821263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.821348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.825679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.825956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.826034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.830569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.831094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.831126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.835393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.835732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.835762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.840269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.840663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.840745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.845091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.845687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.845726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.638 [2024-11-27 21:17:17.849961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.638 [2024-11-27 21:17:17.850401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.638 [2024-11-27 21:17:17.850486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.639 [2024-11-27 21:17:17.854856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.639 [2024-11-27 21:17:17.855156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.639 [2024-11-27 21:17:17.855190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.639 [2024-11-27 21:17:17.859715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.639 [2024-11-27 21:17:17.860164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.639 [2024-11-27 21:17:17.860199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.639 [2024-11-27 21:17:17.864469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.639 [2024-11-27 21:17:17.864994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.639 [2024-11-27 21:17:17.865084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.639 [2024-11-27 21:17:17.869367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.639 [2024-11-27 21:17:17.869701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.639 [2024-11-27 21:17:17.869750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.639 [2024-11-27 21:17:17.874451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.639 [2024-11-27 21:17:17.874718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.639 [2024-11-27 21:17:17.874755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.879368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.879770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.879800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.884397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.884804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.884853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.889213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.889628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.889711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.894086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.894417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.894451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.898756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.899015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.899106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.903655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.904030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.904064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.908349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.908700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.908778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.912911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.913362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.913445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.917632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.917774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.917803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.923024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.923206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.923235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.927733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.928081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.928112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.932126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.932502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.932554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.936660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.936872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.936949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.941149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.941423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.941516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.945659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.945938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.946016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.950336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.950664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.950734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.954741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.955055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.955085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.959139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.959418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.959448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.963650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.963833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.963910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.968304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.968551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.968581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.972833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.973102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.973183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.977608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.977907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.977978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.981987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.982347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.982421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.986330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.986574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.986648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.990895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.991121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.991215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.995325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:17.995802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:17.995832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:17.999890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.000237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.000267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.004473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.004814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.004845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.008997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.009357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.009387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.013600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.013840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.013928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.018134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.018445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.018517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.022764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.023123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.023209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.027283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.027629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.027720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.031901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.902 [2024-11-27 21:17:18.032268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.902 [2024-11-27 21:17:18.032297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.902 [2024-11-27 21:17:18.036440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.036927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.036956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.040946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.041459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.041573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.045637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.045884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.045914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.050135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.050406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.050501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.054815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.055098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.055138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.059458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.059702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.059786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.064247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.064503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.064540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.069933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.070155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.070193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.076649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.077016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.077046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.083633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.083850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.083911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.090801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.091142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.091207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.097589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.097789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.097902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.103863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.104048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.104128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.110440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.110671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.110701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.116930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.117152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.117182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.123599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.123763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.123795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.130573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:21.903 [2024-11-27 21:17:18.130884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.903 [2024-11-27 21:17:18.130914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.903 [2024-11-27 21:17:18.137628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.160 [2024-11-27 21:17:18.137901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.137931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.144337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.144556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.144587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.151342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.151643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.151672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.158055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.158221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.158249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.164800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.164952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.164982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.171375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.171565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.171594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.177881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.178029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.178059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.184925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.185284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.185314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.191415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.191651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.191701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.198738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.198932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.198962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.205247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.205410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.205439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.210310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.210601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.210675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.214949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.215204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.215273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.219420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.219802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.219891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.224004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.224234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.224313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.228564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.228933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.228962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.233103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.233483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.233577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.237443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.237682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.237756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.242089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.242455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.242566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.246642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.246830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.246860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.251251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.251595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.251672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.255779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.256087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.256117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.260538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.260809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.260844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.265059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.265369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.265399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.269488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.269805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.269895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.274051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.274444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.274495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.278569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.278901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.278931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.283110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.283386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.283416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.287615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.287846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.287876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.292195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.292522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.292560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.296704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.296999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.297030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.301189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.301552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.301582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.305790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.306089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.306118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.310212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.310647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.310717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.314638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.315002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.315086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.319204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.319489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.319519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.323756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.323897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.323973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.328439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.328779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.328883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.332862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.333065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.333095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.337394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.337662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.337694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.341780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.342065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.342140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.346228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.346353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.346431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.350919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.351389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.351458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.355455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.355730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.355808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.359854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.161 [2024-11-27 21:17:18.360021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.161 [2024-11-27 21:17:18.360116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.161 [2024-11-27 21:17:18.364362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.364605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.364665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.368888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.369132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.369202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.373477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.373930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.374022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.377821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.378190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.378285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.382386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.382679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.382709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.386994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.387287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.387380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.391503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.391872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.391904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.396008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.162 [2024-11-27 21:17:18.396349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.162 [2024-11-27 21:17:18.396381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.162 [2024-11-27 21:17:18.400673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.400882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.400935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.405147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.405407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.405485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.409664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.409874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.409948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.414202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.414656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.414686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.418936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.419173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.419202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.424835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.425120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.425201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.431473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.431611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.431644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.438362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.438561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.438590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.444389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.444652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.444722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.451235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.451374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.451407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.458472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.458659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.458688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.464368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.464761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.464792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.468804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.469326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.469356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.473447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.473783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.473822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.477899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.478487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.478516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.482596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.482825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.482907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.487851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.487946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.419 [2024-11-27 21:17:18.487988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.419 [2024-11-27 21:17:18.492818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.419 [2024-11-27 21:17:18.493048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.493080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.497352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.497724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.497798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.501820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.502280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.502352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.506319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.506807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.506851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.511120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.511451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.511537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.516414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.516581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.516611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.521177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.521632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.521662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.525759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.526042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.526113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.530681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.531045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.531077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.535415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.535841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.535884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.540261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.540703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.540735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.545004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.545407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.545495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.549919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.550389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.550485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.554783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.555252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.555340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.559693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.560096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.560126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.564486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.564881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.564984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.569369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.569709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.569792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.574079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.574286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.574366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.578948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.579435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.579468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.583759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.584272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.584357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.588623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.589125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.589210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.593435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.593785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.593828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.598256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.598663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.598707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.603148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.603433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.603467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.607954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.608288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.608366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.612746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.613183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.613242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.617447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.617749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.617778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.622398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.622902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.622993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.627296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.627921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.628003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.632201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.632747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.632776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.637120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.637607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.637676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.641944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.642365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.642441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.646687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.647149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.647234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.651512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.651844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.651877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.420 [2024-11-27 21:17:18.656453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.420 [2024-11-27 21:17:18.656858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.420 [2024-11-27 21:17:18.656943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.680 [2024-11-27 21:17:18.661294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.680 [2024-11-27 21:17:18.661731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.680 [2024-11-27 21:17:18.661816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.680 [2024-11-27 21:17:18.666133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.680 [2024-11-27 21:17:18.666651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.680 [2024-11-27 21:17:18.666724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.680 [2024-11-27 21:17:18.670878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.680 [2024-11-27 21:17:18.671372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.680 [2024-11-27 21:17:18.671462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.680 [2024-11-27 21:17:18.675762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.676214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.676246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.680498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.680854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.680938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.685327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.685948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.685982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.690238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.690663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.690693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.695102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.695390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.695438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.699974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.700318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.700409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.704629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.705160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.705193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.709495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.709951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.709985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.714341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.714746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.714779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.719157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.719393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.719489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.723902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.724321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.724416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.728720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.729061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.729094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.733493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.733720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.733750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.738371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.738791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.738836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.743027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.743363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.743397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.747779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.748101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.748134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.752556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.752931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.752969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.757326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.757708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.757764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.762125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.762740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.762771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.766937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.767533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.767566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.771788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.681 [2024-11-27 21:17:18.772242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.681 [2024-11-27 21:17:18.772274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.681 [2024-11-27 21:17:18.776697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.776920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.777000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.781632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.781995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.782028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.786381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.786704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.786766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.791316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.791834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.791864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.796218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.796636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.796666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.801032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.801448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.801480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.805804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.806249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.806282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.810480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.810847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.810881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.815355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.815719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.815750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.820070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.820503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.820544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.824964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.825268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.825365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.829933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.830175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.830257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.834691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.835030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.835094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.839708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.840020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.840053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.844578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.845128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.845222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.849317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.849839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.849954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.854189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.854714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.854749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.859113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.859533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.859567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.864027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.864552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.864582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.868851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.869231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.682 [2024-11-27 21:17:18.869264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.682 [2024-11-27 21:17:18.873694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.682 [2024-11-27 21:17:18.874095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.874175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.878492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.878938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.878972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.883215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.883667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.883697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.888160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.888552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.888627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.892970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.893570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.893617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.897801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.898208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.898243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.902620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.902997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.903083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.907400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.907778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.907869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.912278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.912520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.912625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.683 [2024-11-27 21:17:18.917183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.683 [2024-11-27 21:17:18.917571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.683 [2024-11-27 21:17:18.917616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.922045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.922271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.922365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.926852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.927276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.927363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.931664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.931957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.932042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.936560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.937016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.937102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.941320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.941789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.941875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.946177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.942 [2024-11-27 21:17:18.946611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.942 [2024-11-27 21:17:18.946640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.942 [2024-11-27 21:17:18.950976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.951585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.951615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.955743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.956153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.956185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.960421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.960829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.960877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.965302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.965842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.965876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.970109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.970721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.970751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.974892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.975141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.975237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.979771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.980036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.980126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.984607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.984922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.984979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.989616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.990052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.990134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.994411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.994804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.994910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:18.999168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:18.999662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:18.999738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.004032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.004531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.004565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.008865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.009415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.009448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.013663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.014033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.014100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.018592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.019022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.019121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.023579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.024027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.024060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.028279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.028742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.028775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.033074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.033423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.033488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.037924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.038453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.038559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.042796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.043270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.043372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.047561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.047926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.048015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.052262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.052637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.052690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.057158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.057534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.057595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.062026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.062517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.062614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.066908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.067445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.067478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.071845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.072456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.072547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.076543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.076900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.076934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.081430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.081922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.081952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.086166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.086505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.086544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.091001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.091455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.091488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.095833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.096291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.096325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.100695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.101164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.101267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.105502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.105901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.105989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.110326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.110791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.110892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.115187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.115663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.115740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.120156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.120687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.120717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.125222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.125715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.125764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.130246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.130411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.130441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.135864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.136133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.136165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.140736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.141177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.141211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.145517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.146046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.146078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.150557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.150918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.151001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.155266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.155766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.155796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.160264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.160574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.160658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.165215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.943 [2024-11-27 21:17:19.165515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.943 [2024-11-27 21:17:19.165617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:22.943 [2024-11-27 21:17:19.170098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.944 [2024-11-27 21:17:19.170630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.944 [2024-11-27 21:17:19.170691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:22.944 [2024-11-27 21:17:19.175061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.944 [2024-11-27 21:17:19.175659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.944 [2024-11-27 21:17:19.175723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:22.944 [2024-11-27 21:17:19.179926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:22.944 [2024-11-27 21:17:19.180260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:22.944 [2024-11-27 21:17:19.180293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.184892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.185202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.185292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.189678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.190163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.190196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.194501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.194992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.195025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.199142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.199706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.199736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.204041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.204367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.204419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.209258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.209648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.209691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.214326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.214783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.214812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.220316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.220505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.220550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.226993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.227278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.227344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.233822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.234072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.234107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.240780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.241111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.241217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.245912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.246300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.246367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.250940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.251535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.251633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.255743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.203 [2024-11-27 21:17:19.256145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.203 [2024-11-27 21:17:19.256231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.203 [2024-11-27 21:17:19.260686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.261055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.261088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.265556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.266061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.266094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.270333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.270784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.270881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.275286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.275730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.275760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.280123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.280423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.280456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.285069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.285603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.285632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.290010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.290448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.290480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.294779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.295456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.295520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.300128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.300346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.300379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.306341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.306653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.306712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.313033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.313360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.313392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.319151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.319475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.319625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.324473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.324727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.324786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.329398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.329755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.329821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.335340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.335557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.335655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.341842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.342146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.342197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.348934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.349039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.349075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.355573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.355815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.355917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.362420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.362635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.362665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.369803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.369973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.370001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.377121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.377420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.377472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.384098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.384261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.384309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.390395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.390748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.390792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.395317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.395598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.395685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.400035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.400413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.400459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.404780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.405318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.405347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.409868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.204 [2024-11-27 21:17:19.410308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.204 [2024-11-27 21:17:19.410360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.204 [2024-11-27 21:17:19.415947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.205 [2024-11-27 21:17:19.416217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.205 [2024-11-27 21:17:19.416251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.205 [2024-11-27 21:17:19.422315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.205 [2024-11-27 21:17:19.422475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.205 [2024-11-27 21:17:19.422516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.205 [2024-11-27 21:17:19.429233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.205 [2024-11-27 21:17:19.429540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.205 [2024-11-27 21:17:19.429573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.205 [2024-11-27 21:17:19.436139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.205 [2024-11-27 21:17:19.436441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.205 [2024-11-27 21:17:19.436475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.205 [2024-11-27 21:17:19.442343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.205 [2024-11-27 21:17:19.442826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.205 [2024-11-27 21:17:19.442859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.448179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.448826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.448941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.454154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.454652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.454682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.460254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.460721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.460751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.466343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.466619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.466688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.472501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.472780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.472810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.478598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.478952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.479036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.484724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.485082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.485117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.491150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.491386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.491446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.497973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.498153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.498186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.504857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.505091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.505196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.511951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.512247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.512279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.518967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.519260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.519292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.526157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.464 [2024-11-27 21:17:19.526321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.464 [2024-11-27 21:17:19.526355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.464 [2024-11-27 21:17:19.533393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.533555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.533604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.540662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.540802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.540849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.547974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.548202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.548310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.555298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.555612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.555643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.561573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.561945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.561978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.566760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.567163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.567196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.571774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.572176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.572209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.576600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.577019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.577053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.581387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.581802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.581848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.586335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.586774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.586805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.591219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.591669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.591742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.595928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.596158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.596188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.600781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.601118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.601150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:23.465 [2024-11-27 21:17:19.605621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x135dfb0) with pdu=0x2000190fef90 00:27:23.465 [2024-11-27 21:17:19.606029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:23.465 [2024-11-27 21:17:19.606062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:23.465 00:27:23.465 Latency(us) 00:27:23.465 [2024-11-27T20:17:19.706Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:23.465 [2024-11-27T20:17:19.706Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:23.465 nvme0n1 : 2.00 6060.75 757.59 0.00 0.00 2629.19 1771.90 10340.12 00:27:23.465 [2024-11-27T20:17:19.706Z] =================================================================================================================== 00:27:23.465 [2024-11-27T20:17:19.706Z] Total : 6060.75 757.59 0.00 0.00 2629.19 1771.90 10340.12 00:27:23.465 0 00:27:23.465 21:17:19 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:23.465 21:17:19 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:23.465 21:17:19 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:23.465 | .driver_specific 00:27:23.465 | .nvme_error 00:27:23.465 | .status_code 00:27:23.465 | .command_transient_transport_error' 00:27:23.465 21:17:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:23.723 21:17:19 -- host/digest.sh@71 -- # (( 391 > 0 )) 00:27:23.723 21:17:19 -- host/digest.sh@73 -- # killprocess 4099232 00:27:23.723 21:17:19 -- common/autotest_common.sh@936 -- # '[' -z 4099232 ']' 00:27:23.723 21:17:19 -- common/autotest_common.sh@940 -- # kill -0 4099232 00:27:23.723 21:17:19 -- common/autotest_common.sh@941 -- # uname 00:27:23.723 21:17:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:23.723 21:17:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4099232 00:27:23.723 21:17:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:23.723 21:17:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:23.723 21:17:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4099232' 00:27:23.723 killing process with pid 4099232 00:27:23.723 21:17:19 -- common/autotest_common.sh@955 -- # kill 4099232 00:27:23.723 Received shutdown signal, test time was about 2.000000 seconds 00:27:23.723 00:27:23.723 Latency(us) 00:27:23.723 [2024-11-27T20:17:19.964Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:23.723 [2024-11-27T20:17:19.964Z] =================================================================================================================== 00:27:23.723 [2024-11-27T20:17:19.964Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:23.723 21:17:19 -- common/autotest_common.sh@960 -- # wait 4099232 00:27:23.982 21:17:20 -- host/digest.sh@115 -- # killprocess 4097539 00:27:23.982 21:17:20 -- common/autotest_common.sh@936 -- # '[' -z 4097539 ']' 00:27:23.982 21:17:20 -- common/autotest_common.sh@940 -- # kill -0 4097539 00:27:23.982 21:17:20 -- common/autotest_common.sh@941 -- # uname 00:27:23.982 21:17:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:23.982 21:17:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4097539 00:27:23.982 21:17:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:23.982 21:17:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:23.982 21:17:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4097539' 00:27:23.982 killing process with pid 4097539 00:27:23.982 21:17:20 -- common/autotest_common.sh@955 -- # kill 4097539 00:27:23.982 21:17:20 -- common/autotest_common.sh@960 -- # wait 4097539 00:27:24.240 00:27:24.240 real 0m18.278s 00:27:24.240 user 0m35.953s 00:27:24.240 sys 0m4.636s 00:27:24.240 21:17:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:24.240 21:17:20 -- common/autotest_common.sh@10 -- # set +x 00:27:24.240 ************************************ 00:27:24.240 END TEST nvmf_digest_error 00:27:24.240 ************************************ 00:27:24.499 21:17:20 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:24.499 21:17:20 -- host/digest.sh@139 -- # nvmftestfini 00:27:24.499 21:17:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:24.499 21:17:20 -- nvmf/common.sh@116 -- # sync 00:27:24.499 21:17:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:24.499 21:17:20 -- nvmf/common.sh@119 -- # set +e 00:27:24.499 21:17:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:24.499 21:17:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:24.499 rmmod nvme_tcp 00:27:24.499 rmmod nvme_fabrics 00:27:24.499 rmmod nvme_keyring 00:27:24.499 21:17:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:24.499 21:17:20 -- nvmf/common.sh@123 -- # set -e 00:27:24.499 21:17:20 -- nvmf/common.sh@124 -- # return 0 00:27:24.499 21:17:20 -- nvmf/common.sh@477 -- # '[' -n 4097539 ']' 00:27:24.499 21:17:20 -- nvmf/common.sh@478 -- # killprocess 4097539 00:27:24.499 21:17:20 -- common/autotest_common.sh@936 -- # '[' -z 4097539 ']' 00:27:24.499 21:17:20 -- common/autotest_common.sh@940 -- # kill -0 4097539 00:27:24.499 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4097539) - No such process 00:27:24.499 21:17:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4097539 is not found' 00:27:24.499 Process with pid 4097539 is not found 00:27:24.499 21:17:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:24.499 21:17:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:24.499 21:17:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:24.499 21:17:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:24.499 21:17:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:24.499 21:17:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:24.499 21:17:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:24.499 21:17:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:26.404 21:17:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:26.404 00:27:26.404 real 0m38.549s 00:27:26.404 user 1m8.088s 00:27:26.404 sys 0m10.393s 00:27:26.404 21:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:26.404 21:17:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.404 ************************************ 00:27:26.404 END TEST nvmf_digest 00:27:26.404 ************************************ 00:27:26.404 21:17:22 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:26.404 21:17:22 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:26.404 21:17:22 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:26.404 21:17:22 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:26.404 21:17:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:26.404 21:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:26.404 21:17:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.404 ************************************ 00:27:26.404 START TEST nvmf_bdevperf 00:27:26.404 ************************************ 00:27:26.404 21:17:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:26.664 * Looking for test storage... 00:27:26.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:26.664 21:17:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:26.664 21:17:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:26.664 21:17:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:26.664 21:17:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:26.664 21:17:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:26.664 21:17:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:26.664 21:17:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:26.664 21:17:22 -- scripts/common.sh@335 -- # IFS=.-: 00:27:26.664 21:17:22 -- scripts/common.sh@335 -- # read -ra ver1 00:27:26.664 21:17:22 -- scripts/common.sh@336 -- # IFS=.-: 00:27:26.664 21:17:22 -- scripts/common.sh@336 -- # read -ra ver2 00:27:26.664 21:17:22 -- scripts/common.sh@337 -- # local 'op=<' 00:27:26.664 21:17:22 -- scripts/common.sh@339 -- # ver1_l=2 00:27:26.664 21:17:22 -- scripts/common.sh@340 -- # ver2_l=1 00:27:26.664 21:17:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:26.664 21:17:22 -- scripts/common.sh@343 -- # case "$op" in 00:27:26.664 21:17:22 -- scripts/common.sh@344 -- # : 1 00:27:26.664 21:17:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:26.664 21:17:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:26.664 21:17:22 -- scripts/common.sh@364 -- # decimal 1 00:27:26.664 21:17:22 -- scripts/common.sh@352 -- # local d=1 00:27:26.664 21:17:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:26.664 21:17:22 -- scripts/common.sh@354 -- # echo 1 00:27:26.664 21:17:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:26.664 21:17:22 -- scripts/common.sh@365 -- # decimal 2 00:27:26.664 21:17:22 -- scripts/common.sh@352 -- # local d=2 00:27:26.664 21:17:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:26.664 21:17:22 -- scripts/common.sh@354 -- # echo 2 00:27:26.664 21:17:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:26.664 21:17:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:26.664 21:17:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:26.664 21:17:22 -- scripts/common.sh@367 -- # return 0 00:27:26.664 21:17:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:26.664 21:17:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:26.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:26.664 --rc genhtml_branch_coverage=1 00:27:26.664 --rc genhtml_function_coverage=1 00:27:26.664 --rc genhtml_legend=1 00:27:26.664 --rc geninfo_all_blocks=1 00:27:26.664 --rc geninfo_unexecuted_blocks=1 00:27:26.664 00:27:26.664 ' 00:27:26.664 21:17:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:26.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:26.664 --rc genhtml_branch_coverage=1 00:27:26.664 --rc genhtml_function_coverage=1 00:27:26.664 --rc genhtml_legend=1 00:27:26.664 --rc geninfo_all_blocks=1 00:27:26.664 --rc geninfo_unexecuted_blocks=1 00:27:26.664 00:27:26.664 ' 00:27:26.664 21:17:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:26.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:26.664 --rc genhtml_branch_coverage=1 00:27:26.664 --rc genhtml_function_coverage=1 00:27:26.664 --rc genhtml_legend=1 00:27:26.664 --rc geninfo_all_blocks=1 00:27:26.664 --rc geninfo_unexecuted_blocks=1 00:27:26.664 00:27:26.664 ' 00:27:26.664 21:17:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:26.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:26.664 --rc genhtml_branch_coverage=1 00:27:26.664 --rc genhtml_function_coverage=1 00:27:26.664 --rc genhtml_legend=1 00:27:26.664 --rc geninfo_all_blocks=1 00:27:26.664 --rc geninfo_unexecuted_blocks=1 00:27:26.664 00:27:26.664 ' 00:27:26.664 21:17:22 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:26.664 21:17:22 -- nvmf/common.sh@7 -- # uname -s 00:27:26.664 21:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:26.664 21:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:26.664 21:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:26.664 21:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:26.664 21:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:26.665 21:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:26.665 21:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:26.665 21:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:26.665 21:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:26.665 21:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:26.665 21:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:26.665 21:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:26.665 21:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:26.665 21:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:26.665 21:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:26.665 21:17:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:26.665 21:17:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:26.665 21:17:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:26.665 21:17:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:26.665 21:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:26.665 21:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:26.665 21:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:26.665 21:17:22 -- paths/export.sh@5 -- # export PATH 00:27:26.665 21:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:26.665 21:17:22 -- nvmf/common.sh@46 -- # : 0 00:27:26.665 21:17:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:26.665 21:17:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:26.665 21:17:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:26.665 21:17:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:26.665 21:17:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:26.665 21:17:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:26.665 21:17:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:26.665 21:17:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:26.665 21:17:22 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:26.665 21:17:22 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:26.665 21:17:22 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:26.665 21:17:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:26.665 21:17:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:26.665 21:17:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:26.665 21:17:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:26.665 21:17:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:26.665 21:17:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:26.665 21:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:26.665 21:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:26.665 21:17:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:26.665 21:17:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:26.665 21:17:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:26.665 21:17:22 -- common/autotest_common.sh@10 -- # set +x 00:27:28.566 21:17:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:28.566 21:17:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:28.566 21:17:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:28.566 21:17:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:28.566 21:17:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:28.566 21:17:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:28.566 21:17:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:28.566 21:17:24 -- nvmf/common.sh@294 -- # net_devs=() 00:27:28.566 21:17:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:28.566 21:17:24 -- nvmf/common.sh@295 -- # e810=() 00:27:28.566 21:17:24 -- nvmf/common.sh@295 -- # local -ga e810 00:27:28.566 21:17:24 -- nvmf/common.sh@296 -- # x722=() 00:27:28.566 21:17:24 -- nvmf/common.sh@296 -- # local -ga x722 00:27:28.566 21:17:24 -- nvmf/common.sh@297 -- # mlx=() 00:27:28.566 21:17:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:28.566 21:17:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:28.566 21:17:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:28.566 21:17:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:28.566 21:17:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:28.566 21:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.566 21:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:28.566 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:28.566 21:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.566 21:17:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:28.566 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:28.566 21:17:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:28.566 21:17:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:28.566 21:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.566 21:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.566 21:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.566 21:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.566 21:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:28.567 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:28.567 21:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.567 21:17:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.567 21:17:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.567 21:17:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.567 21:17:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.567 21:17:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:28.567 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:28.567 21:17:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.567 21:17:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:28.567 21:17:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:28.567 21:17:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:28.567 21:17:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:28.567 21:17:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:28.567 21:17:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:28.567 21:17:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:28.567 21:17:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:28.567 21:17:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:28.567 21:17:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:28.567 21:17:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:28.567 21:17:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:28.567 21:17:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:28.567 21:17:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:28.567 21:17:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:28.567 21:17:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:28.567 21:17:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:28.567 21:17:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:28.567 21:17:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:28.567 21:17:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:28.567 21:17:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:28.567 21:17:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:28.567 21:17:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:28.567 21:17:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:28.567 21:17:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:28.567 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:28.567 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:27:28.567 00:27:28.567 --- 10.0.0.2 ping statistics --- 00:27:28.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:28.567 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:27:28.567 21:17:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:28.567 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:28.567 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:27:28.567 00:27:28.567 --- 10.0.0.1 ping statistics --- 00:27:28.567 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:28.567 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:27:28.567 21:17:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:28.567 21:17:24 -- nvmf/common.sh@410 -- # return 0 00:27:28.567 21:17:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:28.567 21:17:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:28.567 21:17:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:28.567 21:17:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:28.567 21:17:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:28.567 21:17:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:28.567 21:17:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:28.826 21:17:24 -- host/bdevperf.sh@25 -- # tgt_init 00:27:28.826 21:17:24 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:28.826 21:17:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:28.826 21:17:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.826 21:17:24 -- common/autotest_common.sh@10 -- # set +x 00:27:28.826 21:17:24 -- nvmf/common.sh@469 -- # nvmfpid=4101742 00:27:28.826 21:17:24 -- nvmf/common.sh@470 -- # waitforlisten 4101742 00:27:28.826 21:17:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:28.826 21:17:24 -- common/autotest_common.sh@829 -- # '[' -z 4101742 ']' 00:27:28.826 21:17:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:28.826 21:17:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:28.826 21:17:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:28.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:28.826 21:17:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:28.826 21:17:24 -- common/autotest_common.sh@10 -- # set +x 00:27:28.826 [2024-11-27 21:17:24.872551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:28.826 [2024-11-27 21:17:24.872640] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:28.826 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.826 [2024-11-27 21:17:24.937842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:28.826 [2024-11-27 21:17:25.049754] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:28.826 [2024-11-27 21:17:25.049918] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:28.826 [2024-11-27 21:17:25.049935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:28.826 [2024-11-27 21:17:25.049947] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:28.826 [2024-11-27 21:17:25.050034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:28.826 [2024-11-27 21:17:25.050161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:28.826 [2024-11-27 21:17:25.050163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:29.760 21:17:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:29.760 21:17:25 -- common/autotest_common.sh@862 -- # return 0 00:27:29.760 21:17:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:29.760 21:17:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 21:17:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.761 21:17:25 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:29.761 21:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 [2024-11-27 21:17:25.869185] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:29.761 21:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.761 21:17:25 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:29.761 21:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 Malloc0 00:27:29.761 21:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.761 21:17:25 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:29.761 21:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 21:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.761 21:17:25 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:29.761 21:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 21:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.761 21:17:25 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:29.761 21:17:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.761 21:17:25 -- common/autotest_common.sh@10 -- # set +x 00:27:29.761 [2024-11-27 21:17:25.931876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:29.761 21:17:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.761 21:17:25 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:29.761 21:17:25 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:29.761 21:17:25 -- nvmf/common.sh@520 -- # config=() 00:27:29.761 21:17:25 -- nvmf/common.sh@520 -- # local subsystem config 00:27:29.761 21:17:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:29.761 21:17:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:29.761 { 00:27:29.761 "params": { 00:27:29.761 "name": "Nvme$subsystem", 00:27:29.761 "trtype": "$TEST_TRANSPORT", 00:27:29.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:29.761 "adrfam": "ipv4", 00:27:29.761 "trsvcid": "$NVMF_PORT", 00:27:29.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:29.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:29.761 "hdgst": ${hdgst:-false}, 00:27:29.761 "ddgst": ${ddgst:-false} 00:27:29.761 }, 00:27:29.761 "method": "bdev_nvme_attach_controller" 00:27:29.761 } 00:27:29.761 EOF 00:27:29.761 )") 00:27:29.761 21:17:25 -- nvmf/common.sh@542 -- # cat 00:27:29.761 21:17:25 -- nvmf/common.sh@544 -- # jq . 00:27:29.761 21:17:25 -- nvmf/common.sh@545 -- # IFS=, 00:27:29.761 21:17:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:29.761 "params": { 00:27:29.761 "name": "Nvme1", 00:27:29.761 "trtype": "tcp", 00:27:29.761 "traddr": "10.0.0.2", 00:27:29.761 "adrfam": "ipv4", 00:27:29.761 "trsvcid": "4420", 00:27:29.761 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:29.761 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:29.761 "hdgst": false, 00:27:29.761 "ddgst": false 00:27:29.761 }, 00:27:29.761 "method": "bdev_nvme_attach_controller" 00:27:29.761 }' 00:27:29.761 [2024-11-27 21:17:25.973654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:29.761 [2024-11-27 21:17:25.973736] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4101902 ] 00:27:30.019 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.019 [2024-11-27 21:17:26.035041] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:30.019 [2024-11-27 21:17:26.142046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:30.278 Running I/O for 1 seconds... 00:27:31.657 00:27:31.657 Latency(us) 00:27:31.657 [2024-11-27T20:17:27.898Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:31.657 [2024-11-27T20:17:27.898Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:31.657 Verification LBA range: start 0x0 length 0x4000 00:27:31.657 Nvme1n1 : 1.00 12964.29 50.64 0.00 0.00 9829.65 1159.02 17282.09 00:27:31.657 [2024-11-27T20:17:27.898Z] =================================================================================================================== 00:27:31.657 [2024-11-27T20:17:27.898Z] Total : 12964.29 50.64 0.00 0.00 9829.65 1159.02 17282.09 00:27:31.657 21:17:27 -- host/bdevperf.sh@30 -- # bdevperfpid=4102052 00:27:31.657 21:17:27 -- host/bdevperf.sh@32 -- # sleep 3 00:27:31.657 21:17:27 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:31.657 21:17:27 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:31.657 21:17:27 -- nvmf/common.sh@520 -- # config=() 00:27:31.657 21:17:27 -- nvmf/common.sh@520 -- # local subsystem config 00:27:31.657 21:17:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:31.657 21:17:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:31.657 { 00:27:31.657 "params": { 00:27:31.657 "name": "Nvme$subsystem", 00:27:31.657 "trtype": "$TEST_TRANSPORT", 00:27:31.657 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:31.657 "adrfam": "ipv4", 00:27:31.657 "trsvcid": "$NVMF_PORT", 00:27:31.657 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:31.657 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:31.657 "hdgst": ${hdgst:-false}, 00:27:31.657 "ddgst": ${ddgst:-false} 00:27:31.657 }, 00:27:31.657 "method": "bdev_nvme_attach_controller" 00:27:31.657 } 00:27:31.657 EOF 00:27:31.657 )") 00:27:31.657 21:17:27 -- nvmf/common.sh@542 -- # cat 00:27:31.657 21:17:27 -- nvmf/common.sh@544 -- # jq . 00:27:31.657 21:17:27 -- nvmf/common.sh@545 -- # IFS=, 00:27:31.657 21:17:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:31.657 "params": { 00:27:31.657 "name": "Nvme1", 00:27:31.657 "trtype": "tcp", 00:27:31.657 "traddr": "10.0.0.2", 00:27:31.657 "adrfam": "ipv4", 00:27:31.658 "trsvcid": "4420", 00:27:31.658 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:31.658 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:31.658 "hdgst": false, 00:27:31.658 "ddgst": false 00:27:31.658 }, 00:27:31.658 "method": "bdev_nvme_attach_controller" 00:27:31.658 }' 00:27:31.658 [2024-11-27 21:17:27.764366] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:31.658 [2024-11-27 21:17:27.764447] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4102052 ] 00:27:31.658 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.658 [2024-11-27 21:17:27.824035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:31.915 [2024-11-27 21:17:27.928868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:31.915 Running I/O for 15 seconds... 00:27:35.198 21:17:30 -- host/bdevperf.sh@33 -- # kill -9 4101742 00:27:35.198 21:17:30 -- host/bdevperf.sh@35 -- # sleep 3 00:27:35.198 [2024-11-27 21:17:30.740702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.740977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.740994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.198 [2024-11-27 21:17:30.741010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.198 [2024-11-27 21:17:30.741027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:117840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.741961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.741977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.199 [2024-11-27 21:17:30.741992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.742009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.199 [2024-11-27 21:17:30.742023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.199 [2024-11-27 21:17:30.742040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:117952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:118000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:118056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:118064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:118080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.742936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:118112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.742969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.742985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.200 [2024-11-27 21:17:30.743001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.200 [2024-11-27 21:17:30.743017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.200 [2024-11-27 21:17:30.743032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:118160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:118208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:118224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:118288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.743962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.743979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.743993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.744010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.201 [2024-11-27 21:17:30.744025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.201 [2024-11-27 21:17:30.744042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.201 [2024-11-27 21:17:30.744057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:118320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:118344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:118360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:118368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:118376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:118424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:118432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:118440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:118472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:35.202 [2024-11-27 21:17:30.744718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:35.202 [2024-11-27 21:17:30.744949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.744969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x240d6b0 is same with the state(5) to be set 00:27:35.202 [2024-11-27 21:17:30.744990] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:35.202 [2024-11-27 21:17:30.745002] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:35.202 [2024-11-27 21:17:30.745015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117816 len:8 PRP1 0x0 PRP2 0x0 00:27:35.202 [2024-11-27 21:17:30.745028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:35.202 [2024-11-27 21:17:30.745103] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x240d6b0 was disconnected and freed. reset controller. 00:27:35.202 [2024-11-27 21:17:30.747561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.202 [2024-11-27 21:17:30.747662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.202 [2024-11-27 21:17:30.748209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.202 [2024-11-27 21:17:30.748433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.748458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.748474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.748600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.748737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.748758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.748777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.751562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.760284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.760581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.760721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.760750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.760768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.760932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.761136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.761159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.761174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.763319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.772958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.773321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.773453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.773482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.773506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.773702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.773853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.773877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.773892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.776164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.785541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.785786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.785895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.785923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.785940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.786105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.786219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.786242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.786258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.788650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.798088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.798383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.798534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.798563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.798580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.798763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.798950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.798973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.798988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.801220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.810835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.811159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.811267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.811294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.811311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.811517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.811662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.811686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.811701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.813991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.823283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.823646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.823818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.823847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.203 [2024-11-27 21:17:30.823865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.203 [2024-11-27 21:17:30.824012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.203 [2024-11-27 21:17:30.824162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.203 [2024-11-27 21:17:30.824185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.203 [2024-11-27 21:17:30.824201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.203 [2024-11-27 21:17:30.826509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.203 [2024-11-27 21:17:30.835862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.203 [2024-11-27 21:17:30.836170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.836327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.203 [2024-11-27 21:17:30.836394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.836411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.836552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.836730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.836750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.836763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.838963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.204 [2024-11-27 21:17:30.848488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.204 [2024-11-27 21:17:30.848838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.849032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.849057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.849072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.849234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.849455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.849479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.849494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.852029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.204 [2024-11-27 21:17:30.861063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.204 [2024-11-27 21:17:30.861457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.861613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.861643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.861660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.861825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.862029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.862052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.862067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.864377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.204 [2024-11-27 21:17:30.873738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.204 [2024-11-27 21:17:30.874070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.874181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.874207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.874222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.874420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.874657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.874682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.874697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.876878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.204 [2024-11-27 21:17:30.886443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.204 [2024-11-27 21:17:30.886797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.886987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.887016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.887033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.887215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.887348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.887377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.887394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.889851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.204 [2024-11-27 21:17:30.898906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.204 [2024-11-27 21:17:30.899346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.899504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.204 [2024-11-27 21:17:30.899541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.204 [2024-11-27 21:17:30.899561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.204 [2024-11-27 21:17:30.899707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.204 [2024-11-27 21:17:30.899876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.204 [2024-11-27 21:17:30.899899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.204 [2024-11-27 21:17:30.899914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.204 [2024-11-27 21:17:30.902237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.911307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.911533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.911679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.911707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.911723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.911887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.912038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.912062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.912077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.914472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.923876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.924192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.924311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.924351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.924366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.924496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.924701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.924739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.924760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.926929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.936492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.936808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.936956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.936984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.937002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.937169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.937336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.937359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.937375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.939747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.949055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.949414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.949553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.949582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.949599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.949728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.949878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.949901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.949916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.952473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.961688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.962055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.962238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.962266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.962283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.962429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.962658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.962682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.962697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.965064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.974129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.974427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.974569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.974595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.974611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.974758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.974976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.974999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.975015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.977430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.205 [2024-11-27 21:17:30.986793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.205 [2024-11-27 21:17:30.987119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.987263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.205 [2024-11-27 21:17:30.987291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.205 [2024-11-27 21:17:30.987307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.205 [2024-11-27 21:17:30.987507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.205 [2024-11-27 21:17:30.987635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.205 [2024-11-27 21:17:30.987659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.205 [2024-11-27 21:17:30.987674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.205 [2024-11-27 21:17:30.990125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:30.999571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:30.999964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.000082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.000108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.000124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.000272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.000436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.000460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.000475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.002864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.011938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.012224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.012376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.012403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.012418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.012566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.012772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.012796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.012812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.015096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.024538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.024901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.025029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.025054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.025070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.025221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.025372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.025395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.025410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.027701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.036892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.037244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.037388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.037416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.037433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.037612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.037764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.037787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.037802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.040252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.049381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.049745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.050000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.050026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.050042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.050185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.050379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.050402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.050417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.052786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.062013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.062442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.062602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.062631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.062648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.062831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.062981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.063004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.063019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.065072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.074729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.075056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.075242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.075267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.206 [2024-11-27 21:17:31.075283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.206 [2024-11-27 21:17:31.075414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.206 [2024-11-27 21:17:31.075596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.206 [2024-11-27 21:17:31.075620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.206 [2024-11-27 21:17:31.075636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.206 [2024-11-27 21:17:31.078012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.206 [2024-11-27 21:17:31.087295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.206 [2024-11-27 21:17:31.087633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.087823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.206 [2024-11-27 21:17:31.087860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.087879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.088025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.088230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.088254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.088269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.090599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.099946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.100287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.100408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.100434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.100449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.100676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.100845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.100868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.100883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.103151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.112425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.112771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.112902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.112930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.112947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.113111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.113315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.113338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.113354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.115578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.125106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.125426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.125563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.125591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.125614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.125797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.125983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.126006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.126021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.128397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.137671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.138012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.138118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.138146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.138162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.138344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.138494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.138517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.138545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.140941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.150375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.150680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.150820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.150848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.150864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.151046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.151268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.151291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.151306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.153710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.162857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.163183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.163321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.163349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.163366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.163548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.163663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.207 [2024-11-27 21:17:31.163686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.207 [2024-11-27 21:17:31.163701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.207 [2024-11-27 21:17:31.166023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.207 [2024-11-27 21:17:31.175414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.207 [2024-11-27 21:17:31.175722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.175862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.207 [2024-11-27 21:17:31.175889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.207 [2024-11-27 21:17:31.175907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.207 [2024-11-27 21:17:31.176053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.207 [2024-11-27 21:17:31.176185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.176208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.176224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.178493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.187967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.188320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.188423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.188448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.188463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.188622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.188787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.188811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.188826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.191149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.200703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.201037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.201179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.201220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.201236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.201425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.201609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.201633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.201648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.203951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.213325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.213670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.213782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.213810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.213828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.213973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.214141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.214165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.214180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.216603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.226002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.226327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.226479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.226505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.226520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.226689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.226822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.226846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.226861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.229201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.238516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.238820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.238957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.238986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.239003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.239202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.239316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.239345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.239361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.241605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.250960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.251327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.251490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.251516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.251542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.251759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.251964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.251988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.252004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.254363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.263389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.208 [2024-11-27 21:17:31.263745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.263908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.208 [2024-11-27 21:17:31.263933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.208 [2024-11-27 21:17:31.263966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.208 [2024-11-27 21:17:31.264113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.208 [2024-11-27 21:17:31.264281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.208 [2024-11-27 21:17:31.264304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.208 [2024-11-27 21:17:31.264319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.208 [2024-11-27 21:17:31.266577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.208 [2024-11-27 21:17:31.275707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.276032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.276179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.276218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.276234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.276438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.276637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.276661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.276682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.278844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.288384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.288781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.288897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.288938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.288953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.289053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.289222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.289246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.289261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.291611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.300699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.300956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.301094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.301122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.301139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.301231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.301399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.301422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.301438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.303878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.313310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.313697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.313951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.314007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.314024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.314171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.314340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.314362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.314377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.316627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.325919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.326252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.326427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.326453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.326468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.326643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.326821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.326845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.326860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.329255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.338500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.338848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.338960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.338988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.339006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.339117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.339285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.339309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.339324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.341749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.351004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.351331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.351472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.351500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.351517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.209 [2024-11-27 21:17:31.351711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.209 [2024-11-27 21:17:31.351844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.209 [2024-11-27 21:17:31.351867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.209 [2024-11-27 21:17:31.351881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.209 [2024-11-27 21:17:31.354042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.209 [2024-11-27 21:17:31.363592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.209 [2024-11-27 21:17:31.363882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.364061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.209 [2024-11-27 21:17:31.364087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.209 [2024-11-27 21:17:31.364102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.364334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.364521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.364555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.364570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.366857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.210 [2024-11-27 21:17:31.375887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.210 [2024-11-27 21:17:31.376235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.376367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.376395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.210 [2024-11-27 21:17:31.376413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.376571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.376723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.376746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.376761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.379191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.210 [2024-11-27 21:17:31.388406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.210 [2024-11-27 21:17:31.388691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.388901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.388954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.210 [2024-11-27 21:17:31.388971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.389171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.389339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.389362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.389377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.391546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.210 [2024-11-27 21:17:31.401001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.210 [2024-11-27 21:17:31.401324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.401472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.401500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.210 [2024-11-27 21:17:31.401517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.401727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.401914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.401938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.401953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.404329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.210 [2024-11-27 21:17:31.413518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.210 [2024-11-27 21:17:31.413839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.414004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.414033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.210 [2024-11-27 21:17:31.414050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.414178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.414292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.414315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.414330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.416590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.210 [2024-11-27 21:17:31.426088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.210 [2024-11-27 21:17:31.426368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.426492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.210 [2024-11-27 21:17:31.426519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.210 [2024-11-27 21:17:31.426547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.210 [2024-11-27 21:17:31.426748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.210 [2024-11-27 21:17:31.426936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.210 [2024-11-27 21:17:31.426960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.210 [2024-11-27 21:17:31.426977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.210 [2024-11-27 21:17:31.429284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.470 [2024-11-27 21:17:31.438620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.470 [2024-11-27 21:17:31.438958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.470 [2024-11-27 21:17:31.439139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.470 [2024-11-27 21:17:31.439172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.470 [2024-11-27 21:17:31.439188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.439347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.439522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.439570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.439585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.441762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.451190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.451537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.451672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.451697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.451713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.451860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.452042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.452065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.452081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.454353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.463721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.464070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.464215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.464261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.464278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.464478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.464656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.464680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.464696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.466962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.476134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.476358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.476507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.476541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.476566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.476768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.476918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.476941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.476956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.479187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.489026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.489332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.489486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.489511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.489535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.489686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.489904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.489928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.489943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.492228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.501576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.501916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.502081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.502129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.502147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.502329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.502480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.502503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.502520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.504642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.514211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.514538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.514655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.514682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.514698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.514850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.515019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.515042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.515058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.517182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.526586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.526868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.527044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.527071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.527086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.527201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.527410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.527434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.527449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.529675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.539332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.539613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.539712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.539736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.539751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.539950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.540113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.540133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.540146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.542362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.551982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.552322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.552468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.552496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.552513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.552739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.552924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.552944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.552958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.555306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.564514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.564832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.564968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.564995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.565012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.565159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.565327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.565351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.565366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.567586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.576969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.577304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.577433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.577462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.577478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.577656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.577823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.577847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.577863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.580164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.589521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.589952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.590111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.590139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.590157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.590303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.590471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.590500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.471 [2024-11-27 21:17:31.590516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.471 [2024-11-27 21:17:31.592692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.471 [2024-11-27 21:17:31.602074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.471 [2024-11-27 21:17:31.602468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.602640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.471 [2024-11-27 21:17:31.602669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.471 [2024-11-27 21:17:31.602686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.471 [2024-11-27 21:17:31.602868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.471 [2024-11-27 21:17:31.603020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.471 [2024-11-27 21:17:31.603043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.603058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.605455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.614649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.614979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.615120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.615148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.615165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.615364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.615516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.615549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.615565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.617820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.627185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.627491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.627643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.627669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.627684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.627886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.628073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.628096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.628117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.630378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.639880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.640275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.640405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.640430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.640445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.640601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.640801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.640825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.640841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.643074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.652424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.652731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.652935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.652963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.652980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.653163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.653295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.653318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.653334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.655755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.665108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.665433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.665577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.665606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.665624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.665807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.665976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.665999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.666014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.668276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.677794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.678142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.678295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.678323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.678340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.678486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.678683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.678707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.678724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.680882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.690336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.690649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.690777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.690805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.690822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.690969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.691137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.691161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.691176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.693488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.472 [2024-11-27 21:17:31.702833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.472 [2024-11-27 21:17:31.703152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.703281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.472 [2024-11-27 21:17:31.703307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.472 [2024-11-27 21:17:31.703322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.472 [2024-11-27 21:17:31.703547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.472 [2024-11-27 21:17:31.703698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.472 [2024-11-27 21:17:31.703721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.472 [2024-11-27 21:17:31.703736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.472 [2024-11-27 21:17:31.706150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.732 [2024-11-27 21:17:31.715683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.732 [2024-11-27 21:17:31.716065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.716262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.716319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.732 [2024-11-27 21:17:31.716338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.732 [2024-11-27 21:17:31.716486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.732 [2024-11-27 21:17:31.716646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.732 [2024-11-27 21:17:31.716670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.732 [2024-11-27 21:17:31.716686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.732 [2024-11-27 21:17:31.719119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.732 [2024-11-27 21:17:31.728406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.732 [2024-11-27 21:17:31.728692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.728817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.728845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.732 [2024-11-27 21:17:31.728862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.732 [2024-11-27 21:17:31.729027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.732 [2024-11-27 21:17:31.729197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.732 [2024-11-27 21:17:31.729220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.732 [2024-11-27 21:17:31.729236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.732 [2024-11-27 21:17:31.731745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.732 [2024-11-27 21:17:31.740907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.732 [2024-11-27 21:17:31.741170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.741286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.741315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.732 [2024-11-27 21:17:31.741332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.732 [2024-11-27 21:17:31.741515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.732 [2024-11-27 21:17:31.741676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.732 [2024-11-27 21:17:31.741699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.732 [2024-11-27 21:17:31.741715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.732 [2024-11-27 21:17:31.743822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.732 [2024-11-27 21:17:31.753350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.732 [2024-11-27 21:17:31.753704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.753866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.732 [2024-11-27 21:17:31.753903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.732 [2024-11-27 21:17:31.753934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.732 [2024-11-27 21:17:31.754098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.732 [2024-11-27 21:17:31.754230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.732 [2024-11-27 21:17:31.754253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.732 [2024-11-27 21:17:31.754278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.756391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.766118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.766436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.766592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.766621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.766638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.766803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.766970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.766994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.767009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.769386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.778686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.779032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.779239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.779264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.779280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.779411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.779573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.779598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.779613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.782079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.791074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.791358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.791508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.791551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.791570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.791735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.791903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.791926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.791942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.794138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.803767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.804157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.804417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.804442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.804457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.804680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.804849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.804872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.804887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.807266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.816254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.816593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.816735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.816764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.816781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.816909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.817095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.817119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.817134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.819381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.828897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.829162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.829295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.829324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.829347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.829540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.829691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.829715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.829730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.832067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.841402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.841698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.841828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.841853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.841868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.842033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.842166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.842188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.842204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.844425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.853998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.854287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.854420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.854448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.854465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.854658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.854828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.854851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.854865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.857206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.866307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.866629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.866783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.866812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.733 [2024-11-27 21:17:31.866829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.733 [2024-11-27 21:17:31.867018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.733 [2024-11-27 21:17:31.867223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.733 [2024-11-27 21:17:31.867247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.733 [2024-11-27 21:17:31.867262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.733 [2024-11-27 21:17:31.869650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.733 [2024-11-27 21:17:31.878981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.733 [2024-11-27 21:17:31.879304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.733 [2024-11-27 21:17:31.879467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.879495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.879512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.879687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.879874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.879897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.879912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.882273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.891540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.891828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.892010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.892060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.892078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.892205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.892374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.892397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.892412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.894763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.904046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.904330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.904503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.904541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.904561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.904761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.904936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.904959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.904974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.907281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.916726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.917010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.917146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.917174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.917191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.917356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.917536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.917560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.917575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.919737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.929319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.929649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.929778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.929803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.929819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.929994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.930145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.930167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.930182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.932494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.941986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.942249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.942432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.942457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.942472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.942697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.942867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.942896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.942912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.945165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.954518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.954825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.954961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.954990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.955007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.955225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.955375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.955398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.955413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.957911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.734 [2024-11-27 21:17:31.967150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.734 [2024-11-27 21:17:31.967483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.967643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.734 [2024-11-27 21:17:31.967674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.734 [2024-11-27 21:17:31.967692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.734 [2024-11-27 21:17:31.967840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.734 [2024-11-27 21:17:31.968008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.734 [2024-11-27 21:17:31.968031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.734 [2024-11-27 21:17:31.968046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.734 [2024-11-27 21:17:31.970567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.995 [2024-11-27 21:17:31.979828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.995 [2024-11-27 21:17:31.980125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:31.980307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:31.980334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.995 [2024-11-27 21:17:31.980350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.995 [2024-11-27 21:17:31.980548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.995 [2024-11-27 21:17:31.980710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.995 [2024-11-27 21:17:31.980734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.995 [2024-11-27 21:17:31.980755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.995 [2024-11-27 21:17:31.983281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.995 [2024-11-27 21:17:31.992339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.995 [2024-11-27 21:17:31.992784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:31.992982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:31.993008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.995 [2024-11-27 21:17:31.993024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.995 [2024-11-27 21:17:31.993219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.995 [2024-11-27 21:17:31.993405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.995 [2024-11-27 21:17:31.993428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.995 [2024-11-27 21:17:31.993443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.995 [2024-11-27 21:17:31.995620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.995 [2024-11-27 21:17:32.004880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.995 [2024-11-27 21:17:32.005305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.005501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.005541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.995 [2024-11-27 21:17:32.005561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.995 [2024-11-27 21:17:32.005725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.995 [2024-11-27 21:17:32.005911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.995 [2024-11-27 21:17:32.005935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.995 [2024-11-27 21:17:32.005951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.995 [2024-11-27 21:17:32.008261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.995 [2024-11-27 21:17:32.017478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.995 [2024-11-27 21:17:32.017843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.017976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.018002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.995 [2024-11-27 21:17:32.018017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.995 [2024-11-27 21:17:32.018171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.995 [2024-11-27 21:17:32.018303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.995 [2024-11-27 21:17:32.018326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.995 [2024-11-27 21:17:32.018342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.995 [2024-11-27 21:17:32.020577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.995 [2024-11-27 21:17:32.029923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.995 [2024-11-27 21:17:32.030220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.030365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.995 [2024-11-27 21:17:32.030392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.995 [2024-11-27 21:17:32.030410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.995 [2024-11-27 21:17:32.030566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.995 [2024-11-27 21:17:32.030735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.995 [2024-11-27 21:17:32.030758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.995 [2024-11-27 21:17:32.030774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.995 [2024-11-27 21:17:32.033025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.042506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.042818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.042938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.042963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.042979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.043126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.043309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.043333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.043349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.045630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.055090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.055467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.055589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.055618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.055635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.055782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.055969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.055992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.056008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.058369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.067717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.068076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.068260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.068285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.068301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.068431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.068649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.068674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.068689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.071029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.080321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.080611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.080826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.080884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.080901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.081029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.081197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.081220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.081236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.083626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.092814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.093112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.093269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.093295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.093310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.093441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.093627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.093652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.093667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.095991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.105433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.105745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.105887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.105913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.105928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.106065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.106252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.106276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.106291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.108492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.118025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.118312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.118457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.118486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.118503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.118697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.118884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.118907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.118923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.121264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.130511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.130838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.131019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.131045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.131060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.131262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.131421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.131444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.131460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.133517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.142883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.143159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.143299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.143333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.996 [2024-11-27 21:17:32.143351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.996 [2024-11-27 21:17:32.143479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.996 [2024-11-27 21:17:32.143624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.996 [2024-11-27 21:17:32.143649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.996 [2024-11-27 21:17:32.143664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.996 [2024-11-27 21:17:32.146149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.996 [2024-11-27 21:17:32.155486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.996 [2024-11-27 21:17:32.155824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.155972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.996 [2024-11-27 21:17:32.156000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.156017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.156199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.156367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.156390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.156405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.158685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.167896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.168233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.168348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.168377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.168393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.168552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.168740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.168763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.168778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.170904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.180471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.180841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.180943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.180968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.180988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.181136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.181292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.181315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.181331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.183828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.193068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.193450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.193591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.193621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.193639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.193803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.193936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.193959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.193975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.196332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.205715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.206003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.206213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.206264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.206281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.206481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.206643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.206667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.206682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.209041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.218194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.218570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.218710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.218740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.218757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.218946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.219133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.219156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.219171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.997 [2024-11-27 21:17:32.221370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.997 [2024-11-27 21:17:32.230727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.997 [2024-11-27 21:17:32.231092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.231235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.997 [2024-11-27 21:17:32.231265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:35.997 [2024-11-27 21:17:32.231282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:35.997 [2024-11-27 21:17:32.231412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:35.997 [2024-11-27 21:17:32.231655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.997 [2024-11-27 21:17:32.231691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.997 [2024-11-27 21:17:32.231710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.234229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.243283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.243622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.243806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.243832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.243849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.243949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.244128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.244152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.244167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.246556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.255893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.256181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.256323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.256352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.256369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.256548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.256727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.256751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.256766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.259111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.268616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.268887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.269080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.269131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.269149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.269313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.269463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.269486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.269502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.271828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.281099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.281473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.281596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.281626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.281644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.281791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.281959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.281982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.281997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.284123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.293646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.293973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.294082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.294107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.294123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.294302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.294486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.294515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.294543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.296832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.306212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.306497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.306645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.306673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.306691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.306891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.307042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.307064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.307080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.309494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.318681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.319055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.319186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.319214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.319231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.319395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.257 [2024-11-27 21:17:32.319593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.257 [2024-11-27 21:17:32.319617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.257 [2024-11-27 21:17:32.319633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.257 [2024-11-27 21:17:32.321937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.257 [2024-11-27 21:17:32.331235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.257 [2024-11-27 21:17:32.331513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.331688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.257 [2024-11-27 21:17:32.331716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.257 [2024-11-27 21:17:32.331733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.257 [2024-11-27 21:17:32.331933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.332137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.332160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.332182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.334608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.343956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.344324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.344432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.344458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.344474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.344652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.344822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.344845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.344860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.347238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.356146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.356466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.356644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.356670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.356685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.356832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.357005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.357029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.357044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.359333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.368712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.368991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.369175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.369201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.369216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.369359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.369594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.369619] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.369634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.371806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.381244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.381579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.381746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.381775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.381792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.381884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.382053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.382076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.382091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.384328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.394017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.394343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.394478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.394504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.394519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.394653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.394805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.394828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.394843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.397095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.406706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.407028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.407176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.407204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.407221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.407367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.407586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.407610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.407625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.410038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.419376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.419740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.419840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.419864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.419880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.420057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.420225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.420248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.420264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.422480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.432088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.432465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.432688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.432717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.432734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.432934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.433102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.433125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.433141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.258 [2024-11-27 21:17:32.435318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.258 [2024-11-27 21:17:32.444645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.258 [2024-11-27 21:17:32.444976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.445083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.258 [2024-11-27 21:17:32.445107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.258 [2024-11-27 21:17:32.445122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.258 [2024-11-27 21:17:32.445298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.258 [2024-11-27 21:17:32.445468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.258 [2024-11-27 21:17:32.445490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.258 [2024-11-27 21:17:32.445505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.259 [2024-11-27 21:17:32.447766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.259 [2024-11-27 21:17:32.457159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.259 [2024-11-27 21:17:32.457467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.457631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.457657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.259 [2024-11-27 21:17:32.457672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.259 [2024-11-27 21:17:32.457835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.259 [2024-11-27 21:17:32.458021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.259 [2024-11-27 21:17:32.458045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.259 [2024-11-27 21:17:32.458060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.259 [2024-11-27 21:17:32.460184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.259 [2024-11-27 21:17:32.469658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.259 [2024-11-27 21:17:32.470005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.470181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.470206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.259 [2024-11-27 21:17:32.470222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.259 [2024-11-27 21:17:32.470403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.259 [2024-11-27 21:17:32.470564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.259 [2024-11-27 21:17:32.470588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.259 [2024-11-27 21:17:32.470603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.259 [2024-11-27 21:17:32.473093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.259 [2024-11-27 21:17:32.482349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.259 [2024-11-27 21:17:32.482649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.482793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.482821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.259 [2024-11-27 21:17:32.482838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.259 [2024-11-27 21:17:32.483038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.259 [2024-11-27 21:17:32.483242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.259 [2024-11-27 21:17:32.483265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.259 [2024-11-27 21:17:32.483280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.259 [2024-11-27 21:17:32.485497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.259 [2024-11-27 21:17:32.494907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.259 [2024-11-27 21:17:32.495251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.495396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.259 [2024-11-27 21:17:32.495429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.259 [2024-11-27 21:17:32.495447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.259 [2024-11-27 21:17:32.495645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.259 [2024-11-27 21:17:32.495818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.259 [2024-11-27 21:17:32.495841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.259 [2024-11-27 21:17:32.495860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.519 [2024-11-27 21:17:32.498150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.519 [2024-11-27 21:17:32.507380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.519 [2024-11-27 21:17:32.507706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.519 [2024-11-27 21:17:32.507850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.519 [2024-11-27 21:17:32.507879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.519 [2024-11-27 21:17:32.507896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.519 [2024-11-27 21:17:32.508025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.519 [2024-11-27 21:17:32.508177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.519 [2024-11-27 21:17:32.508201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.519 [2024-11-27 21:17:32.508217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.519 [2024-11-27 21:17:32.510833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.519 [2024-11-27 21:17:32.520021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.519 [2024-11-27 21:17:32.520326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.519 [2024-11-27 21:17:32.520474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.519 [2024-11-27 21:17:32.520502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.520521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.520718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.520869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.520893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.520909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.523214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.532455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.532823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.533039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.533089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.533112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.533241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.533446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.533469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.533484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.535708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.545101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.545501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.545642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.545670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.545687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.545852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.546038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.546061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.546077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.548403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.557703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.558100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.558224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.558248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.558263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.558409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.558656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.558681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.558696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.560982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.570101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.570444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.570564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.570593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.570610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.570800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.570951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.570974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.570990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.573210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.582317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.582625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.582761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.582786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.582802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.583016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.583167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.583190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.583205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.585630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.594851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.595158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.595298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.595326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.595344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.595491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.595635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.595659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.595675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.597890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.607371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.607707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.607829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.607854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.607869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.608064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.608259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.608282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.608298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.610542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.619935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.620276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.620408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.620435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.620452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.620593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.620761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.520 [2024-11-27 21:17:32.620784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.520 [2024-11-27 21:17:32.620800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.520 [2024-11-27 21:17:32.623175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.520 [2024-11-27 21:17:32.632569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.520 [2024-11-27 21:17:32.632832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.632969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.520 [2024-11-27 21:17:32.632997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.520 [2024-11-27 21:17:32.633014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.520 [2024-11-27 21:17:32.633178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.520 [2024-11-27 21:17:32.633382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.633405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.633420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.635580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.644980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.645252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.645428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.645453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.645469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.645660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.645794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.645823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.645839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.648127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.657668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.657986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.658086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.658111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.658126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.658320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.658470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.658493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.658508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.660757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.670326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.670596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.670704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.670732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.670749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.670949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.671117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.671141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.671156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.673558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.682958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.683370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.683518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.683553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.683569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.683701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.683894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.683917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.683939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.686319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.695418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.695745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.695924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.695949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.695965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.696180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.696378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.696402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.696417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.698846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.708007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.708302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.708460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.708485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.708501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.708669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.708857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.708879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.708894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.711184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.720699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.720996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.721217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.721246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.721263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.721391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.721554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.721579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.721594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.723978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.733443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.733802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.734060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.734086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.734101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.734259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.734385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.734408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.734424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.736776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.746008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.521 [2024-11-27 21:17:32.746294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.746435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.521 [2024-11-27 21:17:32.746464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.521 [2024-11-27 21:17:32.746481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.521 [2024-11-27 21:17:32.746657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.521 [2024-11-27 21:17:32.746844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.521 [2024-11-27 21:17:32.746868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.521 [2024-11-27 21:17:32.746883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.521 [2024-11-27 21:17:32.749371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.521 [2024-11-27 21:17:32.758629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.781 [2024-11-27 21:17:32.759086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.781 [2024-11-27 21:17:32.759225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.781 [2024-11-27 21:17:32.759253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.781 [2024-11-27 21:17:32.759270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.781 [2024-11-27 21:17:32.759418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.781 [2024-11-27 21:17:32.759635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.781 [2024-11-27 21:17:32.759658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.781 [2024-11-27 21:17:32.759673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.781 [2024-11-27 21:17:32.762145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.781 [2024-11-27 21:17:32.771165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.781 [2024-11-27 21:17:32.771514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.781 [2024-11-27 21:17:32.771638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.781 [2024-11-27 21:17:32.771665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.781 [2024-11-27 21:17:32.771681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.781 [2024-11-27 21:17:32.771853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.781 [2024-11-27 21:17:32.772022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.781 [2024-11-27 21:17:32.772045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.781 [2024-11-27 21:17:32.772061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.781 [2024-11-27 21:17:32.774580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.783649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.783987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.784132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.784161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.784178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.784342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.784492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.784516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.784543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.786979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.796213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.796552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.796730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.796755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.796771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.796918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.797067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.797090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.797106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.799284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.808748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.809176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.809327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.809355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.809372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.809546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.809769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.809792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.809808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.812151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.821295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.821674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.821801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.821826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.821841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.822042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.822193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.822216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.822231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.824589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.833904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.834328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.834476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.834501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.834516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.834673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.834872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.834896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.834912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.837274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.846325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.846631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.846753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.846789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.846807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.846954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.847104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.847128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.847143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.849358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.858908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.859211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.859348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.859377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.859394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.859553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.859704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.859727] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.859742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.861958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.871593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.871928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.872094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.872119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.872135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.872293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.872480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.872503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.872519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.874854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.884192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.884515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.884645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.884675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.782 [2024-11-27 21:17:32.884698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.782 [2024-11-27 21:17:32.884846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.782 [2024-11-27 21:17:32.885032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.782 [2024-11-27 21:17:32.885055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.782 [2024-11-27 21:17:32.885070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.782 [2024-11-27 21:17:32.887250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.782 [2024-11-27 21:17:32.896816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.782 [2024-11-27 21:17:32.897113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.782 [2024-11-27 21:17:32.897251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.897293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.897309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.897500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.897694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.897718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.897733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.900115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.909244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.909599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.909734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.909759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.909774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.909988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.910121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.910144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.910160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.912641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.922032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.922316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.922450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.922478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.922495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.922712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.922863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.922887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.922902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.925119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.934430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.934763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.934920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.934947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.934964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.935165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.935297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.935320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.935336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.937560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.947002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.947342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.947507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.947544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.947564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.947746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.947896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.947919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.947935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.950402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.959604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.959942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.960074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.960100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.960115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.960292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.960449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.960472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.960487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.962786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.971965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.972302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.972463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.972488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.972504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.972688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.972858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.972881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.972896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.975151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.984355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.984673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.984813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.984842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.984859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.985060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.985228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.985251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.985266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.987501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:32.996859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:32.997183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.997321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:32.997348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:32.997366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.783 [2024-11-27 21:17:32.997560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.783 [2024-11-27 21:17:32.997729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.783 [2024-11-27 21:17:32.997758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.783 [2024-11-27 21:17:32.997774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.783 [2024-11-27 21:17:32.999902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.783 [2024-11-27 21:17:33.009506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.783 [2024-11-27 21:17:33.009927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:33.010088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.783 [2024-11-27 21:17:33.010130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:36.783 [2024-11-27 21:17:33.010147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:36.784 [2024-11-27 21:17:33.010329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:36.784 [2024-11-27 21:17:33.010480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.784 [2024-11-27 21:17:33.010504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.784 [2024-11-27 21:17:33.010519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.784 [2024-11-27 21:17:33.012788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.021987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.022403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.022581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.022612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.022630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.022795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.022988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.023011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.023027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.025342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.034606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.035023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.035310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.035361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.035379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.035558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.035709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.035732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.035754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.038244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.047191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.047492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.047663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.047689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.047704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.047920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.048088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.048112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.048128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.050326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.059768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.060094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.060320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.060345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.060376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.060504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.060740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.060764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.060779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.063143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.072752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.073009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.073174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.073201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.073218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.073418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.073616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.073641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.073656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.075970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.085263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.085597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.085739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.085767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.085785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.085950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.086082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.086105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.086121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.088445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.097973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.098252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.098400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.098428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.098445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.098603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.098737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.098760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.044 [2024-11-27 21:17:33.098775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.044 [2024-11-27 21:17:33.101166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.044 [2024-11-27 21:17:33.110474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.044 [2024-11-27 21:17:33.110824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.110980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.044 [2024-11-27 21:17:33.111006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.044 [2024-11-27 21:17:33.111021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.044 [2024-11-27 21:17:33.111183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.044 [2024-11-27 21:17:33.111416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.044 [2024-11-27 21:17:33.111440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.111455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.113966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.122966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.123292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.123400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.123428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.123445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.123584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.123753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.123776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.123792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.126044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.135488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.135942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.136082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.136122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.136140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.136321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.136471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.136494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.136509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.138890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.148176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.148499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.148613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.148641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.148658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.148823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.149009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.149033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.149048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.151410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.160536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.160770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.160912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.160939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.160956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.161102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.161252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.161276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.161291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.163469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.173079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.173357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.173541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.173576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.173592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.173805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.173938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.173962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.173977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.176208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.185902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.186283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.186416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.186441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.186457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.186583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.186753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.186776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.186791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.189113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.198461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.198784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.198927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.198960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.198978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.199143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.199329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.199352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.199367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.201786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.210837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.211185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.211326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.211354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.211371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.211551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.211738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.211761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.211776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.213934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.223249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.223605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.223749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.045 [2024-11-27 21:17:33.223776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.045 [2024-11-27 21:17:33.223792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.045 [2024-11-27 21:17:33.223939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.045 [2024-11-27 21:17:33.224143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.045 [2024-11-27 21:17:33.224166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.045 [2024-11-27 21:17:33.224182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.045 [2024-11-27 21:17:33.226503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.045 [2024-11-27 21:17:33.235931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.045 [2024-11-27 21:17:33.236310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.236465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.236492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.046 [2024-11-27 21:17:33.236515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.046 [2024-11-27 21:17:33.236682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.046 [2024-11-27 21:17:33.236868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.046 [2024-11-27 21:17:33.236891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.046 [2024-11-27 21:17:33.236906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.046 [2024-11-27 21:17:33.239299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.046 [2024-11-27 21:17:33.248365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.046 [2024-11-27 21:17:33.248651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.248830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.248854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.046 [2024-11-27 21:17:33.248869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.046 [2024-11-27 21:17:33.248985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.046 [2024-11-27 21:17:33.249205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.046 [2024-11-27 21:17:33.249230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.046 [2024-11-27 21:17:33.249245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.046 [2024-11-27 21:17:33.251704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.046 [2024-11-27 21:17:33.261095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.046 [2024-11-27 21:17:33.261426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.261590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.261619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.046 [2024-11-27 21:17:33.261637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.046 [2024-11-27 21:17:33.261783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.046 [2024-11-27 21:17:33.261987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.046 [2024-11-27 21:17:33.262011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.046 [2024-11-27 21:17:33.262026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.046 [2024-11-27 21:17:33.264476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.046 [2024-11-27 21:17:33.273854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.046 [2024-11-27 21:17:33.274143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.274270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.046 [2024-11-27 21:17:33.274298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.046 [2024-11-27 21:17:33.274315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.046 [2024-11-27 21:17:33.274504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.046 [2024-11-27 21:17:33.274647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.046 [2024-11-27 21:17:33.274671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.046 [2024-11-27 21:17:33.274687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.046 [2024-11-27 21:17:33.276988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.286372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.286712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.286878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.286904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.286920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.287085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.287268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.287292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.287307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.289661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.298825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.299113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.299263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.299292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.299310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.299475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.299655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.299680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.299695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.301943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.311559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.311887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.312026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.312055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.312072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.312237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.312430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.312454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.312469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.314691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.324220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.324521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.324671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.324700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.324716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.324845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.325049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.325072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.325088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.327393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.337056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.337486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.337750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.337779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.337795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.337941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.338145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.338169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.338184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.340570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.349675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.349971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.350133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.350158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.350173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.350348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.350462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.350491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.350507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.352892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.362365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.362660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.362779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.362808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.306 [2024-11-27 21:17:33.362825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.306 [2024-11-27 21:17:33.363007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.306 [2024-11-27 21:17:33.363175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.306 [2024-11-27 21:17:33.363199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.306 [2024-11-27 21:17:33.363214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.306 [2024-11-27 21:17:33.365337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.306 [2024-11-27 21:17:33.374907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.306 [2024-11-27 21:17:33.375288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.306 [2024-11-27 21:17:33.375408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.375432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.375447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.375605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.375824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.375848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.375863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.378257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.387676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.388013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.388154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.388182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.388199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.388363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.388559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.388584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.388605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.391018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.400409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.400682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.400823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.400851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.400868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.400996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.401164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.401187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.401202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.403365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.413185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.413539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.413689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.413717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.413734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.413898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.414031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.414054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.414069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.416374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.425751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.426056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.426215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.426240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.426255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.426451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.426613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.426640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.426655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.428736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.438345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.438606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.438778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.438806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.438823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.438933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.439120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.439143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.439159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.441356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.451119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.451521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.451681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.451706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.451721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.451915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.452030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.452053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.452068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.454411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.463598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.463973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.464140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.464168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.464185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.464313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.464481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.464505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.464520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.466941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.476143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.476487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.476615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.476641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.476656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.476772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.307 [2024-11-27 21:17:33.476938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.307 [2024-11-27 21:17:33.476961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.307 [2024-11-27 21:17:33.476977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.307 [2024-11-27 21:17:33.479482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.307 [2024-11-27 21:17:33.488585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.307 [2024-11-27 21:17:33.488939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.489212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.307 [2024-11-27 21:17:33.489265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.307 [2024-11-27 21:17:33.489282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.307 [2024-11-27 21:17:33.489446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.308 [2024-11-27 21:17:33.489615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.308 [2024-11-27 21:17:33.489636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.308 [2024-11-27 21:17:33.489650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.308 [2024-11-27 21:17:33.491773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.308 [2024-11-27 21:17:33.501019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.308 [2024-11-27 21:17:33.501361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.501480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.501507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.308 [2024-11-27 21:17:33.501532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.308 [2024-11-27 21:17:33.501732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.308 [2024-11-27 21:17:33.501894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.308 [2024-11-27 21:17:33.501917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.308 [2024-11-27 21:17:33.501933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.308 [2024-11-27 21:17:33.504165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.308 [2024-11-27 21:17:33.513464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.308 [2024-11-27 21:17:33.513776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.513916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.513944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.308 [2024-11-27 21:17:33.513961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.308 [2024-11-27 21:17:33.514125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.308 [2024-11-27 21:17:33.514276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.308 [2024-11-27 21:17:33.514300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.308 [2024-11-27 21:17:33.514315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.308 [2024-11-27 21:17:33.516934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.308 [2024-11-27 21:17:33.525905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.308 [2024-11-27 21:17:33.526242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.526395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.526420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.308 [2024-11-27 21:17:33.526452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.308 [2024-11-27 21:17:33.526661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.308 [2024-11-27 21:17:33.526811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.308 [2024-11-27 21:17:33.526834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.308 [2024-11-27 21:17:33.526849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.308 [2024-11-27 21:17:33.528992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.308 [2024-11-27 21:17:33.538708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.308 [2024-11-27 21:17:33.539024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.539216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.308 [2024-11-27 21:17:33.539241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.308 [2024-11-27 21:17:33.539256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.308 [2024-11-27 21:17:33.539435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.308 [2024-11-27 21:17:33.539598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.308 [2024-11-27 21:17:33.539622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.308 [2024-11-27 21:17:33.539637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.308 [2024-11-27 21:17:33.542010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.568 [2024-11-27 21:17:33.551397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.568 [2024-11-27 21:17:33.551752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.551899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.551926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.568 [2024-11-27 21:17:33.551942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.568 [2024-11-27 21:17:33.552126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.568 [2024-11-27 21:17:33.552289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.568 [2024-11-27 21:17:33.552313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.568 [2024-11-27 21:17:33.552328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.568 [2024-11-27 21:17:33.554573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.568 [2024-11-27 21:17:33.564136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.568 [2024-11-27 21:17:33.564465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.564598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.564628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.568 [2024-11-27 21:17:33.564645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.568 [2024-11-27 21:17:33.564809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.568 [2024-11-27 21:17:33.564959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.568 [2024-11-27 21:17:33.564982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.568 [2024-11-27 21:17:33.564997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.568 [2024-11-27 21:17:33.567338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.568 [2024-11-27 21:17:33.576581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.568 [2024-11-27 21:17:33.576919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.577056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.568 [2024-11-27 21:17:33.577083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.577100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.577264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.577468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.577492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.577507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.579658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.589136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.589514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.589687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.589716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.589739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.589885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.590035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.590058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.590074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.592111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.601759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.602091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.602200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.602227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.602244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.602408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.602570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.602594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.602610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.604767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.614350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.614727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.614837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.614862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.614877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.615063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.615213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.615236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.615251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.617506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.626822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.627184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.627318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.627346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.627362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.627565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.627752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.627775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.627790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.630189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.639348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.639607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.639773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.639801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.639818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.640018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.640186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.640210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.640225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.642721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.652076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.652422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.652576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.652603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.569 [2024-11-27 21:17:33.652618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.569 [2024-11-27 21:17:33.652717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.569 [2024-11-27 21:17:33.652935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.569 [2024-11-27 21:17:33.652959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.569 [2024-11-27 21:17:33.652974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.569 [2024-11-27 21:17:33.655155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.569 [2024-11-27 21:17:33.664439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.569 [2024-11-27 21:17:33.664834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.569 [2024-11-27 21:17:33.664988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.665012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.665027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.665223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.665378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.665402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.665417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.667895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 [2024-11-27 21:17:33.676917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.677271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.677452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.677477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.677493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.677634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.677821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.677845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.677860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.679986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 [2024-11-27 21:17:33.689575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.689946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.690088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.690118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.690135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.690300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.690469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.690492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.690507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.692968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 [2024-11-27 21:17:33.702040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.702325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.702468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.702496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.702513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.702689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.702804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.702832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.702849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.705083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 [2024-11-27 21:17:33.714710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.714980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.715137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.715163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.715178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.715339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.715472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.715495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.715510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.717881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 [2024-11-27 21:17:33.727198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.727499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.727646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.727675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.570 [2024-11-27 21:17:33.727692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.570 [2024-11-27 21:17:33.727820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.570 [2024-11-27 21:17:33.727987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.570 [2024-11-27 21:17:33.728010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.570 [2024-11-27 21:17:33.728026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.570 [2024-11-27 21:17:33.730405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.570 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 4101742 Killed "${NVMF_APP[@]}" "$@" 00:27:37.570 21:17:33 -- host/bdevperf.sh@36 -- # tgt_init 00:27:37.570 21:17:33 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:37.570 21:17:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:37.570 21:17:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:37.570 21:17:33 -- common/autotest_common.sh@10 -- # set +x 00:27:37.570 21:17:33 -- nvmf/common.sh@469 -- # nvmfpid=4102740 00:27:37.570 21:17:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:37.570 21:17:33 -- nvmf/common.sh@470 -- # waitforlisten 4102740 00:27:37.570 21:17:33 -- common/autotest_common.sh@829 -- # '[' -z 4102740 ']' 00:27:37.570 21:17:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:37.570 21:17:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:37.570 21:17:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:37.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:37.570 21:17:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:37.570 21:17:33 -- common/autotest_common.sh@10 -- # set +x 00:27:37.570 [2024-11-27 21:17:33.739783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.570 [2024-11-27 21:17:33.740097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.570 [2024-11-27 21:17:33.740231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.740259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.740276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.740422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.740567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.740591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.740610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.742999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.571 [2024-11-27 21:17:33.752169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.571 [2024-11-27 21:17:33.752503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.752663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.752689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.752705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.752821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.752981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.753005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.753020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.755127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.571 [2024-11-27 21:17:33.764394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.571 [2024-11-27 21:17:33.764720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.764853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.764879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.764894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.765086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.765241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.765260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.765274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.767376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.571 [2024-11-27 21:17:33.776789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.571 [2024-11-27 21:17:33.777135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.777233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.777258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.777274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.777406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.777608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.777628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.777643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.779721] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:37.571 [2024-11-27 21:17:33.779740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.571 [2024-11-27 21:17:33.779791] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:37.571 [2024-11-27 21:17:33.789126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.571 [2024-11-27 21:17:33.789465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.789620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.789647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.789663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.789842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.790013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.790033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.790046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.792176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.571 [2024-11-27 21:17:33.801468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.571 [2024-11-27 21:17:33.801818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.801915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.571 [2024-11-27 21:17:33.801939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.571 [2024-11-27 21:17:33.801955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.571 [2024-11-27 21:17:33.802119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.571 [2024-11-27 21:17:33.802339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.571 [2024-11-27 21:17:33.802359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.571 [2024-11-27 21:17:33.802376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.571 [2024-11-27 21:17:33.804690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.832 [2024-11-27 21:17:33.814021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.832 [2024-11-27 21:17:33.814384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.814508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.814559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.832 [2024-11-27 21:17:33.814588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.832 [2024-11-27 21:17:33.814759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.832 [2024-11-27 21:17:33.814959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.832 [2024-11-27 21:17:33.814981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.832 [2024-11-27 21:17:33.814995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.832 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.832 [2024-11-27 21:17:33.816823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.832 [2024-11-27 21:17:33.826885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.832 [2024-11-27 21:17:33.827206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.827352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.827381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.832 [2024-11-27 21:17:33.827399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.832 [2024-11-27 21:17:33.827591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.832 [2024-11-27 21:17:33.827756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.832 [2024-11-27 21:17:33.827777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.832 [2024-11-27 21:17:33.827790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.832 [2024-11-27 21:17:33.830042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.832 [2024-11-27 21:17:33.839475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.832 [2024-11-27 21:17:33.839779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.839912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.839952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.832 [2024-11-27 21:17:33.839968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.832 [2024-11-27 21:17:33.840132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.832 [2024-11-27 21:17:33.840324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.832 [2024-11-27 21:17:33.840347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.832 [2024-11-27 21:17:33.840369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.832 [2024-11-27 21:17:33.842852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.832 [2024-11-27 21:17:33.852479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.832 [2024-11-27 21:17:33.852649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:37.832 [2024-11-27 21:17:33.852808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.852962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.832 [2024-11-27 21:17:33.852989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.832 [2024-11-27 21:17:33.853006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.832 [2024-11-27 21:17:33.853152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.832 [2024-11-27 21:17:33.853358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.832 [2024-11-27 21:17:33.853381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.853397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.855711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.865072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.865569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.865731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.865758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.865778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.865952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.866109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.866133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.866152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.868361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.877647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.877992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.878167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.878196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.878213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.878379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.878573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.878595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.878609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.880792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.890251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.890682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.890816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.890842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.890857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.891055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.891188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.891212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.891227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.893491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.902769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.903126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.903274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.903303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.903320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.903431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.903589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.903611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.903625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.905782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.915209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.915604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.915801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.915835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.915852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.915970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.916179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.916204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.916221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.918504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.927882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.928273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.928441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.928470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.928490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.928735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.928900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.928924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.928942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.931288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.940537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.940933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.941037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.833 [2024-11-27 21:17:33.941067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.833 [2024-11-27 21:17:33.941084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.833 [2024-11-27 21:17:33.941213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.833 [2024-11-27 21:17:33.941382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.833 [2024-11-27 21:17:33.941406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.833 [2024-11-27 21:17:33.941422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.833 [2024-11-27 21:17:33.943824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.833 [2024-11-27 21:17:33.953015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.833 [2024-11-27 21:17:33.953300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.953473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.953501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:33.953520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:33.953665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:33.953903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:33.953927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:33.953943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:33.956044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:33.965610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:33.965946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.966095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.966138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:33.966155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:33.966304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:33.966471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:33.966495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:33.966510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:33.968572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:33.969331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:37.834 [2024-11-27 21:17:33.969445] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:37.834 [2024-11-27 21:17:33.969463] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:37.834 [2024-11-27 21:17:33.969476] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:37.834 [2024-11-27 21:17:33.969560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:37.834 [2024-11-27 21:17:33.969593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:37.834 [2024-11-27 21:17:33.969596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:37.834 [2024-11-27 21:17:33.977929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:33.978360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.978477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.978504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:33.978544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:33.978685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:33.978840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:33.978861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:33.978878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:33.981071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:33.990129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:33.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.990720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:33.990749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:33.990769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:33.990912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:33.991073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:33.991095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:33.991112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:33.993428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:34.002398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:34.002835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.002996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.003022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:34.003041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:34.003217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:34.003388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:34.003410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:34.003428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:34.005613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:34.014699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:34.015221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.015386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.015413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:34.015434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:34.015602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:34.015759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:34.015782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:34.015800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:34.017932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.834 [2024-11-27 21:17:34.027434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.834 [2024-11-27 21:17:34.027846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.027989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.834 [2024-11-27 21:17:34.028015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.834 [2024-11-27 21:17:34.028034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.834 [2024-11-27 21:17:34.028171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.834 [2024-11-27 21:17:34.028371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.834 [2024-11-27 21:17:34.028404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.834 [2024-11-27 21:17:34.028421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.834 [2024-11-27 21:17:34.030489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.835 [2024-11-27 21:17:34.039765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.835 [2024-11-27 21:17:34.040271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.040389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.040416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.835 [2024-11-27 21:17:34.040437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.835 [2024-11-27 21:17:34.040591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.835 [2024-11-27 21:17:34.040763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.835 [2024-11-27 21:17:34.040785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.835 [2024-11-27 21:17:34.040802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.835 [2024-11-27 21:17:34.043083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.835 [2024-11-27 21:17:34.052256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.835 [2024-11-27 21:17:34.052582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.052729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.052755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.835 [2024-11-27 21:17:34.052773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.835 [2024-11-27 21:17:34.052943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.835 [2024-11-27 21:17:34.053142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.835 [2024-11-27 21:17:34.053163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.835 [2024-11-27 21:17:34.053179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.835 [2024-11-27 21:17:34.055246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.835 [2024-11-27 21:17:34.064374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.835 [2024-11-27 21:17:34.064664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.064772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.835 [2024-11-27 21:17:34.064798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:37.835 [2024-11-27 21:17:34.064814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:37.835 [2024-11-27 21:17:34.064929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:37.835 [2024-11-27 21:17:34.065065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.835 [2024-11-27 21:17:34.065086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.835 [2024-11-27 21:17:34.065108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.835 [2024-11-27 21:17:34.067385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.076611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.076929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.077063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.077090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.077106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.077240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.077408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.077429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.077442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.079882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.089002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.089276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.089389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.089416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.089431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.089556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.089703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.089724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.089738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.091844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.101208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.101499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.101612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.101638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.101653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.101809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.101913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.101934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.101948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.103871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.113409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.113713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.113812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.113837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.113852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.114001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.114152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.114187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.114200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.116336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.125621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.125919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.126024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.126050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.126065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.126197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.126380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.126400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.126413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.128723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.137797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.138108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.138209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.138234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.096 [2024-11-27 21:17:34.138249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.096 [2024-11-27 21:17:34.138397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.096 [2024-11-27 21:17:34.138573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.096 [2024-11-27 21:17:34.138595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.096 [2024-11-27 21:17:34.138609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.096 [2024-11-27 21:17:34.140481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.096 [2024-11-27 21:17:34.149960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.096 [2024-11-27 21:17:34.150291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.096 [2024-11-27 21:17:34.150429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.150453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.150469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.150641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.150810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.150832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.150861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.153048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.162256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.162546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.162678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.162703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.162719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.162868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.163000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.163021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.163034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.165053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.174544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.174794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.174928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.174953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.174969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.175150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.175329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.175349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.175362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.177415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.186701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.186961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.187099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.187124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.187140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.187288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.187484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.187504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.187517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.189591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.199089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.199435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.199559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.199586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.199602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.199750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.199915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.199936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.199949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.201972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.211448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.211787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.211888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.211913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.211929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.212060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.212240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.212261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.212274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.214278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.223642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.223995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.224107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.224137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.224153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.097 [2024-11-27 21:17:34.224301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.097 [2024-11-27 21:17:34.224480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.097 [2024-11-27 21:17:34.224500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.097 [2024-11-27 21:17:34.224514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.097 [2024-11-27 21:17:34.226564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.097 [2024-11-27 21:17:34.235943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.097 [2024-11-27 21:17:34.236231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.236366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.097 [2024-11-27 21:17:34.236391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.097 [2024-11-27 21:17:34.236407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.236506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.236697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.236719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.236733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.238876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.248274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.248561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.248655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.248680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.248696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.248811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.248914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.248949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.248962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.250964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.260408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.260652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.260779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.260804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.260824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.260974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.261122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.261143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.261156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.263404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.272596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.272992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.273092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.273117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.273133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.273249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.273416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.273437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.273451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.275667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.284937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.285220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.285319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.285345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.285360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.285508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.285684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.285707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.285720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.287858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.297460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.297771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.297906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.297933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.297949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.298086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.298238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.298259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.298272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.300352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.309799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.310089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.310214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.310239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.310255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.310418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.098 [2024-11-27 21:17:34.310609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.098 [2024-11-27 21:17:34.310631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.098 [2024-11-27 21:17:34.310645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.098 [2024-11-27 21:17:34.312653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.098 [2024-11-27 21:17:34.321879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.098 [2024-11-27 21:17:34.322152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.322276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.098 [2024-11-27 21:17:34.322302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.098 [2024-11-27 21:17:34.322317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.098 [2024-11-27 21:17:34.322448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.099 [2024-11-27 21:17:34.322609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.099 [2024-11-27 21:17:34.322630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.099 [2024-11-27 21:17:34.322644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.099 [2024-11-27 21:17:34.324867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.099 [2024-11-27 21:17:34.334293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.099 [2024-11-27 21:17:34.334597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.099 [2024-11-27 21:17:34.334731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.099 [2024-11-27 21:17:34.334768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.099 [2024-11-27 21:17:34.334797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.099 [2024-11-27 21:17:34.334957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.359 [2024-11-27 21:17:34.335161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.359 [2024-11-27 21:17:34.335183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.359 [2024-11-27 21:17:34.335197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.359 [2024-11-27 21:17:34.337253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.359 [2024-11-27 21:17:34.346656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.359 [2024-11-27 21:17:34.346955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.347077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.347104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.359 [2024-11-27 21:17:34.347119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.359 [2024-11-27 21:17:34.347333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.359 [2024-11-27 21:17:34.347465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.359 [2024-11-27 21:17:34.347485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.359 [2024-11-27 21:17:34.347498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.359 [2024-11-27 21:17:34.349490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.359 [2024-11-27 21:17:34.359042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.359 [2024-11-27 21:17:34.359334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.359446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.359472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.359 [2024-11-27 21:17:34.359488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.359 [2024-11-27 21:17:34.359662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.359 [2024-11-27 21:17:34.359828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.359 [2024-11-27 21:17:34.359849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.359 [2024-11-27 21:17:34.359862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.359 [2024-11-27 21:17:34.362097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.359 [2024-11-27 21:17:34.371121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.359 [2024-11-27 21:17:34.371411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.371514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.359 [2024-11-27 21:17:34.371551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.359 [2024-11-27 21:17:34.371567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.359 [2024-11-27 21:17:34.371700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.371895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.371920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.371935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.374079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.383502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.383810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.383915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.383941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.383956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.384105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.384240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.384261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.384274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.386392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.395692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.395944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.396064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.396090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.396105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.396254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.396372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.396393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.396406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.398545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.407767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.408061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.408184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.408209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.408224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.408388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.408612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.408633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.408652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.410770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.420127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.420437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.420544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.420570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.420586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.420718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.420884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.420904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.420918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.423102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.432533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.432833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.432961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.432987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.433002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.433150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.433315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.433335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.433348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.435444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.444893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.445135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.445229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.445254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.445269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.445385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.445573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.445595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.445609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.447558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.457241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.457561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.457692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.360 [2024-11-27 21:17:34.457719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.360 [2024-11-27 21:17:34.457735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.360 [2024-11-27 21:17:34.457883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.360 [2024-11-27 21:17:34.458062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.360 [2024-11-27 21:17:34.458082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.360 [2024-11-27 21:17:34.458096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.360 [2024-11-27 21:17:34.460116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.360 [2024-11-27 21:17:34.469610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.360 [2024-11-27 21:17:34.469882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.469986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.470012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.470028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.470208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.470354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.470374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.470388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.472412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.481862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.482125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.482227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.482253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.482268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.482463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.482663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.482686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.482700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.484892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.494109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.494362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.494518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.494551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.494567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.494698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.494879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.494900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.494914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.496991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.506422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.506716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.506823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.506848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.506864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.507044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.507239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.507259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.507273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.509330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.518664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.518956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.519092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.519118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.519133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.519314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.519462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.519483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.519496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.521638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.531206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.531430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.531557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.531583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.531599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.531698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.531881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.531902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.531916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.534159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.543568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.543803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.543931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.543956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.543972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.544136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.361 [2024-11-27 21:17:34.544317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.361 [2024-11-27 21:17:34.544337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.361 [2024-11-27 21:17:34.544351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.361 [2024-11-27 21:17:34.546477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.361 [2024-11-27 21:17:34.556067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.361 [2024-11-27 21:17:34.556341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.556474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.361 [2024-11-27 21:17:34.556499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.361 [2024-11-27 21:17:34.556514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.361 [2024-11-27 21:17:34.556719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.362 [2024-11-27 21:17:34.556902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.362 [2024-11-27 21:17:34.556923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.362 [2024-11-27 21:17:34.556936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.362 [2024-11-27 21:17:34.559081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.362 [2024-11-27 21:17:34.568309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.362 [2024-11-27 21:17:34.568601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.568723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.568753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.362 [2024-11-27 21:17:34.568769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.362 [2024-11-27 21:17:34.568934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.362 [2024-11-27 21:17:34.569115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.362 [2024-11-27 21:17:34.569136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.362 [2024-11-27 21:17:34.569149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.362 [2024-11-27 21:17:34.571248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.362 [2024-11-27 21:17:34.580601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.362 [2024-11-27 21:17:34.580907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.581037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.581061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.362 [2024-11-27 21:17:34.581076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.362 [2024-11-27 21:17:34.581240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.362 [2024-11-27 21:17:34.581374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.362 [2024-11-27 21:17:34.581395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.362 [2024-11-27 21:17:34.581409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.362 [2024-11-27 21:17:34.583448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.362 [2024-11-27 21:17:34.592851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.362 [2024-11-27 21:17:34.593134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.593240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.362 [2024-11-27 21:17:34.593267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.362 [2024-11-27 21:17:34.593282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.362 [2024-11-27 21:17:34.593453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.362 [2024-11-27 21:17:34.593608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.362 [2024-11-27 21:17:34.593640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.362 [2024-11-27 21:17:34.593657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.362 [2024-11-27 21:17:34.595985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.658 [2024-11-27 21:17:34.605495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.658 [2024-11-27 21:17:34.605826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.658 [2024-11-27 21:17:34.605933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.658 [2024-11-27 21:17:34.605959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.658 [2024-11-27 21:17:34.605982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.658 [2024-11-27 21:17:34.606149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.658 [2024-11-27 21:17:34.606301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.658 [2024-11-27 21:17:34.606323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.658 [2024-11-27 21:17:34.606336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.658 [2024-11-27 21:17:34.608285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.658 [2024-11-27 21:17:34.617950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.658 [2024-11-27 21:17:34.618247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.658 [2024-11-27 21:17:34.618379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.658 [2024-11-27 21:17:34.618404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.618420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.618594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.618747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.618768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.618782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.620843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.630270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.630585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.630695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.630720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.630736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.630900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.631082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.631103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.631116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.633084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.642672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.642943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.643073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.643098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.643113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.643249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.643369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.643390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.643404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.645494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.654938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.655222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.655362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.655386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.655402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.655559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.655679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.655700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.655714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.657676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.667224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.667550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.667707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.667732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.667748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.667863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.668030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.668051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.668064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.670115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.679583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.679811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.679917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.679942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.679957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.680137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.680309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.680330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.680344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.682560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.691841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.692142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.692248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.692272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.692288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.692437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.692581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.692603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.692617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.694671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.704136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.704421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.704548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.704575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.659 [2024-11-27 21:17:34.704591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.659 [2024-11-27 21:17:34.704755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.659 [2024-11-27 21:17:34.704922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.659 [2024-11-27 21:17:34.704943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.659 [2024-11-27 21:17:34.704957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.659 [2024-11-27 21:17:34.707056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.659 [2024-11-27 21:17:34.716502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.659 [2024-11-27 21:17:34.716777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.716930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.659 [2024-11-27 21:17:34.716956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.716971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.717103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.717301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.717326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.717340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.719489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.728739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.729026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.729129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.729155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.729171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.729335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.729455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.729476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.729503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.731655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.741108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.741385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.741489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.741513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.741536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.741703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.741870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.741890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.741904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.744035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.753404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.753699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.753822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.753847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.753863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.754075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.754209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.754229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.754248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.756199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.765843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.766125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.766246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.766271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.766286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.766418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.766580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.766602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.766616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.768433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.777982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.778286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.778444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.778469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.778484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.778641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.778858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.778879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.778892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.780978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 [2024-11-27 21:17:34.790210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.790460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.790595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.790623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.790639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.790788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.790969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.790991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.791005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.793026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 21:17:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:38.660 21:17:34 -- common/autotest_common.sh@862 -- # return 0 00:27:38.660 21:17:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:38.660 21:17:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:38.660 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.660 [2024-11-27 21:17:34.802595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.660 [2024-11-27 21:17:34.802804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.802935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.660 [2024-11-27 21:17:34.802960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.660 [2024-11-27 21:17:34.802976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.660 [2024-11-27 21:17:34.803157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.660 [2024-11-27 21:17:34.803355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.660 [2024-11-27 21:17:34.803376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.660 [2024-11-27 21:17:34.803389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.660 [2024-11-27 21:17:34.805531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.660 21:17:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:38.660 [2024-11-27 21:17:34.814988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 21:17:34 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:38.661 21:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.661 [2024-11-27 21:17:34.815309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.661 [2024-11-27 21:17:34.815429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.815454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.815469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.815611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.815780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.815801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.815839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 [2024-11-27 21:17:34.817793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 [2024-11-27 21:17:34.819637] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:38.661 21:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.661 21:17:34 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:38.661 21:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.661 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.661 [2024-11-27 21:17:34.827155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 [2024-11-27 21:17:34.827453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.827595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.827626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.827642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.827823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.828034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.828054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.828068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 [2024-11-27 21:17:34.830108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 [2024-11-27 21:17:34.839608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 [2024-11-27 21:17:34.839878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.839993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.840019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.840034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.840183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.840351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.840371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.840384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 [2024-11-27 21:17:34.842474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 [2024-11-27 21:17:34.851954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 [2024-11-27 21:17:34.852418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.852558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.852584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.852604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.852731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.852903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.852925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.852942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 [2024-11-27 21:17:34.855063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 Malloc0 00:27:38.661 21:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.661 21:17:34 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:38.661 21:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.661 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.661 [2024-11-27 21:17:34.864399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 [2024-11-27 21:17:34.864755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.864900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.864926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.864941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.865057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.865208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.865229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.865243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 21:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.661 21:17:34 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:38.661 21:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.661 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.661 [2024-11-27 21:17:34.867385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 21:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.661 21:17:34 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:38.661 21:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.661 21:17:34 -- common/autotest_common.sh@10 -- # set +x 00:27:38.661 [2024-11-27 21:17:34.876845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.661 [2024-11-27 21:17:34.877101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.877235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:38.661 [2024-11-27 21:17:34.877261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ee160 with addr=10.0.0.2, port=4420 00:27:38.661 [2024-11-27 21:17:34.877277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ee160 is same with the state(5) to be set 00:27:38.661 [2024-11-27 21:17:34.877442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ee160 (9): Bad file descriptor 00:27:38.661 [2024-11-27 21:17:34.877460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:38.661 [2024-11-27 21:17:34.877604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:38.661 [2024-11-27 21:17:34.877626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:38.661 [2024-11-27 21:17:34.877641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:38.661 [2024-11-27 21:17:34.879782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:38.661 21:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.946 21:17:34 -- host/bdevperf.sh@38 -- # wait 4102052 00:27:38.946 [2024-11-27 21:17:34.889135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:38.946 [2024-11-27 21:17:34.963144] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:47.059 00:27:47.059 Latency(us) 00:27:47.059 [2024-11-27T20:17:43.300Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:47.059 [2024-11-27T20:17:43.300Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:47.059 Verification LBA range: start 0x0 length 0x4000 00:27:47.059 Nvme1n1 : 15.01 9038.72 35.31 16240.80 0.00 5048.54 737.28 20583.16 00:27:47.059 [2024-11-27T20:17:43.300Z] =================================================================================================================== 00:27:47.059 [2024-11-27T20:17:43.300Z] Total : 9038.72 35.31 16240.80 0.00 5048.54 737.28 20583.16 00:27:47.317 21:17:43 -- host/bdevperf.sh@39 -- # sync 00:27:47.317 21:17:43 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:47.317 21:17:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:47.317 21:17:43 -- common/autotest_common.sh@10 -- # set +x 00:27:47.317 21:17:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:47.317 21:17:43 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:47.317 21:17:43 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:47.317 21:17:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:47.317 21:17:43 -- nvmf/common.sh@116 -- # sync 00:27:47.317 21:17:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:47.317 21:17:43 -- nvmf/common.sh@119 -- # set +e 00:27:47.317 21:17:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:47.317 21:17:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:47.317 rmmod nvme_tcp 00:27:47.317 rmmod nvme_fabrics 00:27:47.317 rmmod nvme_keyring 00:27:47.317 21:17:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:47.317 21:17:43 -- nvmf/common.sh@123 -- # set -e 00:27:47.317 21:17:43 -- nvmf/common.sh@124 -- # return 0 00:27:47.317 21:17:43 -- nvmf/common.sh@477 -- # '[' -n 4102740 ']' 00:27:47.317 21:17:43 -- nvmf/common.sh@478 -- # killprocess 4102740 00:27:47.317 21:17:43 -- common/autotest_common.sh@936 -- # '[' -z 4102740 ']' 00:27:47.317 21:17:43 -- common/autotest_common.sh@940 -- # kill -0 4102740 00:27:47.317 21:17:43 -- common/autotest_common.sh@941 -- # uname 00:27:47.317 21:17:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:47.317 21:17:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4102740 00:27:47.575 21:17:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:47.576 21:17:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:47.576 21:17:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4102740' 00:27:47.576 killing process with pid 4102740 00:27:47.576 21:17:43 -- common/autotest_common.sh@955 -- # kill 4102740 00:27:47.576 21:17:43 -- common/autotest_common.sh@960 -- # wait 4102740 00:27:47.834 21:17:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:47.834 21:17:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:47.834 21:17:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:47.834 21:17:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:47.835 21:17:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:47.835 21:17:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:47.835 21:17:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:47.835 21:17:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.735 21:17:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:49.735 00:27:49.735 real 0m23.303s 00:27:49.735 user 1m2.347s 00:27:49.735 sys 0m4.634s 00:27:49.735 21:17:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:49.735 21:17:45 -- common/autotest_common.sh@10 -- # set +x 00:27:49.735 ************************************ 00:27:49.735 END TEST nvmf_bdevperf 00:27:49.735 ************************************ 00:27:49.735 21:17:45 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:49.735 21:17:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:49.735 21:17:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:49.735 21:17:45 -- common/autotest_common.sh@10 -- # set +x 00:27:49.735 ************************************ 00:27:49.735 START TEST nvmf_target_disconnect 00:27:49.735 ************************************ 00:27:49.735 21:17:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:49.994 * Looking for test storage... 00:27:49.994 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:49.994 21:17:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:49.994 21:17:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:49.994 21:17:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:49.994 21:17:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:49.994 21:17:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:49.994 21:17:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:49.994 21:17:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:49.994 21:17:46 -- scripts/common.sh@335 -- # IFS=.-: 00:27:49.994 21:17:46 -- scripts/common.sh@335 -- # read -ra ver1 00:27:49.994 21:17:46 -- scripts/common.sh@336 -- # IFS=.-: 00:27:49.994 21:17:46 -- scripts/common.sh@336 -- # read -ra ver2 00:27:49.994 21:17:46 -- scripts/common.sh@337 -- # local 'op=<' 00:27:49.994 21:17:46 -- scripts/common.sh@339 -- # ver1_l=2 00:27:49.994 21:17:46 -- scripts/common.sh@340 -- # ver2_l=1 00:27:49.994 21:17:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:49.994 21:17:46 -- scripts/common.sh@343 -- # case "$op" in 00:27:49.994 21:17:46 -- scripts/common.sh@344 -- # : 1 00:27:49.994 21:17:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:49.994 21:17:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:49.994 21:17:46 -- scripts/common.sh@364 -- # decimal 1 00:27:49.994 21:17:46 -- scripts/common.sh@352 -- # local d=1 00:27:49.994 21:17:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:49.994 21:17:46 -- scripts/common.sh@354 -- # echo 1 00:27:49.994 21:17:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:49.994 21:17:46 -- scripts/common.sh@365 -- # decimal 2 00:27:49.994 21:17:46 -- scripts/common.sh@352 -- # local d=2 00:27:49.994 21:17:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:49.994 21:17:46 -- scripts/common.sh@354 -- # echo 2 00:27:49.994 21:17:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:49.994 21:17:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:49.994 21:17:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:49.994 21:17:46 -- scripts/common.sh@367 -- # return 0 00:27:49.994 21:17:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:49.994 21:17:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:49.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.994 --rc genhtml_branch_coverage=1 00:27:49.994 --rc genhtml_function_coverage=1 00:27:49.994 --rc genhtml_legend=1 00:27:49.994 --rc geninfo_all_blocks=1 00:27:49.994 --rc geninfo_unexecuted_blocks=1 00:27:49.994 00:27:49.994 ' 00:27:49.994 21:17:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:49.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.994 --rc genhtml_branch_coverage=1 00:27:49.994 --rc genhtml_function_coverage=1 00:27:49.994 --rc genhtml_legend=1 00:27:49.994 --rc geninfo_all_blocks=1 00:27:49.994 --rc geninfo_unexecuted_blocks=1 00:27:49.994 00:27:49.994 ' 00:27:49.994 21:17:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:49.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.994 --rc genhtml_branch_coverage=1 00:27:49.994 --rc genhtml_function_coverage=1 00:27:49.994 --rc genhtml_legend=1 00:27:49.994 --rc geninfo_all_blocks=1 00:27:49.994 --rc geninfo_unexecuted_blocks=1 00:27:49.994 00:27:49.994 ' 00:27:49.994 21:17:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:49.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:49.994 --rc genhtml_branch_coverage=1 00:27:49.994 --rc genhtml_function_coverage=1 00:27:49.994 --rc genhtml_legend=1 00:27:49.994 --rc geninfo_all_blocks=1 00:27:49.994 --rc geninfo_unexecuted_blocks=1 00:27:49.994 00:27:49.994 ' 00:27:49.994 21:17:46 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:49.994 21:17:46 -- nvmf/common.sh@7 -- # uname -s 00:27:49.994 21:17:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:49.994 21:17:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:49.994 21:17:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:49.994 21:17:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:49.994 21:17:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:49.994 21:17:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:49.994 21:17:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:49.994 21:17:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:49.994 21:17:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:49.994 21:17:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:49.994 21:17:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.994 21:17:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.994 21:17:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:49.994 21:17:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:49.994 21:17:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:49.994 21:17:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.994 21:17:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.994 21:17:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.994 21:17:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.995 21:17:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.995 21:17:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.995 21:17:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.995 21:17:46 -- paths/export.sh@5 -- # export PATH 00:27:49.995 21:17:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.995 21:17:46 -- nvmf/common.sh@46 -- # : 0 00:27:49.995 21:17:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:49.995 21:17:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:49.995 21:17:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:49.995 21:17:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:49.995 21:17:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:49.995 21:17:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:49.995 21:17:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:49.995 21:17:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:49.995 21:17:46 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:49.995 21:17:46 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:49.995 21:17:46 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:49.995 21:17:46 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:49.995 21:17:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:49.995 21:17:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:49.995 21:17:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:49.995 21:17:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:49.995 21:17:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:49.995 21:17:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.995 21:17:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.995 21:17:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.995 21:17:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:49.995 21:17:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:49.995 21:17:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:49.995 21:17:46 -- common/autotest_common.sh@10 -- # set +x 00:27:51.907 21:17:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:51.907 21:17:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:51.907 21:17:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:51.907 21:17:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:51.907 21:17:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:51.907 21:17:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:51.907 21:17:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:51.907 21:17:48 -- nvmf/common.sh@294 -- # net_devs=() 00:27:51.907 21:17:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:51.907 21:17:48 -- nvmf/common.sh@295 -- # e810=() 00:27:51.907 21:17:48 -- nvmf/common.sh@295 -- # local -ga e810 00:27:51.907 21:17:48 -- nvmf/common.sh@296 -- # x722=() 00:27:51.907 21:17:48 -- nvmf/common.sh@296 -- # local -ga x722 00:27:51.907 21:17:48 -- nvmf/common.sh@297 -- # mlx=() 00:27:51.907 21:17:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:51.907 21:17:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:51.907 21:17:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:51.907 21:17:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:51.907 21:17:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.907 21:17:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:51.907 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:51.907 21:17:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.907 21:17:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:51.907 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:51.907 21:17:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.907 21:17:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.907 21:17:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.907 21:17:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:51.907 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:51.907 21:17:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.907 21:17:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.907 21:17:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.907 21:17:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.907 21:17:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:51.907 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:51.907 21:17:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.907 21:17:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:51.907 21:17:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:51.907 21:17:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:51.907 21:17:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:51.907 21:17:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:51.907 21:17:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:51.907 21:17:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:51.907 21:17:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:51.907 21:17:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:51.907 21:17:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:51.907 21:17:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:51.907 21:17:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:51.907 21:17:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:51.907 21:17:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:51.907 21:17:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:51.907 21:17:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:51.907 21:17:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:51.908 21:17:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:51.908 21:17:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:51.908 21:17:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:52.166 21:17:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:52.166 21:17:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:52.166 21:17:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:52.166 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:52.166 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:27:52.166 00:27:52.166 --- 10.0.0.2 ping statistics --- 00:27:52.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:52.166 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:27:52.166 21:17:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:52.166 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:52.166 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:27:52.166 00:27:52.166 --- 10.0.0.1 ping statistics --- 00:27:52.166 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:52.166 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:27:52.166 21:17:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:52.166 21:17:48 -- nvmf/common.sh@410 -- # return 0 00:27:52.166 21:17:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:52.166 21:17:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:52.166 21:17:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:52.166 21:17:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:52.166 21:17:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:52.166 21:17:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:52.166 21:17:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:52.166 21:17:48 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:52.166 21:17:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:52.166 21:17:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:52.166 21:17:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.166 ************************************ 00:27:52.166 START TEST nvmf_target_disconnect_tc1 00:27:52.166 ************************************ 00:27:52.166 21:17:48 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:52.166 21:17:48 -- host/target_disconnect.sh@32 -- # set +e 00:27:52.166 21:17:48 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:52.166 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.166 [2024-11-27 21:17:48.281287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.166 [2024-11-27 21:17:48.281459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.166 [2024-11-27 21:17:48.281489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1eccb40 with addr=10.0.0.2, port=4420 00:27:52.166 [2024-11-27 21:17:48.281539] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:52.166 [2024-11-27 21:17:48.281565] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:52.166 [2024-11-27 21:17:48.281580] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:52.166 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:52.166 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:52.166 Initializing NVMe Controllers 00:27:52.166 21:17:48 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:52.167 21:17:48 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:52.167 21:17:48 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:52.167 21:17:48 -- common/autotest_common.sh@1142 -- # return 0 00:27:52.167 21:17:48 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:52.167 21:17:48 -- host/target_disconnect.sh@41 -- # set -e 00:27:52.167 00:27:52.167 real 0m0.086s 00:27:52.167 user 0m0.030s 00:27:52.167 sys 0m0.056s 00:27:52.167 21:17:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:52.167 21:17:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.167 ************************************ 00:27:52.167 END TEST nvmf_target_disconnect_tc1 00:27:52.167 ************************************ 00:27:52.167 21:17:48 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:52.167 21:17:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:52.167 21:17:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:52.167 21:17:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.167 ************************************ 00:27:52.167 START TEST nvmf_target_disconnect_tc2 00:27:52.167 ************************************ 00:27:52.167 21:17:48 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:52.167 21:17:48 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:52.167 21:17:48 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:52.167 21:17:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:52.167 21:17:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:52.167 21:17:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.167 21:17:48 -- nvmf/common.sh@469 -- # nvmfpid=4105945 00:27:52.167 21:17:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:52.167 21:17:48 -- nvmf/common.sh@470 -- # waitforlisten 4105945 00:27:52.167 21:17:48 -- common/autotest_common.sh@829 -- # '[' -z 4105945 ']' 00:27:52.167 21:17:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:52.167 21:17:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:52.167 21:17:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:52.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:52.167 21:17:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:52.167 21:17:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.167 [2024-11-27 21:17:48.360001] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:52.167 [2024-11-27 21:17:48.360085] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:52.167 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.426 [2024-11-27 21:17:48.427348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:52.426 [2024-11-27 21:17:48.536707] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:52.426 [2024-11-27 21:17:48.536850] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:52.426 [2024-11-27 21:17:48.536875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:52.426 [2024-11-27 21:17:48.536888] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:52.426 [2024-11-27 21:17:48.536960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:52.426 [2024-11-27 21:17:48.537010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:52.426 [2024-11-27 21:17:48.537061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:52.426 [2024-11-27 21:17:48.537064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:53.360 21:17:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:53.360 21:17:49 -- common/autotest_common.sh@862 -- # return 0 00:27:53.360 21:17:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:53.360 21:17:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 21:17:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:53.360 21:17:49 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 Malloc0 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 [2024-11-27 21:17:49.438918] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 [2024-11-27 21:17:49.467178] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:53.360 21:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.360 21:17:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.360 21:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.360 21:17:49 -- host/target_disconnect.sh@50 -- # reconnectpid=4106101 00:27:53.360 21:17:49 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:53.360 21:17:49 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:53.360 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.262 21:17:51 -- host/target_disconnect.sh@53 -- # kill -9 4105945 00:27:55.262 21:17:51 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 [2024-11-27 21:17:51.492140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Read completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.262 Write completed with error (sct=0, sc=8) 00:27:55.262 starting I/O failed 00:27:55.263 [2024-11-27 21:17:51.492503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Write completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 Read completed with error (sct=0, sc=8) 00:27:55.263 starting I/O failed 00:27:55.263 [2024-11-27 21:17:51.492863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:55.263 [2024-11-27 21:17:51.493093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.493392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.493650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.493783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.493906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.494133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.494359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.494612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.494735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.494828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.495207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.495505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.495771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.495938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.496064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.496285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.496589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.496874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.496998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.497121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.497399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.497681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.497802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.497905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.498042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.263 [2024-11-27 21:17:51.498086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.263 qpair failed and we were unable to recover it. 00:27:55.263 [2024-11-27 21:17:51.498283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.498519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.498777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.498902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.499098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.499350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.499602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.499887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.499990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.500027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.500176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.500308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.500335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.500462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.500584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.500611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.500729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.501653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-11-27 21:17:51.501679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.264 [2024-11-27 21:17:51.501796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.501948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.501985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.502119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.502476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.502766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.502914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.503006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.503250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.503531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.503778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.503983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.504132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.504235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.539 [2024-11-27 21:17:51.504262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.539 qpair failed and we were unable to recover it. 00:27:55.539 [2024-11-27 21:17:51.504366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.504521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.504555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.504690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.504818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.504844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.504941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.505155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.505453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.505711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.505859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.506011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.506300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.506519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.506818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.506986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.507143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.507410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.507677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.507825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.507970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.508186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.508488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.508737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.508855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.508982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.509241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.509540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.509716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.509861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.510132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.510433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.510664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.510789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.510917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.511163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.511436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.511678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.511854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.540 qpair failed and we were unable to recover it. 00:27:55.540 [2024-11-27 21:17:51.512005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.540 [2024-11-27 21:17:51.512103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.512280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.512583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.512832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.512981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.513105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.513369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.513592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.513742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.513868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.514169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.514484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.514837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.514985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.515115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.515384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.515688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.515805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.515926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.516248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.516493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.516809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.516958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.517084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.517384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.517685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.517886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.518031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.518298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.518594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.518833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.518984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.519076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.519308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.519590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.519861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.541 [2024-11-27 21:17:51.519980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.541 qpair failed and we were unable to recover it. 00:27:55.541 [2024-11-27 21:17:51.520105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.520373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.520654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.520804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.520926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Write completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 Read completed with error (sct=0, sc=8) 00:27:55.542 starting I/O failed 00:27:55.542 [2024-11-27 21:17:51.521343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:55.542 [2024-11-27 21:17:51.521493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.521756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.521933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.522104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.522394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.522646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.522773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.522915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.523211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.523485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.523800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.523949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.524073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.524356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.524635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.524775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.524886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.525195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.525429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.525684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.525892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.542 qpair failed and we were unable to recover it. 00:27:55.542 [2024-11-27 21:17:51.526022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.542 [2024-11-27 21:17:51.526150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.526298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.526547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.526824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.526972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.527094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.527401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.527715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.527858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.528028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.528324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.528621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.528745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.528883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.529205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.529534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.529791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.529941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.530023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.530268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.530576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.530829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.530946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.531068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.531320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.531584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.531828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.531950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.532126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.532468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.532763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.532933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.533069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.533401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.533654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.533823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.543 qpair failed and we were unable to recover it. 00:27:55.543 [2024-11-27 21:17:51.533927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.534090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.543 [2024-11-27 21:17:51.534117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.534260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.534534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.534808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.534921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.535038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.535355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.535683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.535846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.536009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.536307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.536567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.536802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.536949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.537105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.537362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.537595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.537905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.537993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.538121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.538393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.538669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.538784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.538905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.539185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.539464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.539783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.539970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.540126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.540226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.540251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.540397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.540584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.544 qpair failed and we were unable to recover it. 00:27:55.544 [2024-11-27 21:17:51.540735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.544 [2024-11-27 21:17:51.540895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.540920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.541044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.541349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.541626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.541774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.541895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.542173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.542398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.542694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.542877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.543028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.543347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.543600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.543757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.543922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.544182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.544461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.544737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.544885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.545010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.545258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.545550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.545820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.545990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.546142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.546419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.546657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.546776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.546901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.547168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.547461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.547745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.547893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.548009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.548303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.545 [2024-11-27 21:17:51.548633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.545 [2024-11-27 21:17:51.548780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.545 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.548898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.549211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.549487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.549768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.549918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.550040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.550283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.550579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.550737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.550881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.551190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.551539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.551832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.551985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.552160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.552401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.552640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.552781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.552924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.553276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.553585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.553865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.553987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.554156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.554419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.554701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.554847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.554942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.555261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.555502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.555774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.555922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.556047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.556308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.556541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.556743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.546 qpair failed and we were unable to recover it. 00:27:55.546 [2024-11-27 21:17:51.556865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.546 [2024-11-27 21:17:51.557002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.557204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.557421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.557756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.557945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.558097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.558369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.558697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.558844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.558937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.559155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.559366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.559615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.559771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.559951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.560233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.560509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.560743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.560892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.561011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.561262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.561494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.561739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.561909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.562036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.562318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.562651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.562801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.562930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.563163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.563454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.563750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.563895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.564096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.564332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.547 [2024-11-27 21:17:51.564569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.547 [2024-11-27 21:17:51.564715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.547 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.564861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.564998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.565115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.565356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.565631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.565780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.565905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.566172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.566472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.566706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.566828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.566950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.567194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.567452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.567693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.567841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.567986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.568314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.568630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.568812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.568927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.569140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.569423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.569667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.569808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.569936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.570201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.570478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.570754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.570906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.571019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.571115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.571141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.548 [2024-11-27 21:17:51.571230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.571345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.548 [2024-11-27 21:17:51.571373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.548 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.571482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.571649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.571675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.571801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.571928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.571953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.572102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.572356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.572683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.572861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.572962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.573199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.573490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.573769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.573920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.574047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.574363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.574610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.574733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.574904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.575197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.575482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.575776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.575949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.576099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.576322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.576614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.576856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.576982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.577102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.577378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.577688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.577839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.577948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.578270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.578539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.578819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.578963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.579080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.579216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.579249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.549 qpair failed and we were unable to recover it. 00:27:55.549 [2024-11-27 21:17:51.579394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.549 [2024-11-27 21:17:51.579494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.579518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.579682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.579780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.579804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.579948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.580263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.580623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.580839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.580972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.581119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.581397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.581640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.581788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.581911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.582188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.582457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.582760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.582916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.583013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.583252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.583535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.583769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.583941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.584057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.584330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.584658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.584773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.584938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.585248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.585594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.585818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.585994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.586120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.586385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.586687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.586812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.586936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.587057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.587082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.587194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.587330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.587373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.550 qpair failed and we were unable to recover it. 00:27:55.550 [2024-11-27 21:17:51.587477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.550 [2024-11-27 21:17:51.587601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.587627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.587722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.587848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.587874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.588020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.588300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.588576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.588817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.588931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.589052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.589292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.589558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.589820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.589959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.590057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.590305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.590626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.590745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.590872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.591203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.591505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.591816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.591959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.592112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.592397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.592678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.592792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.592911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.593172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.593486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.593764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.593885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.594036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.594276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.594544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.594811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.594992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.595141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.595267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.551 [2024-11-27 21:17:51.595292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.551 qpair failed and we were unable to recover it. 00:27:55.551 [2024-11-27 21:17:51.595453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.595576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.595601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.595745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.595846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.595872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.596000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.596315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.596629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.596832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.596955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.597223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.597502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.597811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.597963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.598111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.598367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.598676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.598824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.598956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.599208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.599501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.599837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.599977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.600139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.600446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.600791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.600934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.601053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.601346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.601630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.601802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.601947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.602227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.602507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.602804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.602950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.603073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.603348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.603655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.552 [2024-11-27 21:17:51.603804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.552 qpair failed and we were unable to recover it. 00:27:55.552 [2024-11-27 21:17:51.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.604216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.604543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.604844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.605182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.605463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.605745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.605889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.606005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.606293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.606602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.606844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.606992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.607125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.607398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.607703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.607852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.607955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.608259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.608582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.608874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.608994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.609184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.609461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.609758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.609948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.610090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.610305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.610637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.610797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.610923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.611043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.611068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.553 [2024-11-27 21:17:51.611171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.611316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.553 [2024-11-27 21:17:51.611344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.553 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.611495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.611627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.611652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.611746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.611875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.611900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.611992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.612237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.612457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.612727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.612921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.613035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.613375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.613701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.613909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.614065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.614344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.614650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.614879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.614992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.615192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.615468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.615689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.615882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.616007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.616271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.616503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.616756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.616899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.617022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.617294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.617548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.617824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.617940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.618037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.618310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.618596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.618735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.618840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.619000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.619027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.554 [2024-11-27 21:17:51.619144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.619244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.554 [2024-11-27 21:17:51.619268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.554 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.619363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.619588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.619830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.619954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.620047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.620326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.620669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.620845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.620982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.621285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.621590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.621766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.621905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.622225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.622457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.622719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.622879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.623008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.623241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.623500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.623833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.623981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.624128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.624389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.624668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.624801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.624944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.625243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.625559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.625870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.625990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.626192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.626514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.626776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.626883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.627025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.627166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.627190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.555 [2024-11-27 21:17:51.627281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.627452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.555 [2024-11-27 21:17:51.627479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.555 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.627635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.627784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.627808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.627929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.628207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.628490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.628770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.628892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.629001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.629281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.629550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.629804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.629950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.630102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.630362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.630672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.630835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.630949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.631221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.631568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.631883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.631994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.632091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.632333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.632597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.632835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.632952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.633069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.633396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.633632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.633792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.633904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.634164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.634407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.634632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.634900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.634986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.635010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.556 qpair failed and we were unable to recover it. 00:27:55.556 [2024-11-27 21:17:51.635161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.635305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.556 [2024-11-27 21:17:51.635332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.635467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.635596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.635621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.635748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.635866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.635891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.636009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.636322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.636566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.636714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.636870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.637139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.637454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.637679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.637899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.637998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.638291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.638508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.638761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.638929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.639072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.639412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.639716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.639868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.640017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.640312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.640608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.640796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.640899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.641161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.641429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.641690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.641829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.641957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.642292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.642591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.642760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.642874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.643016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.643043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.557 qpair failed and we were unable to recover it. 00:27:55.557 [2024-11-27 21:17:51.643229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.557 [2024-11-27 21:17:51.643323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.643347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.643466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.643585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.643611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.643737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.643850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.643878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.644058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.644569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.644841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.644983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.645135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.645384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.645756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.645914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.646032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.646347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.646665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.646838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.646967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.647318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.647598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.647827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.647950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.648044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.648355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.648595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.648745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.648915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.649219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.649493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.649739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.649859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.650004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.650139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.650180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.650331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.650445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.650470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.558 qpair failed and we were unable to recover it. 00:27:55.558 [2024-11-27 21:17:51.650673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.558 [2024-11-27 21:17:51.650812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.650840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.650942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.651252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.651539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.651848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.651993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.652120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.652384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.652653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.652784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.652894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.653200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.653466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.653748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.653897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.654059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.654410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.654724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.654875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.655090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.655522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.655764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.655911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.656051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.656300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.656614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.656742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.656893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.657221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.657535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.657780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.657907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.658028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.658345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.658670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.658824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.658985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.659076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.559 [2024-11-27 21:17:51.659100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.559 qpair failed and we were unable to recover it. 00:27:55.559 [2024-11-27 21:17:51.659237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.659583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.659810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.659994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.660125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.660398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.660701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.660845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.660957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.661219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.661486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.661831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.661985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.662088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.662354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.662559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.662830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.662953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.663048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.663284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.663556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.663947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.664073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.664306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.664521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.664750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.664888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.664981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.665261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.665566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.665816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.665978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.666084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.666369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.560 [2024-11-27 21:17:51.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.560 [2024-11-27 21:17:51.666768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.560 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.666912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.667206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.667533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.667810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.667991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.668136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.668393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.668664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.668783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.668902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.669145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.669438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.669712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.669859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.669968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.670219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.670460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.670731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.670909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.671034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.671309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.671619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.671771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.671880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.672150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.672398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.672713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.672846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.672996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.673308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.673597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.673837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.673961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.674063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.674405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.561 [2024-11-27 21:17:51.674741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.561 [2024-11-27 21:17:51.674915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.561 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.675019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.675308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.675596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.675885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.675983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.676145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.676488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.676788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.676933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.677079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.677335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.677690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.677847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.677984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.678315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.678567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.678836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.678944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.679063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.679664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.679826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.679930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.680174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.680444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.680740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.680861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.680971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.681273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.681529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.681814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.681952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.562 [2024-11-27 21:17:51.682090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.682237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.562 [2024-11-27 21:17:51.682261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.562 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.682379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.682508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.682539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.682671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.682816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.682842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.682983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.683292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.683584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.683774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.683911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.684182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.684459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.684781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.684917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.685089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.685396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.685713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.685855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.686004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.686293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.686586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.686896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.686995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.687121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.687402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.687704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.687828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.687926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.688161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.688446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.688707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.688830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.688960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.689258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.689503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.689797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.689959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.690132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.690280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.690319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.563 [2024-11-27 21:17:51.690464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.690565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.563 [2024-11-27 21:17:51.690591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.563 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.690738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.690883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.690907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.691029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.691348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.691665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.691837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.692029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.692409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.692737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.692878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.693018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.693326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.693626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.693809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.693955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.694253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.694536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.694816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.694966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.695088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.695325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.695631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.695757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.695897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.696199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.696473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.696731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.696906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.697055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.697303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.697685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.697814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.697936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.698188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.698462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.698705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.698838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.564 qpair failed and we were unable to recover it. 00:27:55.564 [2024-11-27 21:17:51.698962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.699086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.564 [2024-11-27 21:17:51.699112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.699266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.699535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.699783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.699933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.700062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.700314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.700600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.700835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.700983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.701113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.701392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.701639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.701766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.701909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.702155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.702414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.702715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.702838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.702931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.703200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.703537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.703751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.703870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.703989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.704301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.704580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.704724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.704858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.705137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.705420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.705674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.705791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.705899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.706167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.706448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.565 qpair failed and we were unable to recover it. 00:27:55.565 [2024-11-27 21:17:51.706699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.565 [2024-11-27 21:17:51.706822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.706847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.706975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.707266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.707536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.707800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.707925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.708039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.708360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.708646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.708766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.708914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.709177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.709716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.709831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.709988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.710198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.710436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.710768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.710886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.711004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.711234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.711590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.711827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.711946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.712087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.712374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.712654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.712779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.712894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.713152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.713371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.713618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.713758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.713898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.714062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.714088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.714206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.714355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.714379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.566 qpair failed and we were unable to recover it. 00:27:55.566 [2024-11-27 21:17:51.714537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.566 [2024-11-27 21:17:51.714680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.714707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.714859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.714976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.715106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.715379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.715679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.715813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.715985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.716269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.716596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.716867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.716987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.717112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.717404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.717717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.717892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.718014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.718355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.718684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.718904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.718994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.719142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.719469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.719743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.719909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.720074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.720359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.720609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.720729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.720870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.721146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.721483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.721734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.721862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.567 qpair failed and we were unable to recover it. 00:27:55.567 [2024-11-27 21:17:51.721962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.567 [2024-11-27 21:17:51.722080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.722103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.722265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.722398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.722424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.722593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.722729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.722756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.722890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.723136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.723433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.723724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.723874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.723997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.724238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.724520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.724830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.724968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.725094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.725343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.725557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.725724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.725846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.726132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.726436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.726713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.726870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.726992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.727262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.727499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.727783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.727954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.728074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.728381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.728655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.728803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.728914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.729185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.729510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.568 [2024-11-27 21:17:51.729788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.568 [2024-11-27 21:17:51.729899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.568 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.730018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.730274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.730568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.730826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.730975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.731094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.731398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.731700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.731840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.731959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.732244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.732511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.732810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.732956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.733092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.733373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.733675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.733824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.733947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.734220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.734512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.734813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.734984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.735107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.735400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.735712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.735857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.735987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.736202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.736468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.736751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.736904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.737008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.737333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.737607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.737775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-27 21:17:51.737917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.738066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.569 [2024-11-27 21:17:51.738092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.738277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.738405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.738431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.738556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.738693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.738734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.738853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.738978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.739103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.739429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.739692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.739814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.739920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.740227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.740485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.740837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.740996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.741148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.741427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.741708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.741853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.741986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.742287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.742610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.742773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.742939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.743281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.743555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.743831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.743983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.744071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.744355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.744642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.744849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.744961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.745108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.745440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.745732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.745853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.745983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.746082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.746108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-27 21:17:51.746202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.746324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.570 [2024-11-27 21:17:51.746350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.746448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.746537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.746562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.746658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.746759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.746784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.746880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.746999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.747122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.747389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.747659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.747781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.747941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.748267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.748539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.748794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.748911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.749031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.749275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.749617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.749742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.749894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.750168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.750389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.750678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.750830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.751000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.751301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.751558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.751863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.751999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.752152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.752386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.752647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.752774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.752879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.753004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.753029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-27 21:17:51.753170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.753305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.571 [2024-11-27 21:17:51.753331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.753460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.753561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.753587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.753711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.753838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.753864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.754007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.754330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.754628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.754746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.754874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.755127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.755401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.755655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.755778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.755907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.756152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.756385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.756637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.756792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.756917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.757250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.757476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.757755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.757933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.758090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.758397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.758701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.758898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.759033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.759288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.759558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.759838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.759963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.760058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.760328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.760663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.760826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.760953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.761078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.761103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.572 qpair failed and we were unable to recover it. 00:27:55.572 [2024-11-27 21:17:51.761224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.572 [2024-11-27 21:17:51.761322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.761347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.573 qpair failed and we were unable to recover it. 00:27:55.573 [2024-11-27 21:17:51.761496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.761644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.761670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.573 qpair failed and we were unable to recover it. 00:27:55.573 [2024-11-27 21:17:51.761844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.761975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.762019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.573 qpair failed and we were unable to recover it. 00:27:55.573 [2024-11-27 21:17:51.762149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.762274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.762300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.573 qpair failed and we were unable to recover it. 00:27:55.573 [2024-11-27 21:17:51.762438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.762560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.573 [2024-11-27 21:17:51.762590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.762697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.762794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.762821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.762948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.763190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.763396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.763647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.763802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.763920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.764144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.764392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.764664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.764809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.764907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.765184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.765428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.765670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.765797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.765948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.766246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.766555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.766805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.766954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.767076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.767171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.851 [2024-11-27 21:17:51.767196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.851 qpair failed and we were unable to recover it. 00:27:55.851 [2024-11-27 21:17:51.767295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.767387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.767412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.767508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.767602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.767628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.767794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.767957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.768122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.768374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.768683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.768857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.768963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.769255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.769499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.769724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.769895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.770046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.770315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.770569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.770719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.770882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.771208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.771506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.771777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.771900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.771997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.772256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.772538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.772838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.772982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.773099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.773411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.773724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.773873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.774004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.774289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.774579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.774863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.774996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.775021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.852 [2024-11-27 21:17:51.775112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.775231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.852 [2024-11-27 21:17:51.775258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.852 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.775353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.775454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.775480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.775585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.775707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.775749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.775880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.775982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.776141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.776466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.776804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.776933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.777061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.777339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.777595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.777897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.777991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.778119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.778449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.778785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.778955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.779126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.779378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.779677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.779811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.779942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.780225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.780477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.780732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.780870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.780966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.781252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.781481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.781785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.781905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.782005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.782280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.782586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.782759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.782895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.783034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.783061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.853 qpair failed and we were unable to recover it. 00:27:55.853 [2024-11-27 21:17:51.783186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.853 [2024-11-27 21:17:51.783311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.783336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.783462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.783590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.783617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.783813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.783934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.783959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.784087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.784386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.784702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.784876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.784998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.785237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.785487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.785769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.785943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.786070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.786313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.786599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.786769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.786895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.787181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.787443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.787697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.787875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.788003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.788283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.788557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.788718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.788875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.789183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.789479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.789710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.789853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.790026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.790298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.790512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.790777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.790968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.854 [2024-11-27 21:17:51.791070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.791163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.854 [2024-11-27 21:17:51.791189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.854 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.791343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.791593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.791807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.791933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.792023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.792349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.792597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.792807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.792967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.793139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.793499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.793813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.793985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.794149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.794480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.794708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.794828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.794933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.795219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.795532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.795793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.795940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.796062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.796310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.796580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.796734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.796884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.797435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.797705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.797827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.855 qpair failed and we were unable to recover it. 00:27:55.855 [2024-11-27 21:17:51.797931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.798025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.855 [2024-11-27 21:17:51.798050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.798142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.798425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.798730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.798878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.799006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.799293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.799587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.799803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.799927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.800164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.800416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.800710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.800835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.800983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.801259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.801535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.801789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.801924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.802068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.802378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.802671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.802835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.803001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.803263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.803535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.803788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.803946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.804066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.804353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.804612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.804735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.804861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.805175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.805462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.856 qpair failed and we were unable to recover it. 00:27:55.856 [2024-11-27 21:17:51.805743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.856 [2024-11-27 21:17:51.805838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.805863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.805991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.806266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.806551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.806799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.806955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.807081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.807365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.807646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.807800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.807929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.808208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.808501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.808821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.808971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.809092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.809307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.809577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.809853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.809976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.810126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.810375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.810667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.810833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.810963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.811187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.811431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.811702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.811874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.811975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.812264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.812553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.812808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.812955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.813054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.813180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.813206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.857 [2024-11-27 21:17:51.813333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.813463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.857 [2024-11-27 21:17:51.813492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.857 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.813648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.813767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.813793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.813891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.814163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.814477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.814756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.814936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.815068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.815327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.815576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.815778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.815875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.816167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.816507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.816805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.816924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.817053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.817325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.817611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.817760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.817936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.818209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.818460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.818715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.818838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.818975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.819254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.819632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.819761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.819896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.820143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.820504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.820819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.820968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.821117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.821366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.858 [2024-11-27 21:17:51.821594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.858 [2024-11-27 21:17:51.821728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.858 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.821831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.821971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.822154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.822423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.822684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.822806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.822924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.823162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.823371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.823664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.823818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.823910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.824142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.824367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.824647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.824813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.824926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.825208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.825445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.825720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.825871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.825974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.826252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.826534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.826786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.826937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.827076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.827325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.827563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.827738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.827877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.828152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.828421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.828632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.828783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.828883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.829004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.829030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.859 qpair failed and we were unable to recover it. 00:27:55.859 [2024-11-27 21:17:51.829183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.829299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.859 [2024-11-27 21:17:51.829326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.829474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.829623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.829650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.829784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.829936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.829962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.830086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.830316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.830562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.830839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.830959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.831080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.831328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.831592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.831834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.831949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.832045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.832267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.832546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.832859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.832986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.833136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.833363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.833736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.833915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.834017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.834277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.834557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.834824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.834973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.835095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.835371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.835674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.835838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.835966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.836101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.836127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.860 qpair failed and we were unable to recover it. 00:27:55.860 [2024-11-27 21:17:51.836250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.860 [2024-11-27 21:17:51.836349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.836374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.836473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.836574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.836617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.836764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.836879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.836905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.837025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.837311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.837642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.837818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.837926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.838171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.838396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.838731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.838912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.839065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.839309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.839546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.839710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.839892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.840163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.840441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.840752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.840979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.841086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.841361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.841614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.841836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.841964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.842100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.842418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.842648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.842797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.842914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.843238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.843482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.843742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.843886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.843991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.844123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.861 [2024-11-27 21:17:51.844150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.861 qpair failed and we were unable to recover it. 00:27:55.861 [2024-11-27 21:17:51.844270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.844422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.844447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.844587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.844723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.844751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.844865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.844984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.845134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.845373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.845683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.845813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.845913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.846154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.846439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.846711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.846923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.847052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.847304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.847585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.847841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.847992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.848144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.848413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.848683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.848825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.848925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.849200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.849411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.849748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.849896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.850052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.850326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.850594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.850737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.850907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.851149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.851418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.851644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.851785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.851914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.852039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.862 [2024-11-27 21:17:51.852066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.862 qpair failed and we were unable to recover it. 00:27:55.862 [2024-11-27 21:17:51.852214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.852486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.852745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.852890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.853035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.853366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.853657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.853776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.853962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.854252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.854553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.854817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.854942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.855060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.855278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.855529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.855763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.855919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.856056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.856392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.856666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.856808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.856957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.857234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.857501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.857749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.857864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.857958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.858234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.858476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.858730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.858909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.859050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.859295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.859538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.859759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.863 [2024-11-27 21:17:51.859908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.863 qpair failed and we were unable to recover it. 00:27:55.863 [2024-11-27 21:17:51.859998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.860263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.860488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.860739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.860863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.860987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.861200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.861459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.861703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.861851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.862000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.862329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.862641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.862795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.862896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.863251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.863504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.863732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.863913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.864015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.864281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.864553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.864800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.864947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.865055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.865359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.865670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.865800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.865917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.866214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.866460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.866700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.866843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.866982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.867326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.867604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.864 [2024-11-27 21:17:51.867721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.864 qpair failed and we were unable to recover it. 00:27:55.864 [2024-11-27 21:17:51.867809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.867934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.867959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.868144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.868429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.868650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.868775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.868872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.869193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.869461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.869747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.869908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.870011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.870234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.870596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.870768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.870919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.871201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.871475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.871733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.871868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.871973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.872283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.872568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.872799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.872992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.873089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.873390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.873738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.873885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.874008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.874110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.874135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.865 qpair failed and we were unable to recover it. 00:27:55.865 [2024-11-27 21:17:51.874257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.865 [2024-11-27 21:17:51.874348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.874373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.874502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.874603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.874633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.874765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.874859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.874885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.875007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.875285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.875537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.875787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.875955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.876085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.876327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.876661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.876814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.876916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.877166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.877434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.877715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.877834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.877951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.878260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.878517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.878761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.878908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.879032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.879366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.879663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.879787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.879909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.880209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.880496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.880763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.880890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.881015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.881259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.881558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.866 [2024-11-27 21:17:51.881703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.866 qpair failed and we were unable to recover it. 00:27:55.866 [2024-11-27 21:17:51.881802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.881949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.881975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.882060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.882365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.882700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.882873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.883025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.883271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.883552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.883863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.883987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.884137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.884426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.884726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.884876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.884971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.885197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.885435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.885749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.885905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.886070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.886291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.886498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.886723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.886864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.886966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.887214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.887445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.887755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.887872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.887990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.888322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.888584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.888867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.888990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.889138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.889248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.889276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.867 [2024-11-27 21:17:51.889452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.889572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.867 [2024-11-27 21:17:51.889599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.867 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.889701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.889796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.889822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.889953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.890226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.890498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.890835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.890976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.891071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.891366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.891631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.891863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.891979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.892104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.892398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.892691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.892837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.892973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.893297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.893609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.893836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.893961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.894065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.894343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.894616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.894769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.895852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.896167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.896412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.896701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.896857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.896980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.897297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.897594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.897761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.897896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.898207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.868 [2024-11-27 21:17:51.898537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.868 [2024-11-27 21:17:51.898692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.868 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.898790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.898908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.898951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.899086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.899385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.899677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.899827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.900006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.900284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.900635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.900789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.900911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.901247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.901548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.901768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.901942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.902100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.902394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.902663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.902861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.902975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.903235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.903499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.903770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.903900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.904000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.904297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.904614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.904838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.904986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.905162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.905442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.869 [2024-11-27 21:17:51.905745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.869 [2024-11-27 21:17:51.905919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.869 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.906026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.906170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.906197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.906662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.906784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.906811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.906960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.907305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.907614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.907870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.907984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.908133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.908480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.908814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.908987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.909131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.909402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.909711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.909830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.909974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.910281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.910595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.910724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.911265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.911431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.911460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.911599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.911725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.911751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.911885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.912180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.912449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.912691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.912814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.912916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.913186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.913487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.913799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.913923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.914019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.914229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.914464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.870 [2024-11-27 21:17:51.914694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.870 [2024-11-27 21:17:51.914813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.870 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.914934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.915173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.915392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.915652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.915776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.915929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.916181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.916432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.916682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.916806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.916903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.917181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.917440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.917735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.917878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.918013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.918249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.918520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.918781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.918934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.919047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.919300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.919520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.919774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.919954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.920082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.920355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.920672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.920795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.920918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.921227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.921560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.921858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.921992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.922150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.922282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.922311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.871 qpair failed and we were unable to recover it. 00:27:55.871 [2024-11-27 21:17:51.922450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.871 [2024-11-27 21:17:51.922555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.922582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.922680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.922784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.922826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.922966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.923280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.923537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.923772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.923954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.924071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.924359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.924645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.924897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.924997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.925149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.925406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.925693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.925808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.925955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.926274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.926522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.926776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.926890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.926997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.927304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.927587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.927824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.927981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.928077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.928342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.928696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.928830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.928947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.929177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.929465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.929731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.929852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.929981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.930077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.872 [2024-11-27 21:17:51.930102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.872 qpair failed and we were unable to recover it. 00:27:55.872 [2024-11-27 21:17:51.930293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.930514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.930745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.930893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.931004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.931317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.931614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.931875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.931986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.932133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.932351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.932608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.932733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.932874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.933162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.933460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.933722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.933846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.934008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.934287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.934558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.934804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.934940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.935043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.935333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.935645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.935767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.935911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.936204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.936451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.936673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.936801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.936973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.937227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.937517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.873 [2024-11-27 21:17:51.937743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.873 [2024-11-27 21:17:51.937879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.873 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.938052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.938324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.938620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.938863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.938998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.939114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.939383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.939642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.939881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.939997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.940134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.940398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.940669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.940790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.940936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.941224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.941539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.941767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.941913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.942007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.942325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.942570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.942836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.942989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.943126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.943368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.943678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.943805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.943929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.944186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.944459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.874 [2024-11-27 21:17:51.944611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.874 qpair failed and we were unable to recover it. 00:27:55.874 [2024-11-27 21:17:51.944707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.944801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.944827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.944992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.945250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.945556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.945826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.945997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.946149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.946406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.946652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.946803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.946944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.947267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.947544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.947818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.947996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.948196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.948515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.948764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.948927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.949052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.949361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.949684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.949826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.949926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.950168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.950456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.950703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.950870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.951000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.951309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.951655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.951778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.951928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.952238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.952506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.952758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.875 [2024-11-27 21:17:51.952908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.875 qpair failed and we were unable to recover it. 00:27:55.875 [2024-11-27 21:17:51.953028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.953269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.953592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.953813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.953958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.954075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.954379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.954642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.954783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.954923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.955183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.955424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.955669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.955791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.955894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.956135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.956415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.956648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.956770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.956908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.957191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.957422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.957688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.957822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.957973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.958247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.958497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.958756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.958922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.959067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.959342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.959612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.959832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.959976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.960122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.960256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.960285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.960402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.960552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.876 [2024-11-27 21:17:51.960578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.876 qpair failed and we were unable to recover it. 00:27:55.876 [2024-11-27 21:17:51.960676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.960776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.960801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.960897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.961225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.961508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.961747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.961896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.962011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.962338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.962636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.962861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.962986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.963171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.963428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.963693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.963841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.963977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.964238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.964478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.964701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.964878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.964989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.965281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.965551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.965781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.965901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.965993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.966328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.966620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.966834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.966987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.967101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.967379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.967639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.967868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.967998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.968026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.877 [2024-11-27 21:17:51.968188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.968321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.877 [2024-11-27 21:17:51.968349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.877 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.968510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.968654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.968683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.968777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.968906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.968931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.969071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.969372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.969679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.969828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.969933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.970264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.970539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.970799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.970916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.971088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.971368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.971647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.971763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.971888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.972202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.972470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.972764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.972885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.973011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.973312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.973522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.973816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.973951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.974091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.974414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.974717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.974910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.975068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.975335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.975582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.878 qpair failed and we were unable to recover it. 00:27:55.878 [2024-11-27 21:17:51.975824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.878 [2024-11-27 21:17:51.975954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.976092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.976360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.976610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.976855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.976986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.977101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.977398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.977675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.977798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.977923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.978167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.978445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.978690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.978815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.978916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.979124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.979384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.979690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.979815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.979926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.980232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.980509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.980758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.980920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.981048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.981145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.981170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.981290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.982238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.982520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.982808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.982927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.983064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.983404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.983657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.983793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.879 qpair failed and we were unable to recover it. 00:27:55.879 [2024-11-27 21:17:51.983903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.879 [2024-11-27 21:17:51.984002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.984127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.984387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.984663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.984784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.984913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.985186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.985425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.985658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.985804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.985901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.986149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.986413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.986671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.986795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.986960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.987251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.987488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.987750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.987878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.987986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.988249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.988493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.988748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.988903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.989061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.989191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.989219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.989346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.989533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.989558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.990490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.990606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.990634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.990736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.991443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.991477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.991632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.992367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.992399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.992583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.993309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.993342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.993536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.994533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.994563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.994697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.994794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.994819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.994959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.995125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.995153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.880 qpair failed and we were unable to recover it. 00:27:55.880 [2024-11-27 21:17:51.995265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.880 [2024-11-27 21:17:51.995390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.995414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.995558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.995652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.995678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.995775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.995880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.995906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.996072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.996344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.996600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.996844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.996998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.997187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.997481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.997767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.997959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.998074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.998358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.998603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.998755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.998878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.999128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.999385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.999638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:51.999860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:51.999979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.000069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.000313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.000585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.000832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.000975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.001131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.001382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.001648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.001811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.001952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.002249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.002466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.002731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.881 [2024-11-27 21:17:52.002880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.881 qpair failed and we were unable to recover it. 00:27:55.881 [2024-11-27 21:17:52.002986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.003215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.003435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.003676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.003801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.003952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.004217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.004463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.004687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.004812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.004939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.005170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.005443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.005677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.005824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.005965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.006244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.006572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.006777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.006944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.007069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.007357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.007627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.007832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.007988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.008227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.008448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.008681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.008803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.008905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.009170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.009383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.009627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.009770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.009932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.010050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.010076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.010176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.010303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.882 [2024-11-27 21:17:52.010329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.882 qpair failed and we were unable to recover it. 00:27:55.882 [2024-11-27 21:17:52.010424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.010554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.010582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.010691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.010782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.010808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.010912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.011220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.011469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.011696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.011848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.011997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.012288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.012558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.012791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.012915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.013036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.013318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.013535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.013778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.013919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.014021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.014265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.014554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.014776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.014907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.015030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.015305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.015570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.015793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.015947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.016071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.016361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.016610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.016768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.883 qpair failed and we were unable to recover it. 00:27:55.883 [2024-11-27 21:17:52.016872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.883 [2024-11-27 21:17:52.017025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.017051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.017145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.017281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.017306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.017406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.017500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.017535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.018254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.018415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.018442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.018616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.018740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.018765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.018862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.018991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.019018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.019164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.019299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.019328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.020250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.020433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.020469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.021214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.021533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.021806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.021993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.022112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.022371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.022692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.022827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.022932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.023196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.023437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.023713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.023854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.023993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.024305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.024522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.024807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.024989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.025093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.025383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.025673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.025799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.025926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.026215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.026512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.026759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.884 [2024-11-27 21:17:52.026912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.884 qpair failed and we were unable to recover it. 00:27:55.884 [2024-11-27 21:17:52.027019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.027346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.027630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.027761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.027938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.028258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.028582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.028839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.028995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.029153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.029419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.029732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.029884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.029990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.030324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.030587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.030860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.030991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.031146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.031458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.031738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.031889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.032024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.032328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.032585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.032805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.032967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.033078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.033361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.033695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.033876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.034048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.034363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.034896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.034994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.035018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.885 qpair failed and we were unable to recover it. 00:27:55.885 [2024-11-27 21:17:52.035141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.035295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.885 [2024-11-27 21:17:52.035320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.035570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.035704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.035729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.035857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.035949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.035975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.036097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.036342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.036624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.036751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.036892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.037190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.037494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.037832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.037963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.038093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.038396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.038647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.038805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.038905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.039150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.039410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.039704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.039893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.040030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.040285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.040511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.040790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.040977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.041077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.041362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.041642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.041789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.041904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.042143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.042455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.042812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.042955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.043117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.043275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.043300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.886 qpair failed and we were unable to recover it. 00:27:55.886 [2024-11-27 21:17:52.043422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.886 [2024-11-27 21:17:52.043545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.043571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.043696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.043814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.043838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.043975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.044318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.044605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.044780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.044882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.045164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.045460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.045787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.045918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.046052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.046265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.046535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.046683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.046812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.047150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.047429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.047741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.047887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.047993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.048260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.048565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.048828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.048985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.049174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.049443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.049762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.049890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.049992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.050250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.050538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.050781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.050934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.051067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.051234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.051259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.051350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.051453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.887 [2024-11-27 21:17:52.051480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.887 qpair failed and we were unable to recover it. 00:27:55.887 [2024-11-27 21:17:52.051649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.051797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.051822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.051979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.052223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.052579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.052857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.052982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.053190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.053444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.053736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.053906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.054078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.054427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.054684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.054852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.055019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.055334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.055577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.055825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.055976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.056171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.056459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.056746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.056914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.057018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.057304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.057549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.057787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.057932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.058041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.058302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.058608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.058858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.058987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.888 [2024-11-27 21:17:52.059012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.888 qpair failed and we were unable to recover it. 00:27:55.888 [2024-11-27 21:17:52.059146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.059424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.059722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.059863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.060009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.060306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.060522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.060833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.060969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.061118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.061372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.061683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.061826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.061945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.062211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.062552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.062824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.062993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.063134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.063350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.063644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.063804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.063968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.064242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.064508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.064827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.064963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.065094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.065355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.065700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.065902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.066037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.066350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.066626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.066777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.066925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.067027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.067057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.889 qpair failed and we were unable to recover it. 00:27:55.889 [2024-11-27 21:17:52.067174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.067313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.889 [2024-11-27 21:17:52.067341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.067489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.067620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.067647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.067747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.067872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.067898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.068017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.068329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.068579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.068871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.068998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.069224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.069536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.069773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.069899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.070019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.070258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.070566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.070737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.070892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.071044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.071070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:55.890 [2024-11-27 21:17:52.071160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.071262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.890 [2024-11-27 21:17:52.071288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:55.890 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.071415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.071511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.071542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.071665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.071755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.071782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.071918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.072167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.072444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.072722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.072840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.072939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.073157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.073440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.169 [2024-11-27 21:17:52.073583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.169 qpair failed and we were unable to recover it. 00:27:56.169 [2024-11-27 21:17:52.073680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.073773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.073798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.073892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.073983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.074124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.074395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.074673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.074838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.074944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.075189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.075451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.075738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.075953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.076049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.076339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.076645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.076793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.076976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.077275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.077599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.077810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.077933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.078025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.078364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.078716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.078886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.079025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.079355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.079647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.079804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.079963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.080236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.080503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.080849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.080977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.081122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.081408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.170 qpair failed and we were unable to recover it. 00:27:56.170 [2024-11-27 21:17:52.081705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.170 [2024-11-27 21:17:52.081797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.081822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.081965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.082234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.082577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.082848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.082995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.083164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.083437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.083692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.083831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.083939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.084232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.084508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.084764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.084938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.085051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.085346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.085697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.085840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.085935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.086158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.086434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.086750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.086925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.087072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.087248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.087273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.087386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.087561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.087587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.171 qpair failed and we were unable to recover it. 00:27:56.171 [2024-11-27 21:17:52.087676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.171 [2024-11-27 21:17:52.087792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.087820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.087961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.088205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.088475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.088744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.088895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.088995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.089263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.089639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.089788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.089914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.090213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.090475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.090775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.090917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.091073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.091345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.091603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.091769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.091892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.092197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.092476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.092772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.092946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.093096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.093321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.093704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.093851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.094021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.094251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.094571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.094759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.094917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.095194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.172 [2024-11-27 21:17:52.095467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.172 [2024-11-27 21:17:52.095665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.172 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.095775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.095945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.095973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.096094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.096369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.096625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.096744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.096848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.097150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.097418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.097742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.097920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.098076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.098321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.098644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.098795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.098910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.099152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.099446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.099719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.099916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.100015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.100251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.100465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.100818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.100991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.101084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.101408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.101735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.101883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.101994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.102311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.102625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.102834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.102992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.103017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.103132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.103237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.103265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.103405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.103548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.173 [2024-11-27 21:17:52.103574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.173 qpair failed and we were unable to recover it. 00:27:56.173 [2024-11-27 21:17:52.103696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.103846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.103870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.103991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.104268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.104568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.104851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.104991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.105138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.105432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.105716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.105920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.106069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.106399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.106696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.106868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.106990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.107262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.107562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.107737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.107879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.108171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.108450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.108766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.108924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.109045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.109310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.109656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.109832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.109976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.110127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.110151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.110253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.110403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.174 [2024-11-27 21:17:52.110427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.174 qpair failed and we were unable to recover it. 00:27:56.174 [2024-11-27 21:17:52.110616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.110740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.110766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.110906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.111183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.111447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.111706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.111845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.111996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.112273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.112631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.112820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.112959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.113287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.113604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.113800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.113930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.114244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.114597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.114759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.114858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.115207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.115551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.115815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.115978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.116121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.116391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.116654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.116828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.116975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.117276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.117496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.117778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.117919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.118060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.118305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.118600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.175 qpair failed and we were unable to recover it. 00:27:56.175 [2024-11-27 21:17:52.118847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.175 [2024-11-27 21:17:52.118987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.119160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.119416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.119657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.119834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.119937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.120178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.120416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.120756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.120932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.121022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.121304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.121610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.121855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.121980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.122150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.122431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.122679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.122830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.122963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.123263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.123591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.123867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.123997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.124119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.124404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.124752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.124899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.125021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.125298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.125580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.125828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.125994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.126133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.126420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.126779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.126979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.176 qpair failed and we were unable to recover it. 00:27:56.176 [2024-11-27 21:17:52.127101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.176 [2024-11-27 21:17:52.127230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.127255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.127373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.127522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.127553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.127695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.127828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.127855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.127965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.128254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.128531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.128773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.128903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.128997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.129285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.129595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.129771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.129920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.130214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.130485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.130795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.130956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.131107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.131413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.131723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.131843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.131963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.132208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.132552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.132813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.132992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.133187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.133462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.133692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.133852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.133988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.134299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.134536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.134816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.134971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.177 [2024-11-27 21:17:52.135139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.177 [2024-11-27 21:17:52.135293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.177 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.135418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.135542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.135567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.135728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.135860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.135902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.135992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.136265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.136570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.136769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.136916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.137176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.137464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.137773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.137919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.138060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.138345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.138657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.138860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.139030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.139289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.139629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.139882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.139994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.140089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.140380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.140738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.140914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.141068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.141392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.141686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.141857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.142001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.142259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.142503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.142747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.142874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.143035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.143143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.143172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.143277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.143451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.143477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.178 qpair failed and we were unable to recover it. 00:27:56.178 [2024-11-27 21:17:52.143580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.178 [2024-11-27 21:17:52.143704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.143729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.143897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.144161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.144470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.144792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.144975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.145116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.145379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.145665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.145842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.145991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.146262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.146576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.146755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.146901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.147181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.147464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.147754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.147900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.148024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.148286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.148597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.148761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.148891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.149193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.149454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.149774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.149900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.150026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.150373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.150619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.150768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.150883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.151012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.179 [2024-11-27 21:17:52.151040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.179 qpair failed and we were unable to recover it. 00:27:56.179 [2024-11-27 21:17:52.151178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.151485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.151789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.151965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.152085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.152391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.152705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.152870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.153010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.153302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.153588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.153754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.153898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.154214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.154451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.154728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.154888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.155022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.155305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.155644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.155810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.155954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.156239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.156507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.156663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.156838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.157202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.157510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.157858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.157991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.158136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.158409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.158698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.158870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.158991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.159248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.180 qpair failed and we were unable to recover it. 00:27:56.180 [2024-11-27 21:17:52.159546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.180 [2024-11-27 21:17:52.159713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.159866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.159989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.160115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.160406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.160688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.160846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.160954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.161225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.161493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.161820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.161995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.162129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.162388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.162725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.162886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.162993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.163286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.163620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.163869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.163988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.164136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.164462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.164720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.164880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.164998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.165294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.165602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.165845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.165975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.166073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.166318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.166662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.166820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.166986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.167248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.167484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.181 [2024-11-27 21:17:52.167608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.181 qpair failed and we were unable to recover it. 00:27:56.181 [2024-11-27 21:17:52.167769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.167931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.167958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.168105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.168361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.168728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.168905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.169069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.169350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.169684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.169847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.169944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.170195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.170503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.170830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.170972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.171118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.171418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.171708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.171883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.172079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.172401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.172652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.172802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.172988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.173226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.173521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.173688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.173855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.174212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.174538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.174821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.174952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.175109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.175351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.175653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.175831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.175970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.176115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.176139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.182 [2024-11-27 21:17:52.176285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.176376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.182 [2024-11-27 21:17:52.176418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.182 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.176552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.176645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.176671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.176773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.176925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.176950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.177059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.177385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.177692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.177848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.178016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.178331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.178628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.178784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.178906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.179174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.179438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.179720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.179892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.180058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.180326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.180582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.180820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.180976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.181183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.181482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.181756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.181915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.182045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.182309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.182586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.182886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.182976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.183001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.183127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.183222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.183247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.183367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.183519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.183 [2024-11-27 21:17:52.183550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.183 qpair failed and we were unable to recover it. 00:27:56.183 [2024-11-27 21:17:52.183674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.183767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.183813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.183921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.184264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.184584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.184798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.184950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.185094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.185389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.185599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.185822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.185935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.186029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.186313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.186619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.186773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.186891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.187153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.187483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.187763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.187901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.187998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.188269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.188637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.188913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.188999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.189153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.189471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.189719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.189863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.190011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.190245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.190545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.190757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.190895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.191050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.191177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.191202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.184 qpair failed and we were unable to recover it. 00:27:56.184 [2024-11-27 21:17:52.191340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.191464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.184 [2024-11-27 21:17:52.191491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.191645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.191739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.191764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.191948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.192244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.192537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.192808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.192935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.193073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.193359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.193615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.193770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.193913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.194209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.194521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.194810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.194963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.195101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.195350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.195629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.195768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.195883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.196203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.196497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.196772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.196948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.197067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.197407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.197680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.197844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.197960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.198254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.198518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.198787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.198934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.199082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.199369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.185 qpair failed and we were unable to recover it. 00:27:56.185 [2024-11-27 21:17:52.199674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.185 [2024-11-27 21:17:52.199821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.199939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.200207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.200452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.200746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.200898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.201065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.201406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.201700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.201858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.201953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.202288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.202570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.202835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.202964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.203104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.203393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.203699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.203824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.203922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.204250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.204512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.204779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.204965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.205115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.205419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.205739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.205894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.205982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.206219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.206561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.206773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.206912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.207035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.207303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.207553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.207746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.186 qpair failed and we were unable to recover it. 00:27:56.186 [2024-11-27 21:17:52.207890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.208066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.186 [2024-11-27 21:17:52.208091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.208214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.208497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.208735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.208883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.208982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.209225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.209487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.209838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.209958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.210110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.210419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.210682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.210797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.210893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.211187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.211448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.211752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.211937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.212061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.212383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.212780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.212964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.213114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.213353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.213675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.213807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.213915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.214216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.214515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.214798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.214959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.215081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.215295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.215555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.215790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.215940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.187 qpair failed and we were unable to recover it. 00:27:56.187 [2024-11-27 21:17:52.216052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.187 [2024-11-27 21:17:52.216151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.216175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.216325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.216459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.216486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.216632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.216830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.216854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.216945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.217201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.217493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.217779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.217912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.218042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.218363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.218650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.218821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.218965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.219194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.219546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.219834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.219980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.220137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.220420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.220671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.220815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.220937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.221242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.221544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.221751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.221867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.222000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.222323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.222622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.222845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.222970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.223088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.223212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.188 [2024-11-27 21:17:52.223237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.188 qpair failed and we were unable to recover it. 00:27:56.188 [2024-11-27 21:17:52.223323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.223447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.223473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.223582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.223728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.223752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.223843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.223971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.224159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.224388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.224691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.224842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.224945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.225270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.225602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.225751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.225901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.226240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.226540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.226719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.226870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.227213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.227453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.227744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.227900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.228016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.228296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.228594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.228903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.228999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.229156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.229380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.229643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.229762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.229921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.230201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.230479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.230786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.230975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.231109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.231282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.231307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.231489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.231634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.189 [2024-11-27 21:17:52.231662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.189 qpair failed and we were unable to recover it. 00:27:56.189 [2024-11-27 21:17:52.231795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.231921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.231949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.232103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.232364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.232687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.232849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.232982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.233337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.233569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.233858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.233992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.234153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.234420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.234716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.234878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.234984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.235247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.235500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.235810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.235996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.236134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.236428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.236681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.236829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.236970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.237303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.237617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.237859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.237970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.238112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.238424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.238720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.238889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.239016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.239293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.239579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.239847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.190 [2024-11-27 21:17:52.239987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.190 qpair failed and we were unable to recover it. 00:27:56.190 [2024-11-27 21:17:52.240135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.240347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.240675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.240836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.241025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.241375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.241670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.241782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.241927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.242234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.242519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.242775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.242955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.243119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.243423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.243763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.243877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.243994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.244286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.244587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.244824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.244945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.245038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.245300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.245638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.245880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.245979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.246121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.246363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.246707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.246867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.247003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.247285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.247589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.247885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.247974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.248015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.191 [2024-11-27 21:17:52.248127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.248221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.191 [2024-11-27 21:17:52.248246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.191 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.248329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.248547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.248806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.248967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.249079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.249356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.249622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.249771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.249921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.250254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.250577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.250846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.250980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.251104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.251397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.251620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.251833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.251981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.252105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.252346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.252626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.252870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.252976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.253080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.253376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.253626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.253797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.253947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.254264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.254564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.192 qpair failed and we were unable to recover it. 00:27:56.192 [2024-11-27 21:17:52.254873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.254980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.192 [2024-11-27 21:17:52.255005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.255096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.255317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.255655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.255805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.255946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.256234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.256502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.256801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.256949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.257052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.257359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.257714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.257900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.258024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.258320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.258607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.258757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.258900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.259157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.259429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.259771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.259921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.260037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.260372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.260722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.260869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.260975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.261284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.261568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.261830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.261984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.262103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.262374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.262679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.262833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.262934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.263071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.263099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.193 qpair failed and we were unable to recover it. 00:27:56.193 [2024-11-27 21:17:52.263211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.193 [2024-11-27 21:17:52.263316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.263343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.263475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.263613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.263642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.263764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.263872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.263897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.264034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.264312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.264623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.264793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.264891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.265209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.265485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.265760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.265933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.266058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.266270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.266505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.266749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.266868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.266986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.267295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.267598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.267863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.267982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.268083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.268403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.268650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.268805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.268912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.269232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.269516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.269821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.269945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.270092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.270397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.270699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.270874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.270976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.271111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.271140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.194 qpair failed and we were unable to recover it. 00:27:56.194 [2024-11-27 21:17:52.271277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.194 [2024-11-27 21:17:52.271412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.271439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.271567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.271664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.271688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.271786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.271933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.271957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.272093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.272358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.272639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.272897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.272995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.273212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.273508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.273830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.273978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.274111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.274415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.274744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.274905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.275024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.275277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.275590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.275847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.275977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.276129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.276418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.276764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.276931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.277127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.277427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.277728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.277847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.277990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.278297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.278555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.278770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.278910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.279044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.279138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.279181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.279326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.279430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.279458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.195 qpair failed and we were unable to recover it. 00:27:56.195 [2024-11-27 21:17:52.279580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.195 [2024-11-27 21:17:52.279668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.279693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.279823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.279952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.279976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.280142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.280399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.280716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.280840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.280937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.281193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.281481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.281801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.281951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.282106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.282355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.282643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.282885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.282975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.283144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.283434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.283704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.283848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.283998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.284289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.284532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.284829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.284980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.285106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.285358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.285683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.285826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.285996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.286318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.286544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.286803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.286962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.287069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.287175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.287202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.287315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.287463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.196 [2024-11-27 21:17:52.287489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.196 qpair failed and we were unable to recover it. 00:27:56.196 [2024-11-27 21:17:52.287613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.287791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.287817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.287965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.288252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.288537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.288838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.288992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.289132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.289389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.289743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.289910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.290047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.290313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.290528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.290830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.290946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.291087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.291360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.291685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.291837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.291948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.292218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.292517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.292786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.292945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.293044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.293318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.293605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.293843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.293978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.294129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.294459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.197 qpair failed and we were unable to recover it. 00:27:56.197 [2024-11-27 21:17:52.294685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.197 [2024-11-27 21:17:52.294834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.294975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.295224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.295490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.295793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.295970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.296081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.296353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.296657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.296833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.296952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.297268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.297574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.297818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.297959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.298096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.298379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.298632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.298756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.298904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.299234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.299493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.299763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.299966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.300130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.300390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.300662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.300810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.301194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.301440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.301701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.301853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.301979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.302197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.302479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.198 qpair failed and we were unable to recover it. 00:27:56.198 [2024-11-27 21:17:52.302691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.198 [2024-11-27 21:17:52.302807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.302940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.303249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.303468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.303783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.303942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.304067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.304313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.304578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.304747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.304894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.305161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.305413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.305687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.305808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.305926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.306202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.306482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.306771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.306928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.307088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.307352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.307614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.307863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.307999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.308146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.308449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.308726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.308967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.309095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.309362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.309686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.309879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.309997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.310509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.199 qpair failed and we were unable to recover it. 00:27:56.199 [2024-11-27 21:17:52.310862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.199 [2024-11-27 21:17:52.310958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.310982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.311101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.311322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.311574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.311837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.311990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.312090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.312365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.312599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.312745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.312901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.313163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.313414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.313688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.313810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.313942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.314164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.314403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.314664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.314813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.314910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.315134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.315389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.315667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.315793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.315918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.316227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.316447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.316677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.316799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.316899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.317153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.317374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.317673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.317815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.317916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.318039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.200 [2024-11-27 21:17:52.318063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.200 qpair failed and we were unable to recover it. 00:27:56.200 [2024-11-27 21:17:52.318160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.318414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.318666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.318814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.318940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.319267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.319513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.319792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.319938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.320036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.320250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.320553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.320799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.320934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.321072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.321364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.321627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.321878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.321997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.322092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.322360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.322590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.322804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.322927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.323080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.323366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.323605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.323847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.323991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.324088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.324310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.324593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.324849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.324999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.325164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.325299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.325323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.201 qpair failed and we were unable to recover it. 00:27:56.201 [2024-11-27 21:17:52.325426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.325530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.201 [2024-11-27 21:17:52.325556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.325682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.325768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.325792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.325894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.325977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.326104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.326349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.326593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.326813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.326934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.327034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.327302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.327534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.327758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.327878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.328006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.328225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.328475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.328735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.328861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.328957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.329257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.329548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.329795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.329969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.330101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.330317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.330619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.330871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.330995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.331147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.331408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.331705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.331858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.202 qpair failed and we were unable to recover it. 00:27:56.202 [2024-11-27 21:17:52.331981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.202 [2024-11-27 21:17:52.332099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.332282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.332538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.332819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.332940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.333062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.333334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.333558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.333786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.333964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.334108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.334392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.334631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.334864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.334980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.335154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.335409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.335656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.335785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.335915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.336191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.336469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.336751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.336878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.337027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.337307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.337579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.337825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.337973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.338097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.338364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.338644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.338793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.338915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.339181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.339397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.203 qpair failed and we were unable to recover it. 00:27:56.203 [2024-11-27 21:17:52.339677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.203 [2024-11-27 21:17:52.339800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.339825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.339924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.340179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.340447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.340689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.340817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.340917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.341174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.341460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.341733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.341883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.342009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.342256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.342616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.342799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.342904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.343201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.343505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.343776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.343946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.344095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.344387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.344680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.344882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.344980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.345228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.345565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.345843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.345974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.346141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.346410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.346671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.346822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.346920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.347241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.347513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.204 qpair failed and we were unable to recover it. 00:27:56.204 [2024-11-27 21:17:52.347769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.204 [2024-11-27 21:17:52.347909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.347934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.348082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.348379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.348690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.348840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.349286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.349621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.349870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.349989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.350117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.350384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.350660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.350780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.350933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.351226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.351497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.351813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.351940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.352034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.352256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.352537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.352866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.352990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.353097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.353420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.353706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.353878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.354013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.354333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.354675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.354855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.354994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.355271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.355558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.355737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.355887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.356069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.205 [2024-11-27 21:17:52.356093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.205 qpair failed and we were unable to recover it. 00:27:56.205 [2024-11-27 21:17:52.356246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.356538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.356759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.356875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.357015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.357291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.357614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.357753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.357893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.358206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.358509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.358764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.358906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.359070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.359361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.359650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.359768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.359901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.360227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.360512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.360776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.360952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.361079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.361346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.361605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.361750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.361894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.362143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.362402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.362658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.362809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.362906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.363100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.363125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.206 [2024-11-27 21:17:52.363252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.363347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.206 [2024-11-27 21:17:52.363389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.206 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.363537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.363635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.363659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.363764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.363936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.363964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.364124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.364421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.364706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.364829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.365006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.365333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.365578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.365825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.365941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.366085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.366307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.366611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.366859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.366981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.367191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.367454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.367704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.367819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.367947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.368278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.368498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.368718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.368880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.368999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.369294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.369635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.207 [2024-11-27 21:17:52.369783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.207 qpair failed and we were unable to recover it. 00:27:56.207 [2024-11-27 21:17:52.369884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.369982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.370160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.370467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.370727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.370946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.371044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.371330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.371576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.371807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.371966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.372074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.372379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.372660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.372812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.372959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.373207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.373517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.373802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.373979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.374119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.374415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.374673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.374795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.374920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.375197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.375474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.375761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.375909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.376014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.376137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.376161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.208 qpair failed and we were unable to recover it. 00:27:56.208 [2024-11-27 21:17:52.376284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.208 [2024-11-27 21:17:52.376379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.376404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.376533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.376631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.376655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.376755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.376892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.376916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.377013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.377334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.377633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.377898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.377989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.378109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.378360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.378653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.378906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.378999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.379150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.379390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.379704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.379837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.379928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.380239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.380540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.380821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.380950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.381122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.381426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.381729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.381857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.381947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.382269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.209 [2024-11-27 21:17:52.382507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.209 [2024-11-27 21:17:52.382646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.209 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.382780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.382930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.382955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.383079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.383333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.383729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.383850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.383996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.384299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.384620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.384750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.384879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.385222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.385536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.385826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.385970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.386083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.386379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.386655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.386780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.386924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.387269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.387495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.387784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.387960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.388068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.388317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.388562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.388787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.210 [2024-11-27 21:17:52.388960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.210 qpair failed and we were unable to recover it. 00:27:56.210 [2024-11-27 21:17:52.389098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.389390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.389667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.389791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.389941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.390182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.390427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.390669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.390793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.390897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.391197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.391446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.391704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.391816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.391914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.392186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.392434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.392671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.392837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.392946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.393079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.393107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.393256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.393377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.490 [2024-11-27 21:17:52.393401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.490 qpair failed and we were unable to recover it. 00:27:56.490 [2024-11-27 21:17:52.393505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.393604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.393636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.393760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.393858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.393882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.394022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.394276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.394543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.394792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.394988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.395115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.395398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.395662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.395780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.395933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.396184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.396397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.396650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.396770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.396870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.397205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.397507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.397842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.397972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.398119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.398418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.398713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.398833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.398968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.399109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.399137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.491 [2024-11-27 21:17:52.399280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.399394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.491 [2024-11-27 21:17:52.399421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.491 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.399556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.399702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.399727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.399853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.399948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.399973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.400120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.400382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.400664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.400821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.401007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.401310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.401667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.401820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.401915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.402207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.402475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.402740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.402903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.403013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.403252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.403512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.403781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.403980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.404105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.404365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.404679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.404827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.404967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.405205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.405551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.405812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.405952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.406052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.406189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.406216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.406352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.406486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.492 [2024-11-27 21:17:52.406513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.492 qpair failed and we were unable to recover it. 00:27:56.492 [2024-11-27 21:17:52.406640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.406763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.406788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.406967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.407236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.407475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.407746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.407871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.407993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.408249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.408519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.408768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.408882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.409337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.409581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.409844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.409965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.410093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.410432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.410745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.410879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.411025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.411324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.411643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.411766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.411880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.412017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.412043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.493 qpair failed and we were unable to recover it. 00:27:56.493 [2024-11-27 21:17:52.412158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.493 [2024-11-27 21:17:52.412279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.412303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.412481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.412634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.412659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.412781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.412946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.412974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.413111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.413395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.413688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.413899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.413991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.414112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.414382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.414637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.414852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.414977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.415148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.415478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.415731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.415904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.416076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.416430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.416758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.416878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.417059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.417351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.417604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.417860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.417982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.418005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.418162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.418326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.494 [2024-11-27 21:17:52.418351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.494 qpair failed and we were unable to recover it. 00:27:56.494 [2024-11-27 21:17:52.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.418603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.418629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.418783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.418932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.418961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.419084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.419445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.419700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.419858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.419981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.420234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.420564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.420888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.420995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.421164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.421448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.421761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.421913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.422036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.422273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.422588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.422713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.422868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.423168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.423461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.423727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.423856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.423998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.424267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.424499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.424787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.495 [2024-11-27 21:17:52.424934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.495 qpair failed and we were unable to recover it. 00:27:56.495 [2024-11-27 21:17:52.425084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.425411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.425778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.425947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.426066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.426339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.426683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.426849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.426994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.427343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.427662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.427816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.427949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.428254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.428542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.428803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.428926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.429020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.429281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.429574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.429697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.429860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.430160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.430478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.430784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.430905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.431113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.431259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.431284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.496 qpair failed and we were unable to recover it. 00:27:56.496 [2024-11-27 21:17:52.431433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.431593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.496 [2024-11-27 21:17:52.431621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.431771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.431893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.431918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.432043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.432255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.432539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.432800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.432915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.433018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.433248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.433486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.433776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.433917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.434029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.434278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.434570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.434723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.434889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.435164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.435468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.435784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.435954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.436076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.436388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.436704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.436879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.436975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.437240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.437554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.437807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.437984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.438127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.438261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.438289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.497 qpair failed and we were unable to recover it. 00:27:56.497 [2024-11-27 21:17:52.438421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.497 [2024-11-27 21:17:52.438533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.438562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.438701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.438833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.438858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.438950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.439258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.439516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.439760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.439894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.440027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.440312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.440663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.440843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.440980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.441309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.441649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.441769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.441928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.442202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.442494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.442817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.442979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.443146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.443463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.443724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.443842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.443993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.444269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.444636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.444785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.444920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.445071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.445096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.445218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.445323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.498 [2024-11-27 21:17:52.445352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.498 qpair failed and we were unable to recover it. 00:27:56.498 [2024-11-27 21:17:52.445458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.445574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.445600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.445688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.445785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.445810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.445901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.446145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.446496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.446806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.446969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.447092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.447393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.447669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.447810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.447958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.448203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.448505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.448836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.448997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.449143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.449411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.449715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.449921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.450042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.450354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.450603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.450750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.450903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.451187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.451466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.499 qpair failed and we were unable to recover it. 00:27:56.499 [2024-11-27 21:17:52.451745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.499 [2024-11-27 21:17:52.451908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.451933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.452061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.452319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.452574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.452753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.452900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.453177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.453452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.453667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.453819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.453918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.454192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.454453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.454768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.454931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.455091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.455338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.455599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.455848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.455998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.456155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.456395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.456626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.456804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.456904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.457187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.457412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.457696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.457849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.457967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.458281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.500 [2024-11-27 21:17:52.458606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.500 [2024-11-27 21:17:52.458762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.500 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.458865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.459142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.459415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.459722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.459874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.460002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.460256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.460536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.460791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.460940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.461042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.461320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.461537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.461780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.461941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.462048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.462304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.462573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.462851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.462979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.463100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.463398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.501 qpair failed and we were unable to recover it. 00:27:56.501 [2024-11-27 21:17:52.463710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.501 [2024-11-27 21:17:52.463844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.463870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.463974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.464275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.464555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.464739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.464878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.465147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.465408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.465725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.465876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.465981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.466192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.466534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.466770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.466930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.467050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.467319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.467632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.467883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.467981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.468133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.468411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.468655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.468844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.468996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.469290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.469565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.469803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.469980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.470113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.470237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.470263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.470362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.470486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.470512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.502 qpair failed and we were unable to recover it. 00:27:56.502 [2024-11-27 21:17:52.470673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.502 [2024-11-27 21:17:52.470789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.470814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.470940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.471225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.471490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.471829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.471985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.472127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.472396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.472704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.472866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.472967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.473244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.473477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.473702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.473889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.474017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.474279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.474591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.474885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.474984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.475139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.475415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.475719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.475869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.475972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.476098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.476125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.476253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.476349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.503 [2024-11-27 21:17:52.476374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.503 qpair failed and we were unable to recover it. 00:27:56.503 [2024-11-27 21:17:52.476532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.476630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.476656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.476785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.476945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.476972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.477126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.477424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.477715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.477881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.478013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.478288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.478595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.478850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.478981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.479116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.479388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.479675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.479807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.479932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.480186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.480423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.480676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.480808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.480906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.481212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.481464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.481709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.481857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.481979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.482102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.482129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.504 qpair failed and we were unable to recover it. 00:27:56.504 [2024-11-27 21:17:52.482279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.482384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.504 [2024-11-27 21:17:52.482411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.482508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.482666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.482692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.482796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.482934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.482959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.483087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.483344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.483600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.483876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.483999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.484127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.484405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.484724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.484852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.484978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.485272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.485569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.485844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.485969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.486089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.486375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.486652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.486775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.486898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.487166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.487433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.487690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.487816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.487918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.488164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.488423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.488704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.488835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.488965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.489240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.505 qpair failed and we were unable to recover it. 00:27:56.505 [2024-11-27 21:17:52.489513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.505 [2024-11-27 21:17:52.489646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.489746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.489850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.489878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.490007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.490238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.490559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.490742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.490895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.491210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.491517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.491801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.491932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.492065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.492308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.492561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.492830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.492982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.493105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.493370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.493618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.493770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.493926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.494223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.494513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.494753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.494909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.495011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.495163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.495190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.495321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.495417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.506 [2024-11-27 21:17:52.495444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.506 qpair failed and we were unable to recover it. 00:27:56.506 [2024-11-27 21:17:52.495562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.495691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.495718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.495811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.495975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.496160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.496500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.496787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.496946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.497072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.497371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.497706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.497829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.497955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.498212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.498469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.498746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.498926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.499053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.499313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.499583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.499828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.499982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.500135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.500370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.500656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.500776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.500879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.501008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.501034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.501128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.501254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.501281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.507 qpair failed and we were unable to recover it. 00:27:56.507 [2024-11-27 21:17:52.501408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.507 [2024-11-27 21:17:52.501558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.501585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.501723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.501852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.501879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.502008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.502309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.502540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.502814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.502941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.503063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.503352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.503724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.503878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.504034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.504324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.504558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.504839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.504990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.505086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.505347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.505668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.505846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.505976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.506258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.506542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.506721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.506853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.507004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.507031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.508 [2024-11-27 21:17:52.507189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.507308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.508 [2024-11-27 21:17:52.507335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.508 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.507471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.507602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.507630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.507727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.507859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.507885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.508043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.508350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.508687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.508812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.508946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.509241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.509518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.509704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.509848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.510176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.510473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.510745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.510901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.511032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.511343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.511668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.511830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.511954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.512229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.512504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.512736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.512912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.513029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.513279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.509 [2024-11-27 21:17:52.513539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.509 [2024-11-27 21:17:52.513686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.509 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.513787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.513949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.513976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.514102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.514395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.514679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.514829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.514985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.515229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.515456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.515722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.515864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.516016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.516256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.516541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.516803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.516924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.517018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.517299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.517549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.517804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.517958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.518059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.518311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.518562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.518818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.518975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.519097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.519325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.519567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.519806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.519960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.520085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.520379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.520736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.510 [2024-11-27 21:17:52.520916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.510 qpair failed and we were unable to recover it. 00:27:56.510 [2024-11-27 21:17:52.521012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.521282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.521549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.521924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.522042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.522284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.522572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.522841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.522970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.523064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.523339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.523584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.523828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.523993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.524088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.524374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.524630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.524753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.524880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.525176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.525412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.525686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.525836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.525963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.526207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.511 [2024-11-27 21:17:52.526463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.511 [2024-11-27 21:17:52.526645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.511 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.526773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.526927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.526953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.527076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.527322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.527537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.527818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.527977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.528106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.528365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.528630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.528790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.528913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.529194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.529510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.529763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.529938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.530087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.530341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.530604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.530886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.530976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.531093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.531350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.531628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.531779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.531937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.532196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.512 [2024-11-27 21:17:52.532539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.512 [2024-11-27 21:17:52.532695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.512 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.532791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.532890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.532916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.533043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.533349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.533567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.533836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.533999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.534163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.534501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.534791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.534945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.535038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.535260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.535556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.535824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.535976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.536138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.536401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.536648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.536796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.536922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.537231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.537483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.537817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.537936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.538053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.538326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.538540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.513 qpair failed and we were unable to recover it. 00:27:56.513 [2024-11-27 21:17:52.538827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.513 [2024-11-27 21:17:52.538917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.538944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.539043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.539339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.539654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.539810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.539905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.540179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.540442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.540718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.540875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.540966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.541277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.541619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.541801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.541954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.542232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.542547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.542818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.542963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.543088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.543352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.543680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.543836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.543985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.544257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.544541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.544850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.544977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.545125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.545251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.545278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.514 qpair failed and we were unable to recover it. 00:27:56.514 [2024-11-27 21:17:52.545404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.545520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.514 [2024-11-27 21:17:52.545554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.545677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.545818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.545845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.545947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.546243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.546560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.546795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.546918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.547070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.547353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.547687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.547817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.547912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.548190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.548461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.548744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.548921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.549050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.549333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.549586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.549871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.549999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.550114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.550425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.550701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.550836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.550961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.551217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.551499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.551780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.551959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.552099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.552258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.552285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.552441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.552565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.552593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.515 qpair failed and we were unable to recover it. 00:27:56.515 [2024-11-27 21:17:52.552688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.515 [2024-11-27 21:17:52.552791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.552817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.552911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.553187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.553427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.553677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.553800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.553949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.554283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.554538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.554716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.554854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.555153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.555404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.555707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.555895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.556022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.556246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.556497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.556782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.556965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.557066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.557374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.557723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.557904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.558053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.558224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.558254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.516 [2024-11-27 21:17:52.558363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.558462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.516 [2024-11-27 21:17:52.558489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.516 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.558592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.558693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.558721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.558885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.559163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.559429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.559703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.559828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.559986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.560299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.560629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.560823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.560986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.561283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.561540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.561869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.561996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.562164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.562390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.562662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.562818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.562920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.563230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.563505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.563791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.563941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.564096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.564315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.564561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.564817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.564976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.565114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.565346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.565639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.565817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.565951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.566078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.566105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.517 qpair failed and we were unable to recover it. 00:27:56.517 [2024-11-27 21:17:52.566271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.517 [2024-11-27 21:17:52.566391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.566418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.566547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.566689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.566716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.566815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.566937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.566963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.567086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.567322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.567599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.567829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.567976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.568076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.568365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.568690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.568823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.568943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.569196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.569503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.569783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.569978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.570114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.570383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.518 [2024-11-27 21:17:52.570658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.518 [2024-11-27 21:17:52.570819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.518 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.570963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.571235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.571512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.571727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.571883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.572176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.572446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.572698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.572844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.572968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.573236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.573516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.573706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.573859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.574154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.574398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.574706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.574908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.575009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.575340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.575647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.575837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.575965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.576254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.576541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.576766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.576917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.577156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.577435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.577692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.577865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.577994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.578095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.578122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.578254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.578403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.578429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.519 qpair failed and we were unable to recover it. 00:27:56.519 [2024-11-27 21:17:52.578555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.519 [2024-11-27 21:17:52.578704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.578730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.578879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.579151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.579457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.579794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.579976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.580160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.580417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.580643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.580758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.580889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.581202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.581446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.581739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.581930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.582073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.582319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.582600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.582825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.582972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.583249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.583539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.583706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.583835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.584161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.584463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.584754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.584901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.520 [2024-11-27 21:17:52.585025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.585181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.520 [2024-11-27 21:17:52.585207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.520 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.585328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.585475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.585502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.585668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.585792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.585818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.585956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.586210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.586434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.586711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.586866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.586997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.587273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.587523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.587802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.587952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.588080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.588337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.588637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.588843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.588973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.589311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.589579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.589810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.589918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.590179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.590485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.590677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.590829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.591163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.591439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.591713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.591864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.521 qpair failed and we were unable to recover it. 00:27:56.521 [2024-11-27 21:17:52.592015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.592133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.521 [2024-11-27 21:17:52.592159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.592318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.592473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.592500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.592661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.592803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.592848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.592992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.593265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.593540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.593725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.593899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.594217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.594493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.594814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.594936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.595039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.595317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.595600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.595876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.595979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.596107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.596349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.596628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.596900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.596996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.597148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.597455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.597714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.597923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.598060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.598314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.598596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.598750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.598896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.599042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.599069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.599198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.599318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.599346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.522 qpair failed and we were unable to recover it. 00:27:56.522 [2024-11-27 21:17:52.599441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.522 [2024-11-27 21:17:52.599539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.599567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.599688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.599847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.599893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.600011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.600284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.600614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.600788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.600914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.601152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.601422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.601715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.601866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.601983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.602255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.602537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.602872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.602995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.603155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.603369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.603667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.603812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.603921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.604142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.523 [2024-11-27 21:17:52.604480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.523 [2024-11-27 21:17:52.604644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.523 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.604773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.604902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.604929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.605077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.605345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.605624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.605797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.605950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.606269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.606515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.606838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.606989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.607139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.607451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.607744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.607949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.608127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.608396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.608683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.608921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.609051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.609361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.609639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.609825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.609953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.610240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.610517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.610829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.610985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.611033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.611225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.611348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.611375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.611475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.611626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.611671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.611816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.612010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.612039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.612207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.612331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.524 [2024-11-27 21:17:52.612359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.524 qpair failed and we were unable to recover it. 00:27:56.524 [2024-11-27 21:17:52.612486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.612625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.612653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.612807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.612941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.612968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.613093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.613222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.613248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.613379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.613548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.613574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.614211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.614440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.614770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.614970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.615063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.615383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.615675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.615832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.616006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.616332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.616623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.616877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.616974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.617128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.617405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.617727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.617907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.618043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.618296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.525 [2024-11-27 21:17:52.618515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.525 [2024-11-27 21:17:52.618704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.525 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.618853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.618996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.619162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.619408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.619690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.619886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.620010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.620316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.620563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.620808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.620983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.621112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.621427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.621718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.621900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.622003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.622211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.622464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.622711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.622837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.622997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.623300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.623607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.623816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.623958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.624256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.624502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.624784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.624960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.625085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.625346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.625629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.625872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.625997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.526 qpair failed and we were unable to recover it. 00:27:56.526 [2024-11-27 21:17:52.626090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.526 [2024-11-27 21:17:52.626210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.626237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.626356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.626485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.626512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.626652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.626782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.626809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.626953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.627221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.627491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.627774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.627925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.628022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.628333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.628625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.628778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.628904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.629211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.629461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.629742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.629897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.630006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.630261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.630484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.630761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.630914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.631017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.631297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.631552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.631768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.631919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.527 [2024-11-27 21:17:52.632051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.632170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.527 [2024-11-27 21:17:52.632197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.527 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.632291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.632535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.632779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.632974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.633109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.633445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.633718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.633875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.634062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.634396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.634693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.634814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.634969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.635257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.635558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.635699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.635890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.636166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.636402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.636719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.636909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.637038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.637291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.637544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.637715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.637891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.638159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.638395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.638718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.638869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.638995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.639092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.639119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.528 qpair failed and we were unable to recover it. 00:27:56.528 [2024-11-27 21:17:52.639242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.528 [2024-11-27 21:17:52.639370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.639396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.639489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.639659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.639687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.639798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.639898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.639926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.640018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.640262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.640509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.640816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.640969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.641074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.641372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.641685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.641877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.641992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.642285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.642536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.642717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.642883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.643235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.643629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xed9600 is same with the state(5) to be set 00:27:56.529 [2024-11-27 21:17:52.643816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.643996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.644260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.644575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.644841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.644990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.529 qpair failed and we were unable to recover it. 00:27:56.529 [2024-11-27 21:17:52.645133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.529 [2024-11-27 21:17:52.645241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.645271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.645412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.645544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.645599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.645692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.645862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.645889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.646099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.646438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.646720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.646881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.647015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.647322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.647646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.647834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.648009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.648348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.648673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.648812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.648985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.649332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.649658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.649800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.649944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.650276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.650570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.650695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.650870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.651338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.651630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.651823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.651998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.652221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.652271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.530 qpair failed and we were unable to recover it. 00:27:56.530 [2024-11-27 21:17:52.652386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.652537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.530 [2024-11-27 21:17:52.652564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.652700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.652795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.652822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.653046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.653391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.653700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.653934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.654063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.654312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.654582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.654859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.654984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.655141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.655379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.655663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.655815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.655978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.656258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.656484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.656853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.656992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.657119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.657379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.657683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.657859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.657981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.658255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.658593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.658842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.658994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.659153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.659426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.659725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.659861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.531 qpair failed and we were unable to recover it. 00:27:56.531 [2024-11-27 21:17:52.659989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.660079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.531 [2024-11-27 21:17:52.660106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.660203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.660454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.660733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.660868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.661032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.661286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.661553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.661866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.661972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.662119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.662426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.662766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.662969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.663078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.663342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.663700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.663882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.664024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.664292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.664675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.664839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.664962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.665278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.665552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.665694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.665818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.666002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.666032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.532 qpair failed and we were unable to recover it. 00:27:56.532 [2024-11-27 21:17:52.666222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.532 [2024-11-27 21:17:52.666406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.666433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.666561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.666751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.666795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.666908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.667183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.667437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.667744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.667896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.667996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.668248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.668481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.668698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.668877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.668982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.669271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.669539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.669842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.669997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.670096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.670319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.670586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.670818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.670984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.671155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.671432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.671724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.671888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.672003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.672306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.672622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.672745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.672870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.673159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.673446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.533 qpair failed and we were unable to recover it. 00:27:56.533 [2024-11-27 21:17:52.673729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.533 [2024-11-27 21:17:52.673854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.673881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.674006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.674320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.674587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.674724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.674881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.675251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.675537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.675831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.675982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.676153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.676468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.676779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.676934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.677029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.677334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.677680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.677815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.677954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.678229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.678516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.678812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.678942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.534 qpair failed and we were unable to recover it. 00:27:56.534 [2024-11-27 21:17:52.679100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.534 [2024-11-27 21:17:52.679203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.679232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.679348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.679519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.679572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.679675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.679781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.679807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.679931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.680201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.680423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.680669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.680832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.680953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.681307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.681593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.681755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.681883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.682187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.682506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.682799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.682945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.683045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.683353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.683703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.683828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.683957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.684257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.684558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.684825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.684956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.685121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.685448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.685805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.685926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.686019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.686315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.686601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.686753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.535 qpair failed and we were unable to recover it. 00:27:56.535 [2024-11-27 21:17:52.686903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.687023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.535 [2024-11-27 21:17:52.687048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.687144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.687417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.687727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.687889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.687983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.688268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.688547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.688815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.688961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.689088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.689418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.689733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.689880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.690001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.690254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.690500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.690788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.690910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.691064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.691316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.691601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.691851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.691979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.692105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.692379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.692689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.692819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.692944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.693167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.693435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.693653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.693837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.536 qpair failed and we were unable to recover it. 00:27:56.536 [2024-11-27 21:17:52.693965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.536 [2024-11-27 21:17:52.694057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.694203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.694505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.694829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.694954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.695057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.695313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.695596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.695878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.695983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.696165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.696426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.696691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.696841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.696939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.697166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.697427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.697730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.697852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.697973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.698194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.698432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.698681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.698841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.698980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.699259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.699511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.699804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.699952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.700104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.700337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.537 [2024-11-27 21:17:52.700597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.537 [2024-11-27 21:17:52.700744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.537 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.700838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.700953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.700980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.701080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.701389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.701708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.701841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.701941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.702253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.702582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.702759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.702888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.703173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.703456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.703723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.703907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.704003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.704220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.704470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.704719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.704855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.704991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.705273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.705505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.705837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.705963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.706116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.706360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.706634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.706757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.706866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.707198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.707465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.707707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.707861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.707953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.708212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.708497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.708782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.538 [2024-11-27 21:17:52.708942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.538 qpair failed and we were unable to recover it. 00:27:56.538 [2024-11-27 21:17:52.709073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.824 qpair failed and we were unable to recover it. 00:27:56.824 [2024-11-27 21:17:52.709348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.824 qpair failed and we were unable to recover it. 00:27:56.824 [2024-11-27 21:17:52.709659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.709824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.824 qpair failed and we were unable to recover it. 00:27:56.824 [2024-11-27 21:17:52.709954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.710084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.710111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.824 qpair failed and we were unable to recover it. 00:27:56.824 [2024-11-27 21:17:52.710240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.710395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.824 [2024-11-27 21:17:52.710423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.710563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.710700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.710727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.711605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.711768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.711796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.711940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.712217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.712569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.712890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.712993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.713114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.713367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.713611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.713862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.713983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.714123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.714386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.714653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.714790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.714912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.715212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.715474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.715806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.715935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.716037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.716285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.716605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.716959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.717088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.717416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.717696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.717821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.717928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.718149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.718390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.718682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.718810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.825 qpair failed and we were unable to recover it. 00:27:56.825 [2024-11-27 21:17:52.718939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.825 [2024-11-27 21:17:52.719093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.719257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.719543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.719771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.719937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.720035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.720309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.720532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.720777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.720966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.721116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.721447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.721677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.721815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.721918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.722199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.722451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.722699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.722829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.722929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.723208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.723505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.723767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.723925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.724077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.724324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.724573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.724791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.724937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.725089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.725343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.725621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.725781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.725944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.726272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.726552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.826 [2024-11-27 21:17:52.726713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.826 qpair failed and we were unable to recover it. 00:27:56.826 [2024-11-27 21:17:52.726840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.726960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.726988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.727119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.727396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.727658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.727779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.727900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.728208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.728459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.728741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.728892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.729042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.729327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.729614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.729763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.729901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.730166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.730484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.730775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.730937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.731091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.731394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.731667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.731794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.731893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.732201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.732448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.732683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.732849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.732976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.733236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.733490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.733751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.733930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.734056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.734336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.827 [2024-11-27 21:17:52.734623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.827 [2024-11-27 21:17:52.734795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.827 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.734947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.735227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.735510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.735776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.735966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.736097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.736382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.736710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.736838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.736968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.737221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.737469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.737747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.737908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.738035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.738315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.738568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.738789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.738923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.739022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.739241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.739509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.739822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.739945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.740067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.740323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.740605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.740840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.740994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.741122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.741458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.741708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.741843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.741998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.742122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.742150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.742304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.742399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.742427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.828 qpair failed and we were unable to recover it. 00:27:56.828 [2024-11-27 21:17:52.742537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.828 [2024-11-27 21:17:52.742666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.742693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.742812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.742936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.742962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.743089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.743296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.743582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.743739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.743883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.744135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.744433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.744741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.744889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.744985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.745228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.745538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.745871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.745989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.746111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.746389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.746694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.746882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.747011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.747287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.747565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.747844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.747994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.748121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.748398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.748702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.748867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.749019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.749145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.749173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.749298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.749417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.829 [2024-11-27 21:17:52.749444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.829 qpair failed and we were unable to recover it. 00:27:56.829 [2024-11-27 21:17:52.749548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.749662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.749689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.749825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.749922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.749949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.750068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.750293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.750574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.750873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.750995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.751122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.751427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.751738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.751891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.752046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.752325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.752629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.752794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.752916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.753261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.753523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.753708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.753890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.754233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.754511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.754741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.754892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.755025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.755281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.755542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.755732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.755872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.756242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.756532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.756746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.756892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.757263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.757564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.757723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.830 qpair failed and we were unable to recover it. 00:27:56.830 [2024-11-27 21:17:52.757839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.758037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.830 [2024-11-27 21:17:52.758081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.758203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.758533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.758832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.758998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.759128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.759422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.759681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.759829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.759950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.760228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.760450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.760664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.760820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.760920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.761202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.761488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.761800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.761925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.762085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.762393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.762637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.762829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.762952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.763288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.763518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.763680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.763844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.764280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.764538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.764832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.764984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.765010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.765163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.765317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.765343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.765467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.765617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.765664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.765840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.766019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.766046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.766198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.766320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.766346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.831 qpair failed and we were unable to recover it. 00:27:56.831 [2024-11-27 21:17:52.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.831 [2024-11-27 21:17:52.766541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.766567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.766672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.766795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.766828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.766967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.767270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.767518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.767794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.767987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.768160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.768412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.768671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.768796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.768899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.769174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.769505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.769701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.769866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.770174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.770452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.770728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.770849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.770992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.771245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.771466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.771726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.771879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.772004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.772259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.772538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.772703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.772869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.773160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.773388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.773642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.773893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.773983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.774010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.832 qpair failed and we were unable to recover it. 00:27:56.832 [2024-11-27 21:17:52.774135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.774252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.832 [2024-11-27 21:17:52.774283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.774399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.774561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.774589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.774746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.774847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.774874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.774997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.775278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.775624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.775829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.775980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.776221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.776504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.776790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.776954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.777077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.777333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.777674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.777856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.778007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.778323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.778595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.778815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.778954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.779305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.779594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.779801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.779939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.780232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.780485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.780806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.780985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.781075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.781326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.781646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.781824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.833 qpair failed and we were unable to recover it. 00:27:56.833 [2024-11-27 21:17:52.781924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.782058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.833 [2024-11-27 21:17:52.782085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.782212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.782491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.782786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.782989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.783095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.783372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.783690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.783887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.784035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.784352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.784637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.784849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.784976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.785263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.785568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.785745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.785915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.786300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.786638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.786804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.786918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.787159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.787467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.787717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.787864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.788016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.788278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.788533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.788701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.788884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.789217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.789498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.789693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.789839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.790146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.790402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.834 [2024-11-27 21:17:52.790586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.834 qpair failed and we were unable to recover it. 00:27:56.834 [2024-11-27 21:17:52.790714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.790836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.790862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.790959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.791214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.791498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.791819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.791984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.792077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.792364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.792702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.792874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.793024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.793281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.793568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.793714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.793871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.794123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.794387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.794625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.794748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.794876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.795207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.795433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.795699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.795842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.795993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.796249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.796570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.796750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.796872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.797147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.797451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.797739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.797892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.798026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.798265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.835 [2024-11-27 21:17:52.798536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.835 [2024-11-27 21:17:52.798744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.835 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.798889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.799284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.799602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.799828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.799949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.800167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.800474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.800717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.800869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.800991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.801291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.801537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.801837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.801978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.802078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.802318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.802673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.802874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.803015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.803316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.803716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.803889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.803991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.804272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.804563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.804725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.804906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.805233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.805521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.805778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.805937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.806070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.806422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.806723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.806894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.807044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.807214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.807240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.836 qpair failed and we were unable to recover it. 00:27:56.836 [2024-11-27 21:17:52.807396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.807547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.836 [2024-11-27 21:17:52.807574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.807705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.807851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.807881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.808015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.808354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.808702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.808822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.808973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.809259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.809567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.809703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.809873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.810186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.810491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.810825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.810969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.811120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.811430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.811714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.811834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.811952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.812289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.812663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.812809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.812960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.813263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.813564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.813876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.813997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.814143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.814404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.814734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.814884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.815059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.815381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.815722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.815886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.816029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.816140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.816170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.837 qpair failed and we were unable to recover it. 00:27:56.837 [2024-11-27 21:17:52.816300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.837 [2024-11-27 21:17:52.816443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.816475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.816597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.816692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.816719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.816838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.817168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.817465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.817764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.817925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.818061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.818336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.818631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.818783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.818935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.819287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.819605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.819727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.819874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.820229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.820536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.820791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.820932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.821090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.821403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.821726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.821882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.822024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.822265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.822547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.822772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.822921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.823049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.823292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.823613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.838 [2024-11-27 21:17:52.823765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.838 qpair failed and we were unable to recover it. 00:27:56.838 [2024-11-27 21:17:52.823908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.824236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.824536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.824826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.824985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.825124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.825425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.825695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.825845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.826024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.826280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.826609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.826801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.826963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.827253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.827561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.827763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.827894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.828239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.828601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.828769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.828949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.829195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.829477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.829821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.829984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.830149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.830463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.830707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.830839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.830965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.831229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.831577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.831857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.831982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.832008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.832131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.832264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.832294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.839 [2024-11-27 21:17:52.832433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.832564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.839 [2024-11-27 21:17:52.832593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.839 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.832746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.832870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.832896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.832999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.833274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.833549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.833755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.833892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.834189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.834456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.834792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.834956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.835121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.835467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.835784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.835917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.836027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.836312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.836640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.836810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.836940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.837203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.837463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.837737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.837936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.838127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.838463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.838768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.838918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.839059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.839363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.839673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.839906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.840087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.840348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.840713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.840956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.841160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.841332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.841368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-11-27 21:17:52.841554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.841658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.840 [2024-11-27 21:17:52.841686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.841811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.841932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.841958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.842084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.842339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.842622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.842798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.842956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.843258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.843504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.843831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.843964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.844150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.844425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.844757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.844903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.845058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.845327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.845614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.845746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.845890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.846187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.846506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.846761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.846936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.847100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.847407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.847717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.847862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.847998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.848290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.848593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.848745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.848917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.849216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.849465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.849717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.849865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-11-27 21:17:52.850027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.841 [2024-11-27 21:17:52.850129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.850316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.850584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.850826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.850943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.851096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.851397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.851714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.851831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.851950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.852253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.852515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.852775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.852988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.853138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.853459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.853773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.853892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.854076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.854316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.854582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.854778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.854948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.855249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.855591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.855740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.855876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.856186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.856505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.856776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.856940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.857090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.857422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.857718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.857859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.858011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.858162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.858188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-11-27 21:17:52.858335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.858498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.842 [2024-11-27 21:17:52.858533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.858706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.858844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.858872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.859039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.859325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.859578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.859755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.859912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.860236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.860512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.860807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.860971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.861098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.861390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.861749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.861902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.862074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.862379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.862680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.862839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.862961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.863224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.863538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.863790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.863903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.864052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.864312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.864640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.864764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.864913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.865206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.865516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.865819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.865979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.866006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.866147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.866274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.843 [2024-11-27 21:17:52.866301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.843 qpair failed and we were unable to recover it. 00:27:56.843 [2024-11-27 21:17:52.866429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.866560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.866604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.866756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.866929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.866957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.867131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.867402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.867670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.867851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.867953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.868280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.868587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.868881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.868974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.869120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.869348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.869669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.869802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.869955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.870215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.870547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.870826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.870991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.871167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.871511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.871783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.871972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.872125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.872433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.872726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.872864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.872974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.873282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.873593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.873815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.873981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.874108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.874355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.874688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.844 [2024-11-27 21:17:52.874852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.844 qpair failed and we were unable to recover it. 00:27:56.844 [2024-11-27 21:17:52.875001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.875268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.875555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.875803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.875909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.876059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.876338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.876634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.876775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.876916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.877251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.877585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.877736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.877855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.878214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.878566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.878817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.878985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.879124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.879428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.879765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.879894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.879994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.880332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.880614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.880792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.880934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.881204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.881534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.881831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.881998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.882150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.882383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.882699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.882893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.883044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.883163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.883189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.845 [2024-11-27 21:17:52.883312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.883459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.845 [2024-11-27 21:17:52.883485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.845 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.883607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.883742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.883771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.883917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.884184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.884481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.884781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.884894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.885013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.885298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.885578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.885868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.885984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.886151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.886432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.886665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.886784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.886926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.887196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.887505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.887822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.887964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.888092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.888407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.888662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.888853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.888995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.889309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.889583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.889747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.889892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.890204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.890577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.890849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.890974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.891112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.891468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.846 [2024-11-27 21:17:52.891759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.846 [2024-11-27 21:17:52.891925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.846 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.892040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.892351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.892669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.892815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.892910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.893216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.893517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.893834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.893972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.894107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.894377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.894647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.894775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.894925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.895296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.895551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.895829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.895983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.896078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.896390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.896738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.896888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.896991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.897241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.897570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.897864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.897984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.898210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.898500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.898787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.898904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.899053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.899198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.899226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.899393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.899533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.847 [2024-11-27 21:17:52.899576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.847 qpair failed and we were unable to recover it. 00:27:56.847 [2024-11-27 21:17:52.899725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.899849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.899875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.900053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.900349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.900656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.900776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.900907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.901135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.901440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.901752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.901955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.902119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.902372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.902694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.902853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.902982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.903324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.903633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.903796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.903906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.904233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.904512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.904806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.904981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.905107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.905346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.905698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.905850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.906029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.906358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.906675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.906864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.906986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.907290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.907616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.907796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.907946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.908044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.908069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.908215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.908312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.848 [2024-11-27 21:17:52.908357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.848 qpair failed and we were unable to recover it. 00:27:56.848 [2024-11-27 21:17:52.908495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.908604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.908631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.908726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.908821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.908848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.908993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.909261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.909546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.909788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.909972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.910114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.910375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.910682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.910836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.910952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.911313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.911653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.911795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.911897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.912182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.912488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.912751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.912944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.913084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.913296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.913622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.913774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.913923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.914226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.914552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.914836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.914975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.915117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.915426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.915739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.849 [2024-11-27 21:17:52.915886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.849 qpair failed and we were unable to recover it. 00:27:56.849 [2024-11-27 21:17:52.916042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.916307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.916612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.916862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.916980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.917179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.917455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.917734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.917950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.918058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.918390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.918717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.918883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.919002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.919250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.919551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.919731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.919866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.920130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.920373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.920683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.920850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.920965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.921183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.921468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.850 [2024-11-27 21:17:52.921637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.850 qpair failed and we were unable to recover it. 00:27:56.850 [2024-11-27 21:17:52.921784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.921880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.921907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.922025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.922309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.922656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.922809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.922957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.923256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.923536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.923882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.923991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.924156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.924478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.924732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.924893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.925043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.925319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.925560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.925881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.925993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.926144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.926432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.926714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.926848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.926991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.927289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.927615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.927881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.927999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.928119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.928420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.928739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.928863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.851 qpair failed and we were unable to recover it. 00:27:56.851 [2024-11-27 21:17:52.928967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.851 [2024-11-27 21:17:52.929066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.929195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.929489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.929777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.929925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.930067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.930390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.930690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.930861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.931020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.931304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.931549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.931848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.931972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.932121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.932352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.932659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.932854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.932993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.933268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.933547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.933818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.933942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.934073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.934396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.934667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.934812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.934952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.935261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.935563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.935785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.935950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.936087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.936213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.936243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.852 qpair failed and we were unable to recover it. 00:27:56.852 [2024-11-27 21:17:52.936392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.852 [2024-11-27 21:17:52.936514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.936546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.936664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.936802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.936832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.936997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.937332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.937584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.937775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.937918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.938249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.938580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.938753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.938890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.939154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.939423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.939759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.939901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.940025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.940321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.940603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.940732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.940886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.941190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.941470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.941751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.941925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.942079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.942417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.942693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.942822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.942921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.943206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.943515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.943783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.943929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.944038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.944323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.944653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.944801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.853 qpair failed and we were unable to recover it. 00:27:56.853 [2024-11-27 21:17:52.944971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.853 [2024-11-27 21:17:52.945077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.945231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.945519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.945810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.945982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.946131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.946417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.946749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.946912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.947050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.947342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.947633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.947790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.947916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.948236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.948536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.948814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.948964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.949148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.949415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.949704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.949883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.950003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.950258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.950569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.950721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.950835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.951183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.951566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.951743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.951865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.952182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.952468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.952707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.952847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.952991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.953154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.953182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.854 [2024-11-27 21:17:52.953318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.953434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.854 [2024-11-27 21:17:52.953460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.854 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.953635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.953820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.953846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.953976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.954282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.954499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.954809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.954954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.955103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.955409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.955739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.955895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.956019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.956233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.956536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.956839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.956985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.957192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.957522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.957762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.957913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.958061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.958408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.958713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.958838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.958937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.959186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.959517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.959746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.959916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.960090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.960401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.960695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.960872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.961027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.961352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.961675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.961818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.855 [2024-11-27 21:17:52.961959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.962064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.855 [2024-11-27 21:17:52.962092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.855 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.962264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.962394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.962421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.962577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.962717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.962746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.962848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.962979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.963150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.963409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.963669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.963811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.963974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.964331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.964642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.964834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.964985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.965233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.965494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.965795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.965967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.966123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.966401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.966722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.966864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.967048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.967346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.967634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.967786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.967905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.968216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.968591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.968796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.968908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.969223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.969490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.856 [2024-11-27 21:17:52.969801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.856 [2024-11-27 21:17:52.969927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.856 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.970073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.970346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.970708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.970901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.971023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.971335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.971674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.971841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.971950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.972220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.972555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.972887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.972992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.973176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.973438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.973802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.973968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.974087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.974341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.974633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.974783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.974940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.975182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.975466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.975737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.975883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.976034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.976320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.976605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.976856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.976978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.977004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.977148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.977286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.977316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.857 qpair failed and we were unable to recover it. 00:27:56.857 [2024-11-27 21:17:52.977439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.857 [2024-11-27 21:17:52.977557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.977584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.977711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.977833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.977861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.977996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.978302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.978658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.978779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.978957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.979247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.979519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.979728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.979832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.980208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.980523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.980825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.980995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.981136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.981409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.981677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.981817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.981973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.982253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.982558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.982829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.982950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.983103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.983359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.983589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.983749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.983890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.984224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.984585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.984826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.984934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.985112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.985425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.985773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.858 [2024-11-27 21:17:52.985941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.858 qpair failed and we were unable to recover it. 00:27:56.858 [2024-11-27 21:17:52.986121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.986399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.986705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.986819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.986977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.987232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.987457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.987724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.987887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.988016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.988262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.988567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.988843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.988988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.989200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.989482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.989835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.989989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.990115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.990376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.990721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.990843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.990967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.991279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.991534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.991872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.991991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.992135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.992459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.992721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.992926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.993055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.993374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.993721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.993857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.994007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.994131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.994158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.994284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.994378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.859 [2024-11-27 21:17:52.994405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.859 qpair failed and we were unable to recover it. 00:27:56.859 [2024-11-27 21:17:52.994566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.994678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.994706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.994874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.995187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.995482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.995838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.995988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.996108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.996370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.996707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.996872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.997045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.997335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.997728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.997853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.997975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.998216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.998467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.998785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.998905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.999057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.999358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.999629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:52.999774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:52.999901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.000263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.000540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.000788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.000937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.001034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.001324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.001631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.001795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.001930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.002242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.002518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.860 [2024-11-27 21:17:53.002839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.002992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.860 [2024-11-27 21:17:53.003018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.860 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.003110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.003382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.003729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.003890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.004045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.004394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.004647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.004837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.004943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.005211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.005468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.005768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.005918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.006063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.006366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.006704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.006826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.006926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.007196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.007445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.007714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.007869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.007999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.008308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.008583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.008861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.008988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.009161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.009463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.009814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.009961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.010112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.010235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.010261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.861 qpair failed and we were unable to recover it. 00:27:56.861 [2024-11-27 21:17:53.010386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.010544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.861 [2024-11-27 21:17:53.010574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.010687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.010826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.010855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.011000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.011345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.011688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.011841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.011990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.012267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.012538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.012870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.012990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.013178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.013448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.013763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.013911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.014007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.014275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.014486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.014780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.014957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.015047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.015349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.015696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.015888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.016043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.016287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.016592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.016720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.016861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.017225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.017488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.017788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.017957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.018053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.018178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.018204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.018355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.018516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.018557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.862 qpair failed and we were unable to recover it. 00:27:56.862 [2024-11-27 21:17:53.018700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.862 [2024-11-27 21:17:53.018862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.018891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.019069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.019342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.019701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.019875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.019973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.020223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.020487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.020842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.020989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.021122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.021448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.021741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.021891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.022045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.022344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.022635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.022863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.022982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.023108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.023352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.023679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.023882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.023983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.024341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.024612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.024800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.024940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.025294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.025626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.025792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.025908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.026219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.026499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.026807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.026946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.027061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.027212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.027238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.863 qpair failed and we were unable to recover it. 00:27:56.863 [2024-11-27 21:17:53.027386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.863 [2024-11-27 21:17:53.027487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.027515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.027645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.027809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.027838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.028009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.028301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.028558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.028838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.028961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.029101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.029433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.029698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.029839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.029988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.030284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.030563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.030826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.030986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.031092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.031377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.031672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.031846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.031950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.032220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.032470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.032745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.032911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.033041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.033399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.033706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.033871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.033976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.034266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.034520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.034758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.034926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.035052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.035370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.035637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.035794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.035943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.036090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.864 [2024-11-27 21:17:53.036118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.864 qpair failed and we were unable to recover it. 00:27:56.864 [2024-11-27 21:17:53.036283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.036413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.036442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.865 qpair failed and we were unable to recover it. 00:27:56.865 [2024-11-27 21:17:53.036582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.036691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.036718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.865 qpair failed and we were unable to recover it. 00:27:56.865 [2024-11-27 21:17:53.036820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.036977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.865 [2024-11-27 21:17:53.037007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:56.865 qpair failed and we were unable to recover it. 00:27:56.865 [2024-11-27 21:17:53.037164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.153 [2024-11-27 21:17:53.037269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.153 [2024-11-27 21:17:53.037296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.153 qpair failed and we were unable to recover it. 00:27:57.153 [2024-11-27 21:17:53.037392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.153 [2024-11-27 21:17:53.037516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.037575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.037692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.037795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.037823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.037943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.038233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.038521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.038846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.038990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.039115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.039259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.039304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.039472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.039634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.039681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.039802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.039981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.040189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.040463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.040755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.040920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.041057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.041346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.041669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.041802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.041910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.042253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.042533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.042841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.042987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.043092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.043402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.043756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.043940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.044095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.044366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.044702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.044825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.044950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.045223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.045534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.154 [2024-11-27 21:17:53.045868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.045982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.154 [2024-11-27 21:17:53.046012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.154 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.046157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.046475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.046787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.046976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.047153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.047437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.047750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.047903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.048003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.048329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.048640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.048855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.049015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.049288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.049571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.049822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.049958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.050087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.050382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.050657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.050826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.050964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.051283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.051601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.051745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.051901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.052231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.052617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.052876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.052999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.053159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.053443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.053684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.053807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.053904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.054036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.054063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.054162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.054258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.054284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.155 qpair failed and we were unable to recover it. 00:27:57.155 [2024-11-27 21:17:53.054379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.155 [2024-11-27 21:17:53.054505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.054541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.054665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.054760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.054787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.054942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.055215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.055463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.055785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.055980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.056101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.056348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.056579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.056828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.056989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.057145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.057374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.057615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.057796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.057949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.058228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.058504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.058806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.058976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.059129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.059409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.059640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.059893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.059998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.060119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.060361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.060602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.060838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.060991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.061085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.061341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.061582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.156 [2024-11-27 21:17:53.061710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.156 qpair failed and we were unable to recover it. 00:27:57.156 [2024-11-27 21:17:53.061810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.061933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.061959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.062083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.062359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.062634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.062818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.062985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.063231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.063489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.063734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.063923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.064074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.064360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.064587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.064744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.064843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.065183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.065440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.065720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.065839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.065969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.066203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.066517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.066752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.066933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.067086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.067420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.067679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.067808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.068637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.068776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.068804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.068911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.069201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.069487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.069766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.069895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.070058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.070158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.070184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.157 qpair failed and we were unable to recover it. 00:27:57.157 [2024-11-27 21:17:53.070291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.157 [2024-11-27 21:17:53.070422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.070448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.070549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.070670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.070696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.070808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.070912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.070948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.071050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.071319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.071597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.071840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.071998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.072152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.072407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.072688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.072821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.072960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.073271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.073558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.073776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.073960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.074264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.074514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.074767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.074905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.075033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.075264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.075549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.075780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.075929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.076083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.076213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.076240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.076364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.076495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.076521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.158 qpair failed and we were unable to recover it. 00:27:57.158 [2024-11-27 21:17:53.076639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.158 [2024-11-27 21:17:53.076732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.076759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.076935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.077202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.077431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.077727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.077856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.077957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.078204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.078480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.078754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.078942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.079071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.079209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.079234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.079328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.079451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.079476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.080246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.080385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.080414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.080548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.080700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.080744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.080891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.081145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.081443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.081672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.081845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.081964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.082247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.082510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.082780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.082943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.083044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.083328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.083575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.083750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.083902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.084183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.084469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.084717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.084941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.085060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.085186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.159 [2024-11-27 21:17:53.085223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.159 qpair failed and we were unable to recover it. 00:27:57.159 [2024-11-27 21:17:53.085320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.085574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.085814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.085933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.086060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.086348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.086638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.086810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.086930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.087173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.087428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.087691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.087832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.087959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.088209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.088511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.088738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.088871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.089140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.089386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.089688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.089810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.089919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.090170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.090480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.090777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.090955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.091053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.091326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.091659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.091825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.091992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.092445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.092729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.092877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.093016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.093117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.093147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.160 [2024-11-27 21:17:53.093285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.093392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.160 [2024-11-27 21:17:53.093422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.160 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.093568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.093680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.093709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.093865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.094182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.094767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.094909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.095064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.095370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.095728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.095864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.096021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.096292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.096549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.096763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.096881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.096981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.097262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.097489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.097740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.097878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.097980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.098269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.098517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.098829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.098976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.099119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.099451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.099689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.099850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.099961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.100318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.100585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.100863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.100994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.101028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.101174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.101321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.101350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.161 qpair failed and we were unable to recover it. 00:27:57.161 [2024-11-27 21:17:53.101483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.161 [2024-11-27 21:17:53.101609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.101635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.101731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.101837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.101863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.102007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.102280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.102648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.102775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.102884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.103207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.103538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.103810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.103969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.104065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.104402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.104663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.104782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.104926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.105267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.105544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.105776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.105901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.106085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.106385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.106694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.106825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.106969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.107269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.107538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.107789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.107932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.108069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.108335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.108588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.108807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.108926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.109070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.109205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.109233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.162 [2024-11-27 21:17:53.109338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.109479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.162 [2024-11-27 21:17:53.109504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.162 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.109614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.109727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.109753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.109939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.110301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.110572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.110794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.110995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.111176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.111555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.111779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.111923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.112065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.112199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.112232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.112346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.113367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.113720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.113844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.113962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.114248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.114541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.114800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.114950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.115092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.115391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.115668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.115802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.115929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.116250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.116494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.116764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.116985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.117114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.117266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.117291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.163 [2024-11-27 21:17:53.117425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.117581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.163 [2024-11-27 21:17:53.117607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.163 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.117701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.117819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.117848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.118006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.118315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.118646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.118813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.118945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.119225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.119586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.119762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.119890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.120171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.120509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.120776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.120936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.121090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.121406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.121742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.121945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.122073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.122378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.122732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.122924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.123073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.123397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.123773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.123989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.124141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.124464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.124746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.124906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.125037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.125374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.125712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.125906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.126037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.126154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.126180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.126367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.126455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.126480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.164 qpair failed and we were unable to recover it. 00:27:57.164 [2024-11-27 21:17:53.126644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.164 [2024-11-27 21:17:53.126817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.126857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.126974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.127323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.127646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.127844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.127962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.128237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.128581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.128789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.128934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.129235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.129547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.129880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.129979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.130104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.130354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.130713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.130891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.131081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.131347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.131645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.131811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.131958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.132263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.132578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.132757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.132957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.133314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.133681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.133835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.133975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.134296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.134599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.134727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.134891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.135233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.165 [2024-11-27 21:17:53.135552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.165 [2024-11-27 21:17:53.135715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.165 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.135808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.135993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.136171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.136419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.136758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.136931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.137026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.137254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.137598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.137773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.137945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.138234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.138508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.138833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.138971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.139149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.139508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.139825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.139954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.140135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.140472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.140765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.140905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.141094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.141386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.141723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.141889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.142041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.142314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.142580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.142748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.142892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.143191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.143532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.143727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.143879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.144030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.144057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.144231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.144373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.144407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.166 qpair failed and we were unable to recover it. 00:27:57.166 [2024-11-27 21:17:53.144596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.166 [2024-11-27 21:17:53.144699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.144728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.144834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.144974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.145149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.145417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.145792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.145957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.146118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.146448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.146695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.146807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.146972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.147259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.147539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.147763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.147903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.148036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.148354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.148694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.148891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.149028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.149310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.149572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.149726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.149869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.150200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.150495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.150774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.150978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.151124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.151373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.151670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.151841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.152017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.152146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.152172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.167 qpair failed and we were unable to recover it. 00:27:57.167 [2024-11-27 21:17:53.152293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.167 [2024-11-27 21:17:53.152391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.152417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.152510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.152640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.152666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.152787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.152939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.152980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.153092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.153370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.153648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.153801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.153928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.154203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.154455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.154729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.154873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.154967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.155340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.155654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.155789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.155970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.156280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.156535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.156751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.156914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.157040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.157272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.157639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.157795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.157898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.158181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.158493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.158762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.158941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.159118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.159422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.159697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.159849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.159977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.160096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.160122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.160312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.160446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.168 [2024-11-27 21:17:53.160474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.168 qpair failed and we were unable to recover it. 00:27:57.168 [2024-11-27 21:17:53.160631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.160727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.160752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.160878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.161150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.161397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.161724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.161883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.162038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.162338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.162643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.162818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.162939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.163225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.163609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.163756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.163895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.164246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.164674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.164819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.164953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.165270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.165560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.165829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.165998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.166198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.166485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.166750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.166931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.167074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.167409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.167720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.167891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.168079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.168389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.168696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.168871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.169008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.169108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.169137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.169308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.169428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.169 [2024-11-27 21:17:53.169457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.169 qpair failed and we were unable to recover it. 00:27:57.169 [2024-11-27 21:17:53.169609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.169740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.169766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.169924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.170259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.170555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.170820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.170973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.171098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.171342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.171645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.171776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.171904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.172203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.172533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.172833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.172971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.173111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.173430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.173734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.173928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.174072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.174349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.174623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.174818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.174973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.175286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.175617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.175752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.175919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.176195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.176513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.176816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.176967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.177069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.177361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.177675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.177853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.170 [2024-11-27 21:17:53.178007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.178131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.170 [2024-11-27 21:17:53.178157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.170 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.178254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.178373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.178399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.178522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.178667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.178695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.178861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.178978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.179171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.179504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.179833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.179978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.180155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.180455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.180734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.180882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.181005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.181328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.181628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.181810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.181943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.182246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.182547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.182829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.182998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.183114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.183415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.183669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.183813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.183970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.184338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.184665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.184853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.184999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.185336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.185715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.185889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.186019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.186365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.186691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.186845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.171 [2024-11-27 21:17:53.187024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.187142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.171 [2024-11-27 21:17:53.187168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.171 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.187263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.187386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.187414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.187581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.187720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.187748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.187861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.187992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.188146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.188440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.188789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.188940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.189064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.189396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.189667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.189845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.189992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.190315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.190633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.190833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.191006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.191327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.191634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.191809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.191929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.192246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.192512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.192830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.192980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.193112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.193455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.193763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.193892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.194039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.194367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.194684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.172 [2024-11-27 21:17:53.194816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.172 qpair failed and we were unable to recover it. 00:27:57.172 [2024-11-27 21:17:53.194911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.195191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.195557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.195784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.195925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.196042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.196343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.196665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.196821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.196922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.197211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.197521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.197828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.197983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.198134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.198409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.198716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.198883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.199043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.199378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.199696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.199890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.200018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.200400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.200700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.200835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.200985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.201311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.201584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.201772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.201927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.202274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.202591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.202761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.202944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.203256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.203536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.173 [2024-11-27 21:17:53.203699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.173 qpair failed and we were unable to recover it. 00:27:57.173 [2024-11-27 21:17:53.203853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.204172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.204472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.204800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.204956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.205130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.205449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.205801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.205995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.206179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.206510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.206796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.206973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.207132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.207432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.207740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.207921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.208071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.208402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.208717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.208840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.208974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.209252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.209564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.209839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.209974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.210111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.210466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.210710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.210894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.211057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.211400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.211727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.211919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.212031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.212176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.212202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.212349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.212463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.212492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.174 qpair failed and we were unable to recover it. 00:27:57.174 [2024-11-27 21:17:53.212656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.174 [2024-11-27 21:17:53.212782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.212808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.212931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.213266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.213554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.213774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.213891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.213990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.214236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.214483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.214765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.214911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.215033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.215287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.215560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.215712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.215863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.216187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.216551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.216783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.216943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.217277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.217599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.217782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.217962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.218266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.218574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.218877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.218988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.219145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.219392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.219697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.219872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.220031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.220271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.220540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.220732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.220914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.221038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.221065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.175 qpair failed and we were unable to recover it. 00:27:57.175 [2024-11-27 21:17:53.221163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.175 [2024-11-27 21:17:53.221318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.221344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.221465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.221651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.221682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.221821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.221983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.222157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.222487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.222867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.222995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.223108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.223429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.223785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.223937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.224035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.224311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.224621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.224762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.224910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.225249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.225544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.225810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.225964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.226099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.226350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.226664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.226814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.226956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.227317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.227651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.227780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.227926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.228255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.228515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.176 qpair failed and we were unable to recover it. 00:27:57.176 [2024-11-27 21:17:53.228854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.176 [2024-11-27 21:17:53.228976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.229113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.229396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.229711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.229895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.230052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.230400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.230710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.230841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.230940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.231265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.231590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.231793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.231955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.232294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.232619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.232878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.232997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.233124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.233366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.233643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.233823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.233956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.234324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.234639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.234800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.234950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.235214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.235480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.235771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.235930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.236018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.236367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.236705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.236884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.237063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.237181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.237213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.177 [2024-11-27 21:17:53.237365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.237500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.177 [2024-11-27 21:17:53.237544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.177 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.237688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.237809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.237835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.237998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.238263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.238582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.238786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.238931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.239046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.239350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.239638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.239766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.239902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.240191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.240444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.240774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.240981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.241119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.241377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.241640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.241838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.242018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.242278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.242592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.242894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.242986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.243139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.243486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.243763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.243907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.244061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.244366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.244705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.244848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.244976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.245295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.245564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.178 [2024-11-27 21:17:53.245792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.178 [2024-11-27 21:17:53.245966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.178 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.246099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.246389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.246647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.246786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.246920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.247235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.247458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.247700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.247863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.247981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.248339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.248696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.248845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.248973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.249302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.249662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.249816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.249936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.250243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.250541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.250698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.250853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.251155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.251431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.251742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.251894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.252055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.252330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.252537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.252778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.252985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.253096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.253445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.253755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.253899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.254024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.254153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.254182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.179 qpair failed and we were unable to recover it. 00:27:57.179 [2024-11-27 21:17:53.254311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.254427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.179 [2024-11-27 21:17:53.254454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.254569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.254670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.254700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.254798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.254895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.254924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.255051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.255331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.255593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.255761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.255883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.256218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.256567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.256866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.256983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.257152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.257429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.257741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.257869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.258036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.258349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.258636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.258785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.258933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.259202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.259487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.259737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.259943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.260077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.260407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.260688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.260857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.260964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.261290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.261629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.261760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.261914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.262206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.180 [2024-11-27 21:17:53.262532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.180 [2024-11-27 21:17:53.262705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.180 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.262806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.262928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.262955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.263054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.263282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.263589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.263758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.263906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.264184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.264483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.264807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.264963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.265085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.265296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.265534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.265801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.265935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.266102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.266371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.266655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.266850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.266986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.267274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.267627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.267777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.267942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.268299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.268612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.268775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.268912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.269213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.269476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.181 [2024-11-27 21:17:53.269737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.181 [2024-11-27 21:17:53.269911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.181 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.270058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.270185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.270212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.270332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.270431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.270459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.274696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.274831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.274873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.275050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.275361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.275637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.275809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.275997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.276276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.276595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.276809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.276951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.277082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.277323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.277656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.277785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.277934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.278237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.278540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.278709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.278877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.279185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.279469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.279807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.279950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.280098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.280392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.280648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.280815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.280919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.281191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.281494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.281808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.281976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.282147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.282298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.282325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.182 [2024-11-27 21:17:53.282475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.282604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.182 [2024-11-27 21:17:53.282631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.182 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.282781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.282934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.283079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.283386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.283719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.283873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.284001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.284255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.284472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.284737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.284884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.284987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.285241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.285556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.285805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.285926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.286038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.286336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.286620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.286768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.286941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.287266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.287554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.287743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.287847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.288147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.288449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.288732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.288878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.289058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.289332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.289606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.289801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.289957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.290257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.290502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.183 qpair failed and we were unable to recover it. 00:27:57.183 [2024-11-27 21:17:53.290834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.183 [2024-11-27 21:17:53.290924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.290951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.291043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.291331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.291657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.291780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.291931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.292239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.292475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.292785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.292968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.293140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.293480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.293769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.293914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.294045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.294337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.294651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.294785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.294942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.295209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.295491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.295769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.295885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.296011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.296289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.296605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.296727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.296852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.297212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.297559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.297726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.297870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.298168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.298468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.298816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.298958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.299100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.299267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.299296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.184 qpair failed and we were unable to recover it. 00:27:57.184 [2024-11-27 21:17:53.299460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.184 [2024-11-27 21:17:53.299558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.299587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.299733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.299872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.299899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.300045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.300344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.300605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.300730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.300867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.301211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.301480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.301774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.301926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.302066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.302332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.302596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.302770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.302948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.303279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.303570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.303761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.303901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.304181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.304471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.304774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.304940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.305076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.305401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.305692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.305862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.305954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.306214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.306473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.306774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.306957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.307107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.307436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.307753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.185 [2024-11-27 21:17:53.307881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.185 qpair failed and we were unable to recover it. 00:27:57.185 [2024-11-27 21:17:53.308000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.308285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.308571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.308792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.308969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.309133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.309428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.309731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.309917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.310039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.310379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.310711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.310883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.311027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.311276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.311738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.311919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.312214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.312508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.312838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.312979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.313119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.313365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.313703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.313909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.314063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.314396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.314661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.314833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.314980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.315110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.315135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.315235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.315354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.315397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.186 qpair failed and we were unable to recover it. 00:27:57.186 [2024-11-27 21:17:53.315540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.186 [2024-11-27 21:17:53.315722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.315749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.315842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.315990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.316116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.316418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.316710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.316898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.317040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.317368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.317740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.317917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.318040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.318322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.318656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.318809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.318905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.319238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.319546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.319874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.319990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.320134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.320377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.320656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.320824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.320962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.321297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.321578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.321740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.321875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.322177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.322461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.322749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.322951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.323091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.323327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.323563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.323847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.323975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.324000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.187 qpair failed and we were unable to recover it. 00:27:57.187 [2024-11-27 21:17:53.324108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.187 [2024-11-27 21:17:53.324252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.324280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.324428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.324609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.324636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.324743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.324838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.324863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.325019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.325241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.325611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.325786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.325897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.326167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.326447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.326698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.326895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.327063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.327367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.327688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.327853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.327983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.328318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.328650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.328777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.328924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.329192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.329490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.329771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.329896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.330053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.330375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.330663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.330787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.330967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.331269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.331576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.331857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.331977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.332002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.332099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.332251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.332280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.332464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.332590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.188 [2024-11-27 21:17:53.332616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.188 qpair failed and we were unable to recover it. 00:27:57.188 [2024-11-27 21:17:53.332716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.332834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.332860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.332962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.333289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.333580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.333811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.333958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.334117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.334383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.334683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.334853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.335045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.335324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.335598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.335747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.335903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.336202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.336445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.336695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.336879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.337009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.337276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.337579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.337872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.337993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.338100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.338313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.338583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.338863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.338982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.339134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.339347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.339654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.339804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.339897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.340000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.340027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.340185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.340312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.340338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.189 qpair failed and we were unable to recover it. 00:27:57.189 [2024-11-27 21:17:53.340457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.189 [2024-11-27 21:17:53.340587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.340613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.340734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.340817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.340843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.340968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.341245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.341579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.341761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.341887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.342156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.342403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.342707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.342903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.343072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.343360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.343641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.343889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.343987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.344175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.344456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.344757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.344905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.345029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.345332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.345692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.345929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.346082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.346371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.346665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.346873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.346976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.347320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.347598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.347817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.190 qpair failed and we were unable to recover it. 00:27:57.190 [2024-11-27 21:17:53.347933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.190 [2024-11-27 21:17:53.348095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.348139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.348266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.348388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.348414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.348540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.348710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.348757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.348903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.349193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.349473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.349661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.349840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.350172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.350486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.350815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.350959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.351103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.351385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.351634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.351809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.351950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.352205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.352496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.352792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.352914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.353035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.353345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.353643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.353767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.353920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.354155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.354437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.354738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.354886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.355040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.355344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.355627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.355777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.355935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.356084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.356110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.191 [2024-11-27 21:17:53.356239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.356360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.191 [2024-11-27 21:17:53.356386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.191 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.356513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.356663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.356706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.356825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.356950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.356977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.357354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.357680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.357821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.357942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.358175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.358492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.358762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.358941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.359088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.359412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.359720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.359939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.360065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.360302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.360543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.360852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.360979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.361006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.361136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.361273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.361299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.361460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.361597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.361642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.361815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.362193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.362445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.362688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.362940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.363038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.363326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.363607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.192 [2024-11-27 21:17:53.363863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.192 [2024-11-27 21:17:53.363986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.192 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.364140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.364436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.364895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.365026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.365278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.365557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.365855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.365998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.366026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.483 qpair failed and we were unable to recover it. 00:27:57.483 [2024-11-27 21:17:53.366173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.483 [2024-11-27 21:17:53.366344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.366372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.366474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.366596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.366621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.366753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.366852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.366894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.366999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.367321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.367657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.367858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.367994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.368344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.368666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.368834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.368991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.369264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.369544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.369739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.369876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.370218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.370511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.370764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.370897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.371027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.371386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.371717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.371906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.372012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.372287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.372574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.372752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.372879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.373171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.373479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.373789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.373920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.374062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.374227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.374255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.484 [2024-11-27 21:17:53.374391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.374538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.484 [2024-11-27 21:17:53.374582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.484 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.374676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.374798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.374822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.374971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.375270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.375589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.375765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.375909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.376195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.376514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.376826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.376975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.377142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.377447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.377754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.377954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.378090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.378383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.378689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.378850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.378979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.379274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.379548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.379865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.379979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.380182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.380532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.380830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.380952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.381057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.381357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.381661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.381853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.381992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.382312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.382641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.382819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.382946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.383137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.485 [2024-11-27 21:17:53.383162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.485 qpair failed and we were unable to recover it. 00:27:57.485 [2024-11-27 21:17:53.383266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.383582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.383839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.383968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.384117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.384393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.384779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.384950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.385104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.385486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.385809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.385957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.386111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.386432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.386736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.386912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.387086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.387396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.387683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.387820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.387955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.388223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.388565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.388853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.388999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.389155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.389435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.389689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.389856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.390007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.390272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.390610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.390776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.390920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.391243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.391582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.391744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.486 qpair failed and we were unable to recover it. 00:27:57.486 [2024-11-27 21:17:53.391889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.486 [2024-11-27 21:17:53.392024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.392149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.392491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.392807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.392924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.393067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.393311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.393645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.393838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.394000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.394276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.394630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.394775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.394923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.395212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.395507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.395838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.395980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.396140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.396486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.396789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.396922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.397073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.397324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.397630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.397789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.397969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.398195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.398463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.398749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.398921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.399050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.399300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.399582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.399818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.399990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.487 [2024-11-27 21:17:53.400161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.400299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.487 [2024-11-27 21:17:53.400329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.487 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.400487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.400637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.400666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.400818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.400970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.400995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.401120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.401410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.401685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.401832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.401947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.402253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.402590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.402861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.402982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.403142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.403439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.403744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.403882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.404046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.404400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.404644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.404798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.404921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.405164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.405433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.405760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.405957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.406091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.406364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.406623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.406809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.406959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.407059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.407086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.488 [2024-11-27 21:17:53.407233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.407368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.488 [2024-11-27 21:17:53.407396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.488 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.407558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.407703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.407732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.407850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.407997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.408173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.408507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.408793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.408914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.409037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.409323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.409649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.409809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.409933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.410245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.410554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.410832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.410968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.411115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.411382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.411721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.411896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.412060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.412405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.412726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.412919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.413065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.413391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.413692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.413881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.414019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.414348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.414671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.414830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.414979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.415285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.415604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.415764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.415902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.416034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.416062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.489 qpair failed and we were unable to recover it. 00:27:57.489 [2024-11-27 21:17:53.416210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.489 [2024-11-27 21:17:53.416336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.416362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.416511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.416622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.416667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.416816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.416964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.416989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.417139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.417440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.417740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.417945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.418097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.418415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.418726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.418876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.418972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.419192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.419536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.419857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.419983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.420156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.420531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.420812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.420951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.421052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.421269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.421548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.421699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.421875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.422198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.422522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.422789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.422964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.423100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.423411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.423706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.423856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.424043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.424319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.490 [2024-11-27 21:17:53.424642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.490 [2024-11-27 21:17:53.424816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.490 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.424997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.425268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.425508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.425835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.425978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.426102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.426352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.426668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.426867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.427005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.427265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.427579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.427754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.427901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.428228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.428521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.428865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.428990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.429193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.429494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.429797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.429979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.430130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.430454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.430693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.430843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.430967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.431172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.431519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.431862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.431989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.432152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.432421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.432684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.432850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.432987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.433123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.433151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.491 qpair failed and we were unable to recover it. 00:27:57.491 [2024-11-27 21:17:53.433304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.433433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.491 [2024-11-27 21:17:53.433458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.433603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.433776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.433805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.433964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.434240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.434489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.434780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.434979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.435128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.435402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.435732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.435884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.436014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.436314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.436648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.436789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.437258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.437531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.437823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.437949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.438058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.438425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.438741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.438858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.439007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.439371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.439632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.439788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.439916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.440192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.440457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.492 qpair failed and we were unable to recover it. 00:27:57.492 [2024-11-27 21:17:53.440743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.492 [2024-11-27 21:17:53.440950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.441129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.441444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.441750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.441878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.442070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.442345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.442595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.442888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.442984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.443155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.443409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.443739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.443909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.444082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.444429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.444683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.444827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.444945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.445263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.445627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.445773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.445930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.446190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.446457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.446737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.446859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.447029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.447303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.447563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.447841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.447961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.448084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.448306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.448559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.448778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.493 [2024-11-27 21:17:53.448956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.493 qpair failed and we were unable to recover it. 00:27:57.493 [2024-11-27 21:17:53.449108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.449348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.449659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.449814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.449972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.450307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.450598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.450899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.450990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.451129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.451455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.451754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.451935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.452078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.452346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.452683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.452797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.452948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.453187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.453428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.453686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.453841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.453971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.454294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.454604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.454868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.454985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.455111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.455381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.455639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.455792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.455938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.456196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.456411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.456692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.456903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.457052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.457171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.494 [2024-11-27 21:17:53.457197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.494 qpair failed and we were unable to recover it. 00:27:57.494 [2024-11-27 21:17:53.457315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.457418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.457446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.457596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.457749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.457774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.457896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.458230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.458560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.458815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.458970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.459108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.459382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.459686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.459900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.459992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.460146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.460440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.460723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.460912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.461037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.461311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.461608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.461767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.461891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.462227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.462499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.462783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.462924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.463047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.463355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.463717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.463875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.464027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.464288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.464542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.464808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.464988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.465156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.465261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.465288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.495 [2024-11-27 21:17:53.465437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.465566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.495 [2024-11-27 21:17:53.465592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.495 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.465768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.465911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.465939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.466101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.466391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.466665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.466816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.466952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.467197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.467493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.467822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.467982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.468182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.468488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.468827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.468984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.469159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.469446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.469799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.469973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.470071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.470401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.470756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.470958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.471055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.471415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.471741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.471896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.472019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.472312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.472652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.472843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.472999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.473238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.473485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.473781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.473903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.474020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.474185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.496 [2024-11-27 21:17:53.474212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.496 qpair failed and we were unable to recover it. 00:27:57.496 [2024-11-27 21:17:53.474310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.474417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.474444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.474560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.474660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.474685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.474825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.475133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.475506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.475684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.475849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.476158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.476490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.476785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.476936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.477051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.477326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.477571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.477831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.477990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.478119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.478384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.478670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.478801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.478964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.479209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.479512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.479844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.479965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.480097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.480374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.480654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.480804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.480907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.481027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.481055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.481219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.481354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.481386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.497 qpair failed and we were unable to recover it. 00:27:57.497 [2024-11-27 21:17:53.481535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.497 [2024-11-27 21:17:53.481639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.481666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.481795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.481930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.481956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.482080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.482416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.482728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.482861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.483031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.483305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.483557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.483826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.483974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.484096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.484403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.484741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.484905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.485038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.485158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.485184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 4105945 Killed "${NVMF_APP[@]}" "$@" 00:27:57.498 [2024-11-27 21:17:53.485359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.485484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.485511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.485680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 21:17:53 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:57.498 [2024-11-27 21:17:53.485806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.485844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 21:17:53 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:57.498 21:17:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:57.498 [2024-11-27 21:17:53.485988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 21:17:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.498 [2024-11-27 21:17:53.486138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.486164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 21:17:53 -- common/autotest_common.sh@10 -- # set +x 00:27:57.498 [2024-11-27 21:17:53.486349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.486488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.486535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.486674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.486777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.486820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.486951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.487261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.487573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.487821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.487997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.488149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.488418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.488775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.488930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.489069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.489201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.489230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 [2024-11-27 21:17:53.489392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 [2024-11-27 21:17:53.489554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 21:17:53 -- nvmf/common.sh@469 -- # nvmfpid=4106645 00:27:57.498 [2024-11-27 21:17:53.489585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.498 qpair failed and we were unable to recover it. 00:27:57.498 21:17:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:57.498 21:17:53 -- nvmf/common.sh@470 -- # waitforlisten 4106645 00:27:57.498 [2024-11-27 21:17:53.489759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.498 21:17:53 -- common/autotest_common.sh@829 -- # '[' -z 4106645 ']' 00:27:57.499 [2024-11-27 21:17:53.489908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.489954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 21:17:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:57.499 [2024-11-27 21:17:53.490061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 21:17:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:57.499 21:17:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:57.499 [2024-11-27 21:17:53.490197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:57.499 [2024-11-27 21:17:53.490229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 21:17:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:57.499 [2024-11-27 21:17:53.490364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 21:17:53 -- common/autotest_common.sh@10 -- # set +x 00:27:57.499 [2024-11-27 21:17:53.490537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.490567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.491011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.491412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.491733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.491917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.492100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.492387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.492656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.492825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.492968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.493215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.493491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.493774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.493955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.494093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.494388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.494672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.494827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.494940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.495225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.495613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.495790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.495952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.496255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.496536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.496859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.496996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.497164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.497459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.497776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.497937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.498077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.498214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.498242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.499 qpair failed and we were unable to recover it. 00:27:57.499 [2024-11-27 21:17:53.498393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.498508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.499 [2024-11-27 21:17:53.498537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.498647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.498806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.498845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.498996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.499279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.499575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.499716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.499870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.500169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.500536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.500803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.500966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.501102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.501380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.501697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.501874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.502023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.502256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.502546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.502865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.502993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.503173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.503474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.503711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.503851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.503951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.504198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.504460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.504779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.504985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.505086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.505416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.505741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.505907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.506058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.506386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.506709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.506864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.500 qpair failed and we were unable to recover it. 00:27:57.500 [2024-11-27 21:17:53.506977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.500 [2024-11-27 21:17:53.507122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.507270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.507565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.507827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.507977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.508161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.508478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.508707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.508854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.509003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.509277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.509506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.509772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.509932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.510036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.510304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.510618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.510799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.510949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.511246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.511496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.511759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.511921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.512074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.512322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.512630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.512884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.512999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.513114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.513350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.513640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.513781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.513903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.514156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.514407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.514697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.514852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.501 qpair failed and we were unable to recover it. 00:27:57.501 [2024-11-27 21:17:53.514960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.501 [2024-11-27 21:17:53.515061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.515217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.515463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.515682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.515854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.515943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.516419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.516715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.516887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.517691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.517849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.517876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.518028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.518292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.518610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.518851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.518976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.519164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.519384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.519669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.519798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.519903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.520213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.520523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.520806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.520955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.521112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.521399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.521724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.521879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.522000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.522121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.522147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.502 qpair failed and we were unable to recover it. 00:27:57.502 [2024-11-27 21:17:53.522252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.522380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.502 [2024-11-27 21:17:53.522405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.522553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.522680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.522707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.522835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.522953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.522978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.523080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.523350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.523681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.523834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.523951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.524223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.524498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.524739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.524872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.524964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.525229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.525455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.525750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.525887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.525990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.526480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.526713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.526898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.527018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.527263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.527532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.527779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.527936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.528030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.528286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.528570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.528796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.528919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.529043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.529316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.529560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.503 [2024-11-27 21:17:53.529711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.503 qpair failed and we were unable to recover it. 00:27:57.503 [2024-11-27 21:17:53.529749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:57.503 [2024-11-27 21:17:53.529809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.529836] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:57.504 [2024-11-27 21:17:53.529935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.529960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.530091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.530309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.530589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.530875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.530998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.531136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.531389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.531670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.531787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.531913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.532158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.532421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.532730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.532878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.532977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.533226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.533460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.533765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.533896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.534018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.534265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.534529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.534787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.534955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.535078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.535355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.535669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.535828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.535927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.536139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.536407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.536641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.536890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.536994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.537020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.504 qpair failed and we were unable to recover it. 00:27:57.504 [2024-11-27 21:17:53.537126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.504 [2024-11-27 21:17:53.537249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.537275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.537374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.537503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.537543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.537641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.537780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.537805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.537905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.538157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.538398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.538688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.538840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.538976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.539227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.539729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.539888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.540024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.540285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.540538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.540823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.540963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.541084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.541332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.541624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.541797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.541939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.542156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.542422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.542709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.542879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.543008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.543260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.543567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.543818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.543935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.544057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.544271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.544577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.544860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.544991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.545015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.505 qpair failed and we were unable to recover it. 00:27:57.505 [2024-11-27 21:17:53.545140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.505 [2024-11-27 21:17:53.545290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.545315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.545440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.545556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.545581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.545736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.545860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.545885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.546008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.546345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.546632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.546782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.546944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.547182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.547512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.547844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.547992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.548143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.548420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.548683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.548839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.548946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.549229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.549503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.549792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.549925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.550018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.550255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.550509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.550741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.550870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.550977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.551250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.551495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.551788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.551934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.552053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.552202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.506 [2024-11-27 21:17:53.552228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.506 qpair failed and we were unable to recover it. 00:27:57.506 [2024-11-27 21:17:53.552332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.552622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.552846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.552970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.553098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.553400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.553639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.553891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.553992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.554140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.554409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.554659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.554843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.554950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.555214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.555466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.555721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.555847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.555971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.556191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.556465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.556799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.556926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.557056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.557335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.557605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.557894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.557990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.558151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.558371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.558626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.558768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.558923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.559137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.559372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.559617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.507 [2024-11-27 21:17:53.559745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.507 qpair failed and we were unable to recover it. 00:27:57.507 [2024-11-27 21:17:53.559887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.559988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.560164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.560440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.560667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.560823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.560983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.561265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.561514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.561740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.561871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.561998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.562245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.562501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.562764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.562914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.563003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.563265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.563506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.563817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.563961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.564063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.564329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.564689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.564834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.564984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.565260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.565562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.508 [2024-11-27 21:17:53.565654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.565778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.565891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.566011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.566255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.566552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.566828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.566941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.567043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.567187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.567212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.508 qpair failed and we were unable to recover it. 00:27:57.508 [2024-11-27 21:17:53.567320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.567446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.508 [2024-11-27 21:17:53.567471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.567606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.567702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.567728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.567831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.567956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.567981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.568112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.568355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.568628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.568880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.568984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.569147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.569379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.569694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.569847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.569958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.570212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.570498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.570801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.570954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.571106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.571359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.571624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.571749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.571895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.572164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.572384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.572663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.572830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.572957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.573238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.573518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.573764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.573884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.574037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.574281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.574558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.574810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.509 [2024-11-27 21:17:53.574949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.509 qpair failed and we were unable to recover it. 00:27:57.509 [2024-11-27 21:17:53.575076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.575297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.575585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.575845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.575996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.576093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.576366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.576640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.576793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.576954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.577202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.577453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.577696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.577868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.577997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.578269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.578514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.578792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.578973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.579091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.579337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.579568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.579828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.579964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.580065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.580340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.580632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.580888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.580981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.581135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.581441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.581700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.581851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.581978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.582188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.510 [2024-11-27 21:17:53.582429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.510 [2024-11-27 21:17:53.582560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.510 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.582662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.582757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.582782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.582889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.583164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.583385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.583644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.583830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.583957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.584177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.584450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.584682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.584810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.584913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.585163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.585417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.585689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.585841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.585962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.586180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.586433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.586704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.586830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.586952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.587277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.587573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.587790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.587952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.588078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.588321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.588545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.588788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.511 [2024-11-27 21:17:53.588907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.511 qpair failed and we were unable to recover it. 00:27:57.511 [2024-11-27 21:17:53.589004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.589260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.589500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.589757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.589887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.590014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.590298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.590560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.590811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.590967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.591066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.591323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.591550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.591828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.591985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.592119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.592351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.592608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.592866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.592993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.593143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.593462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.593687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.593824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.593945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.594220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.594486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.594747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.594872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.594977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.595226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.595472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.595718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.595844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.595973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.596067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.596091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.512 [2024-11-27 21:17:53.596177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.596301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.512 [2024-11-27 21:17:53.596326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.512 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.596424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.596521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.596551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.596647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.596778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.596803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.596929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.597150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.597420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.597666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.597820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.597923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.598223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.598544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.598801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.598926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.599054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.599293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.599534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.599808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.599959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.600081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.600327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.600547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.600827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.600946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.601067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.601307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.601585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.601843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.601990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.602088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.602328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.602555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.602800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.602954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.603044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.603130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.603155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.513 qpair failed and we were unable to recover it. 00:27:57.513 [2024-11-27 21:17:53.603303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.513 [2024-11-27 21:17:53.603372] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:57.514 [2024-11-27 21:17:53.603400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.603428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.603532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.603644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.603669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.603791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.603890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.603915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.604016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.604243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.604486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.604733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.604890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.604990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.605203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.605487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.605720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.605834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.605990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.606262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.606511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.606762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.606892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.606985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.607274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.607548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.607797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.607955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.608085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.608358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.608656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.608834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.608934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.609230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.609456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.609704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.609837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.609944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.610204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.514 [2024-11-27 21:17:53.610462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.514 [2024-11-27 21:17:53.610588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.514 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.610710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.610803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.610829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.610923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.611228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.611533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.611821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.611948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.612051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.612305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.612593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.612867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.612993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.613118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.613389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff62c000b90 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.613616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.613770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.613897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.614174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.614416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.614647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.614899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.614995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.615127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.615402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.615662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.615803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.615904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.616178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.616427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.616686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.616809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.616929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.617017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.617042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.515 [2024-11-27 21:17:53.617137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.617252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.515 [2024-11-27 21:17:53.617277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.515 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.617376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.617506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.617537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.617669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.617776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.617800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.617924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.618256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.618509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.618760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.618911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.619020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.619258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.619545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.619795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.619915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.620040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.620263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.620564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.620816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.620964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.621119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.621389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.621674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.621829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.621957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.622270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.622530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.622805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.622954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.623055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.623295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.623582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.623863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.623976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.624098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.624404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.516 [2024-11-27 21:17:53.624642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.516 [2024-11-27 21:17:53.624814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.516 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.624922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.625171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.625412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.625674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.625831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.625958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.626230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.626467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.626709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.626830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.626984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.627231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.627467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.627725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.627885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.628015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.628316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.628559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.628868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.628991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.629091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.629337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.629624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.629776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.629903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.630148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.630401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.630658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.630806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.630907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.631125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.631372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.631621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.631860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.631982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.517 [2024-11-27 21:17:53.632101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.632225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.517 [2024-11-27 21:17:53.632250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.517 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.632351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.632467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.632492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.632596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.632716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.632741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.632900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.632998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.633141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.633348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.633563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.633863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.633995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.634088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.634338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.634550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.634803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.634967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.635103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.635318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.635570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.635815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.635934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.636059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.636298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.636554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.636835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.636974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.637075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.637364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.637648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.637773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.637878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.638126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.638404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.638672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.638815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.638914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.639191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.518 qpair failed and we were unable to recover it. 00:27:57.518 [2024-11-27 21:17:53.639473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.518 [2024-11-27 21:17:53.639612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.639712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.639814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.639846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.639999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.640237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.640506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.640836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.640975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.641124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.641424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.641681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.641803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.641907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.642143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.642382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.642675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.642796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.642955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.643215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.643591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.643858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.643971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.644103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.644346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.644604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.644875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.644993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.645087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.645356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.645649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.645776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.645910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.646151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.646424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.646663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.646814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.646938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.647061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.647087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.519 qpair failed and we were unable to recover it. 00:27:57.519 [2024-11-27 21:17:53.647190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.519 [2024-11-27 21:17:53.647341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.647368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.647490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.647614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.647640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.647788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.647913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.647940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.648095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.648377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.648715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.648846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.648973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.649269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.649516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.649766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.649886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.649989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.650236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.650459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.650761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.650918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.651073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.651349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.651668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.651814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.651979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.652252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.652547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.652817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.652937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.653062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.653315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.653620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.653797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.653948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.654045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.654072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.520 [2024-11-27 21:17:53.654200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.654349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.520 [2024-11-27 21:17:53.654380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.520 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.654534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.654688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.654714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.654841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.654932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.654957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.655106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.655354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.655693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.655869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.655962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.656240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.656454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.656761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.656916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.657066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.657320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.657592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.657889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.657997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.658115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.658362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.658609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.658862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.658984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.659135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.659388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.659622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.659750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.659857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.660127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.660341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.660667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.660796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.660903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.661148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.661713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.661858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.521 qpair failed and we were unable to recover it. 00:27:57.521 [2024-11-27 21:17:53.661964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.662089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.521 [2024-11-27 21:17:53.662114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.662247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.662521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.662811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.662941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.663046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.663321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.663560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.663845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.663955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.664066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.664387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.664709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.664855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.664948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.665196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.665512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.665760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.665906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.666019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.666261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.666564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.666817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.666957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.667091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.667390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.667683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.667811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.667909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.668125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.668377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.668701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.668904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.669041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.669320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.669604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.669784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.522 qpair failed and we were unable to recover it. 00:27:57.522 [2024-11-27 21:17:53.669906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.522 [2024-11-27 21:17:53.670003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.670148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.670405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.670632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.670788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.670919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.671192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.671429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.671731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.671932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.672035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.672279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.672510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.672766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.672889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.673010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.673277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.673536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.673814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.673966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.674076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.674359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.674603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.674756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.674893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.675161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.675395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.675640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.675795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.675899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.676186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.676415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.676698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.676819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.676943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.677101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.677127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.677253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.677401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.523 [2024-11-27 21:17:53.677427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.523 qpair failed and we were unable to recover it. 00:27:57.523 [2024-11-27 21:17:53.677531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.677685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.677710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.677806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.677924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.677950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.678060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.678339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.678586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.678827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.678975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.679061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.679274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.679561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.679783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.679916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.680067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.680354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.680609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.680854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.680975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.681128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.681381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.681637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.681852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.681975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.682104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.682321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.682601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.682829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.682985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.683119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.683379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.683673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.683825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.683926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.684238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.684467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.524 qpair failed and we were unable to recover it. 00:27:57.524 [2024-11-27 21:17:53.684721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.524 [2024-11-27 21:17:53.684883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.684908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.685027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.685245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.685514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.685799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.685951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.686103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.686360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.686680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.686844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.686974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.687227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.687502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.687749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.687922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.688048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.688342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.688604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.688823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.688974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.689074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.689350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.689626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.689875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.689980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.690165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.690447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.690756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.690903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.691026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.691282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.691550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.525 [2024-11-27 21:17:53.691679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.525 qpair failed and we were unable to recover it. 00:27:57.525 [2024-11-27 21:17:53.691792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.691945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.691987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.692166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.692446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.692691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.692841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.692966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.693231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.693485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.693738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.693917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.694053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.694381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.694647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.694772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.694866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.695022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.695048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.822 qpair failed and we were unable to recover it. 00:27:57.822 [2024-11-27 21:17:53.695177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.822 [2024-11-27 21:17:53.695272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.695297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.695392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.695514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.695546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.695647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.695779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.695805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.695937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.696169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.696418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.696648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.696798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.696903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.697197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.697423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.697664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.697840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.697941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.698169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.698444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.698698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.698829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.698936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.699171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.699418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.699654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.699778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.699912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.700164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.700419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.700643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.700826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.700952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.701186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.701454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.701730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.701883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.702013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.702169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.702196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.702298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.702424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.823 [2024-11-27 21:17:53.702451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.823 qpair failed and we were unable to recover it. 00:27:57.823 [2024-11-27 21:17:53.702561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.702662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.702689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.702794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.702893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.702918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.703041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.703322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.703685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.703813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.703945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.704193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.704440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.704706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.704883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.705009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.705320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.705625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.705904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.705993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.706146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.706371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.706662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.706792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.706931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.707183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.707450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.707693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.707809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.707958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.708179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.708433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.708699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.708848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.708942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.709195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.709486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.709714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.709825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.824 qpair failed and we were unable to recover it. 00:27:57.824 [2024-11-27 21:17:53.709943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.824 [2024-11-27 21:17:53.710068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.710221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.710509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.710790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.710919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.711041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.711290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.711505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.711794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.711951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.712090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.712344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.712599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.712825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.712950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.713054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.713309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.713584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.713838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.713990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.714120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.714409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.714667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.714820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.714909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.715191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.715442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.715722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.715840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.715959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.716193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.716432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.716676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.716802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.716929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.717056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.717082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.825 qpair failed and we were unable to recover it. 00:27:57.825 [2024-11-27 21:17:53.717178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.717310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.825 [2024-11-27 21:17:53.717335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.717461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.717583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.717609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.717730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.717825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.717850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.718002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.718220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.718497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.718786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.718943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.719039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.719295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.719503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.719728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.719838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.719940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.720143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:57.826 [2024-11-27 21:17:53.720178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720268] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:57.826 [2024-11-27 21:17:53.720288] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:57.826 [2024-11-27 21:17:53.720301] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:57.826 [2024-11-27 21:17:53.720377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.720372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:57.826 [2024-11-27 21:17:53.720423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:57.826 [2024-11-27 21:17:53.720455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:57.826 [2024-11-27 21:17:53.720457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:57.826 [2024-11-27 21:17:53.720602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.720825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.720970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.721064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.721316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.721551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.721800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.721922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.722055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.722326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.722624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.722866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.722979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.723109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.723309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.723334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.723494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.723610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.723640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.826 qpair failed and we were unable to recover it. 00:27:57.826 [2024-11-27 21:17:53.723744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.826 [2024-11-27 21:17:53.723895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.723921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.724038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.724278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.724544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.724777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.724937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.725037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.725326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.725588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.725846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.725988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.726111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.726347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.726648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.726792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.726897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.727185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.727438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.727672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.727833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.727934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.728145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.728403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.728683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.728803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.728915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.729164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.827 qpair failed and we were unable to recover it. 00:27:57.827 [2024-11-27 21:17:53.729386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.827 [2024-11-27 21:17:53.729501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.729613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.729739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.729765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.729905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.730155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.730450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.730707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.730854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.730954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.731177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.731471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.731705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.731845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.731969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.732209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.732425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.732653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.732780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.732892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.733128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.733345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.733587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.733741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.733891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.734131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.734342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.734601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.734880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.734995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.735121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.735361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.735653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.735777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.735933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.736152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.736414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.828 qpair failed and we were unable to recover it. 00:27:57.828 [2024-11-27 21:17:53.736682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.828 [2024-11-27 21:17:53.736777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.736803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.736913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.737171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.737389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.737642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.737767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.737890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.738250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.738498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.738748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.738871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.738985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.739232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.739535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.739809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.739929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.740037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.740352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.740589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xed9600 (9): Bad file descriptor 00:27:57.829 [2024-11-27 21:17:53.740777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.740935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.741040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.741334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.741565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.741820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.741989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.742083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.742334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.742593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.742837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.742963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.743214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.743455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.743696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.743843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.743981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.744080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.744106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.829 [2024-11-27 21:17:53.744225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.744327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.829 [2024-11-27 21:17:53.744352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.829 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.744479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.744618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.744644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.744770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.744893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.744919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.745038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.745260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.745467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.745716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.745866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.745961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.746202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.746440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.746696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.746806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.746947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.747195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.747423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.747658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.747769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.747908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.748224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.748456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.748707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.748851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.748978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.749197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.749431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.749724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.749853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.749949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.750188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.750411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.750709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.750831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.750966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.751184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.830 qpair failed and we were unable to recover it. 00:27:57.830 [2024-11-27 21:17:53.751439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.830 [2024-11-27 21:17:53.751583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.751682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.751778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.751802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.751914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.752132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.752374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.752644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.752787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.752921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.753143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.753386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.753645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.753856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.753979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.754083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.754329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.754580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.754859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.754982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.755098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.755370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.755628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.755876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.755995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.756153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.756413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.756651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.756769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.756896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.757139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.757401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.757652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.757798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.831 qpair failed and we were unable to recover it. 00:27:57.831 [2024-11-27 21:17:53.757937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.831 [2024-11-27 21:17:53.758039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.758167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.758381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.758666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.758988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.759117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.759388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.759616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.759887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.759997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.760098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.760351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.760626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.760755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.760871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.761130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.761370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.761638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.761859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.761976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.762122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.762375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.762611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.762845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.762998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.763101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.763323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.763588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.763863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.763993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.764123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.764331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.764546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.764779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.832 [2024-11-27 21:17:53.764974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.832 qpair failed and we were unable to recover it. 00:27:57.832 [2024-11-27 21:17:53.765105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.765319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.765571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.765866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.765994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.766116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.766392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.766669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.766779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.766914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.767167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.767415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.767667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.767776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.767887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.768127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.768406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.768712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.768836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.768964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.769220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.769463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.769738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.769884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.770004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.770221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.770466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.770754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.770868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.770972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.771215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.771436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.771669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.771809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.771949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.772052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.772077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.833 [2024-11-27 21:17:53.772200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.772292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.833 [2024-11-27 21:17:53.772318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.833 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.772423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.772542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.772568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.772700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.772805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.772829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.772956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.773194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.773410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.773660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.773804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.773935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.774148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.774422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.774670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.774787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.775195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.775453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.775700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.775843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.775963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.776215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.776572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.776794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.776904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.777005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.777274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.777474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.777699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.777826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.777958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.778229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.778472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.778760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.778902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.779000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.779216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.834 qpair failed and we were unable to recover it. 00:27:57.834 [2024-11-27 21:17:53.779491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.834 [2024-11-27 21:17:53.779622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.779725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.779812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.779837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.779970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.780220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.780437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.780734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.780862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.780982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.781218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.781469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.781730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.781871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.782023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.782266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.782492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.782786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.782920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.783049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.783272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.783531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.783783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.783941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.784063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.784297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.784561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.784775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.784934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.785031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.785276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.785529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.785779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.785954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.786047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.786347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.786597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.786715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.835 qpair failed and we were unable to recover it. 00:27:57.835 [2024-11-27 21:17:53.786820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.835 [2024-11-27 21:17:53.787007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.787130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.787406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.787634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.787865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.787974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.788132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.788412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.788683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.788827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.788923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.789224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.789505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.789792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.789950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.790086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.790327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.790559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.790798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.790950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.791074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.791327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.791615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.791853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.791989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.792163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.792408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.792679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.792889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.792985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.793019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.793120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.793217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.793242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.836 [2024-11-27 21:17:53.793369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.793450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.836 [2024-11-27 21:17:53.793474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.836 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.793624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.793747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.793773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.793871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.793974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.793999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.794098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.794316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.794560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.794820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.794936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.795035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.795281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.795568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.795817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.795968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.796074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.796351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.796595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.796824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.796974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.797071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.797309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.797571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.797788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.797946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.798065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.798276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.798523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.798773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.798894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.798991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.799203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.799444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.799669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.799787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.799917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.800160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.837 qpair failed and we were unable to recover it. 00:27:57.837 [2024-11-27 21:17:53.800390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.837 [2024-11-27 21:17:53.800529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.800625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.800712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.800738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.800856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.800957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.800987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.801073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.801275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.801470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.801702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.801824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.801928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.802174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.802394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.802618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.802820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.802927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.803027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.803282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.803489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.803720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.803891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.804007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.804247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.804487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.804754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.804909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.805040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.805263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.805483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.805768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.805889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.805987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.806200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.806469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.806690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.806824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.806936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.807032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.807057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.838 qpair failed and we were unable to recover it. 00:27:57.838 [2024-11-27 21:17:53.807151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.838 [2024-11-27 21:17:53.807266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.807416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.807652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.807882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.807998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.808123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.808371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.808643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.808865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.808982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.809072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.809284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.809529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.809742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.809885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.809990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.810203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.810427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.810742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.810895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.810989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.811228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.811447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.811695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.811835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.811967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.812177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.812397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.812625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.812875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.812996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.813091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.813311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.813579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.813830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.839 [2024-11-27 21:17:53.813944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.839 qpair failed and we were unable to recover it. 00:27:57.839 [2024-11-27 21:17:53.814043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.814283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.814530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.814805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.814918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.815014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.815254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.815497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.815726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.815849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.815955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.816208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.816453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.816678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.816790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.816930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.817170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.817470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.817705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.817850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.817941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.818222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.818494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.818744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.818874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.818964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.819198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.819397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.819658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.819881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.819978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.820097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.820307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.820568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.840 [2024-11-27 21:17:53.820783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.840 [2024-11-27 21:17:53.820909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.840 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.821045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.821266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.821474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.821705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.821822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.821958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.822198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.822468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.822701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.822829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.822954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.823197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.823483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.823707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.823835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.823943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.824171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.824415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.824646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.824794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.824931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.825189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.825444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.825664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.825877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.825996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.826120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.826365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.826662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.826868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.826990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.827015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.841 qpair failed and we were unable to recover it. 00:27:57.841 [2024-11-27 21:17:53.827108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.841 [2024-11-27 21:17:53.827208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.827339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.827634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.827881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.827975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.828095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.828293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.828571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.828818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.828962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.829089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.829325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.829601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.829815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.829998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.830127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.830380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.830637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.830774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.830875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.831118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.831360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.831596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.831845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.831995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.832094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.832366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.832663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.832827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.832932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.833154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.833417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.833637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.833867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.833985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.834080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.834204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.834230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.842 qpair failed and we were unable to recover it. 00:27:57.842 [2024-11-27 21:17:53.834354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.842 [2024-11-27 21:17:53.834477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.834502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.834611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.834703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.834728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.834827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.834917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.834941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.835037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.835303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.835559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.835807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.835930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.836047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.836294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.836512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.836776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.836920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.837018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.837263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.837502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.837743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.837860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.838004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.838205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.838496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.838734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.838853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.838951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.839189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.839433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.839725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.839859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.839951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.840211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.840458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.840731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.840893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.841028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.841169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.841200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.841428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.843 [2024-11-27 21:17:53.841457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.843 qpair failed and we were unable to recover it. 00:27:57.843 [2024-11-27 21:17:53.841599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.841694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.841719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.841845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.841938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.841962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.842065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.842274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.842541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.842786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.842896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.843019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.843276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.843495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.843742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.843862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.844019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.844253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.844498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.844740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.844857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.844960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.845199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.845441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.845659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.845898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.845986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.846103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.846380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.846642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.846754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.846902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.847144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.847342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.847603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.847821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.847977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.848105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.848201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.848226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.848345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.848440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.844 [2024-11-27 21:17:53.848464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.844 qpair failed and we were unable to recover it. 00:27:57.844 [2024-11-27 21:17:53.848592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.848688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.848713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.848804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.848893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.848919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.849040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.849308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.849522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.849799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.849919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.850046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.850318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.850535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.850660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.850998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.851233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.851439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.851706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.851821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.851916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.852126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.852376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.852664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.852909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.852993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.853119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.853330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.853580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.853796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.853911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.854006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.854278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.854489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.845 qpair failed and we were unable to recover it. 00:27:57.845 [2024-11-27 21:17:53.854709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.845 [2024-11-27 21:17:53.854834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.854858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.854959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.855167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.855382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.855657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.855806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.855932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.856223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.856466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.856710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.856830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.856926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.857139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.857382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.857653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.857868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.857980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.858113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.858323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.858534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.858772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.858942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.859035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.859273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.859477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.859709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.859846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.859971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.860185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.860427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.860681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.860900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.860993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.861019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.861119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.861213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.861238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.861356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.861453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.846 [2024-11-27 21:17:53.861477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.846 qpair failed and we were unable to recover it. 00:27:57.846 [2024-11-27 21:17:53.861590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.861711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.861736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.861837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.861920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.861944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.862030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.862260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.862504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.862754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.862898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.862996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.863206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.863444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.863665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.863874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.863997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.864117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.864357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.864614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.864884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.864994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.865090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.865346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.865588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.865801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.865945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.866063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.866304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.866516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.866792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.866902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.867000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.867262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.867476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.867704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.867816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.867949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.868041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.868067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.868168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.868261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.847 [2024-11-27 21:17:53.868285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.847 qpair failed and we were unable to recover it. 00:27:57.847 [2024-11-27 21:17:53.868379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.868471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.868496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.868626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.868775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.868799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.868885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.868985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.869104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.869322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.869559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.869792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.869915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.870032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.870272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.870498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.870755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.870900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.870990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.871220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.871433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.871672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.871792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.871921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.872199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.872442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.872694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.872840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.872993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.873197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.873395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.873651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.873866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.873990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.874110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.874349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.874584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.874806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.874982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.848 [2024-11-27 21:17:53.875071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.875218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.848 [2024-11-27 21:17:53.875242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.848 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.875327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.875575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.875814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.875933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.876026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.876240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.876452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.876691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.876805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.876892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.877144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.877409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.877620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.877795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.877924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.878131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.878404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.878626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.878862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.878985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.879104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.879338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.879582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.879808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.879962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.880058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.880260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.880498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.880773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.880918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.881020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.881257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.881501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.881743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.881869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.849 qpair failed and we were unable to recover it. 00:27:57.849 [2024-11-27 21:17:53.881962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.849 [2024-11-27 21:17:53.882054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.882187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.882429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.882695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.882816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.882916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.883191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.883398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.883647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.883893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.883986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.884101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.884335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.884585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.884786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.884955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.885065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.885303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.885540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.885750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.885888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.885992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.886210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.886450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.886660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.886896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.886983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.887110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.887407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.887628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.850 qpair failed and we were unable to recover it. 00:27:57.850 [2024-11-27 21:17:53.887883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.850 [2024-11-27 21:17:53.887970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.887995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.888126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.888347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.888626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.888859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.888986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.889133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.889365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.889596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.889835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.889949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.890041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.890367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.890611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.890844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.890951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.891048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.891298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.891540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.891756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.891888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.891980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.892226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.892464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.892734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.892856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.892945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.893206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.893411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.893650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.893863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.893977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.894100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.894371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.894588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.851 qpair failed and we were unable to recover it. 00:27:57.851 [2024-11-27 21:17:53.894807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.851 [2024-11-27 21:17:53.894923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.894949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.895047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.895320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.895546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.895762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.895891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.895981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.896213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.896417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.896695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.896822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.896941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.897144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.897380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.897630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.897842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.897986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.898104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.898308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.898582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.898802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.898922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.899030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.899277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.899521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.899733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.899892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.900041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.900284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.900520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.900741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.900867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.900956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.901196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.901411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.852 qpair failed and we were unable to recover it. 00:27:57.852 [2024-11-27 21:17:53.901685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.852 [2024-11-27 21:17:53.901784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.901809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.901931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.902201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.902450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.902692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.902903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.902990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.903139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.903380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.903609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.903864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.903985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.904083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.904319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.904549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.904770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.904889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.904996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.905260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.905467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.905718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.905860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.905989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.906231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.906451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.906682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.906880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.906988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.907105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.907314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.907520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.907760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.907880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.908010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.908100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.908124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.908223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.908348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.853 [2024-11-27 21:17:53.908373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.853 qpair failed and we were unable to recover it. 00:27:57.853 [2024-11-27 21:17:53.908467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.908555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.908581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.908683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.908779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.908804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.908928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.909145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.909386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.909610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.909824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.909934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.910029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.910271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.910488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.910764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.910884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.910986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.911201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.911413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.911641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.911858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.911980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.912097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.912359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.912631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.912840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.912980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.913106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.913370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.913651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.854 [2024-11-27 21:17:53.913867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.913985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.854 [2024-11-27 21:17:53.914010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.854 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.914101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.914341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.914659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.914880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.914995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.915119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.915344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.915556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.915782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.915902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.916030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.916242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.916474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.916724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.916846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.916981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.917200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.917434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.917709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.917856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.917973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.918202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.918447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.918716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.918827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.918919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.919171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.919410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.919670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.919876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.919976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.920127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.920369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.920606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.855 qpair failed and we were unable to recover it. 00:27:57.855 [2024-11-27 21:17:53.920821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.855 [2024-11-27 21:17:53.920974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.921122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.921365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.921605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.921824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.921978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.922114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.922323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.922547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.922760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.922877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.923003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.923226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.923529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.923773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.923914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.924063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.924271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.924508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.924716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.924841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.924933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.925195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.925456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.925702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.925823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.925945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.926207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.926435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.926655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.926797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.926929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.927151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.927392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.927660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.856 qpair failed and we were unable to recover it. 00:27:57.856 [2024-11-27 21:17:53.927870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.856 [2024-11-27 21:17:53.927965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.927990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.928092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.928310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.928566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.928820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.928952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.929058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.929267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.929504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.929730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.929847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.929949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.930191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.930429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.930649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.930798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.930923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.931129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.931373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.931600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.931879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.931993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.932087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.932326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.932551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.932794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.932904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.933007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.933271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.933505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.933725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.933869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.933959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.934189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.934410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.857 qpair failed and we were unable to recover it. 00:27:57.857 [2024-11-27 21:17:53.934620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.857 [2024-11-27 21:17:53.934706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.934732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.934839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.934961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.934986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.935115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.935319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.935564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.935811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.935951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.936081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.936342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.936554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.936816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.936934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.937031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.937243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.937451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.937700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.937818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.937918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.938199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.938439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.938696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.938837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.938930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.939191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.939407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.939680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.939915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.939999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.940123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.940369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.940612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.940866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.940988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.941015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.941106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.941194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.941219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.941312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.941402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.858 [2024-11-27 21:17:53.941427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.858 qpair failed and we were unable to recover it. 00:27:57.858 [2024-11-27 21:17:53.941555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.941680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.941705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.941856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.941979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.942131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.942346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.942589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.942866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.942986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.943136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.943383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.943609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.943854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.943964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.944090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.944325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.944562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.944776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.944924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.945026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.945249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.945485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.945744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.945897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.945987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.946193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.946415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.946640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.946880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.946998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.947093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.947301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.859 [2024-11-27 21:17:53.947567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.859 [2024-11-27 21:17:53.947688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.859 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.947782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.947869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.947894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.948010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.948254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.948484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.948702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.948816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.948942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.949206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.949447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.949683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.949905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.949996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.950122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.950334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.950859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.950975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.951098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.951340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.951592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.951896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.951986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.952127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.952337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.952589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.952810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.952987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.953082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.953319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.953551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.953760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.953912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.954004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.954210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.860 [2024-11-27 21:17:53.954477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.860 [2024-11-27 21:17:53.954631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.860 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.954728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.954856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.954881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.954987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.955221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.955486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.955707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.955829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.955920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.956190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.956424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.956652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.956836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.956929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.957168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.957373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.957637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.957760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.957888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.958116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.958325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.958554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.958824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.958945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.959067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.959297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.959529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.959771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.959894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.960019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.960245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.960484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.960731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.960849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.960947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.961186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.861 qpair failed and we were unable to recover it. 00:27:57.861 [2024-11-27 21:17:53.961460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.861 [2024-11-27 21:17:53.961575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.961667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.961761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.961786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.961888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.961978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.962128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.962396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.962636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.962879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.962976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.963127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.963399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.963617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.963853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.963972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.964095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.964340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.964576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.964789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.964936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.965063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.965310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.965561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.965809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.965935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.966037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.966243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.966805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.966918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.967015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.967254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.967486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.967739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.967850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.967940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.968026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.968050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.968177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.968272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.968297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.862 qpair failed and we were unable to recover it. 00:27:57.862 [2024-11-27 21:17:53.968389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.862 [2024-11-27 21:17:53.968483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.968518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.968619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.968722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.968747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.968904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.969118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.969359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.969602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.969878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.969987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.970090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.970391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.970668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.970814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.970942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.971210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.971424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.971646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.971790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.971886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.972178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.972421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.972641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.972814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.972943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.973232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.973461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.973738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.973852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.973959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.974201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.974415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.974640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.974893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.974984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.975008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.975110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.975273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.975298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.863 qpair failed and we were unable to recover it. 00:27:57.863 [2024-11-27 21:17:53.975448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.863 [2024-11-27 21:17:53.975544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.975569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.975692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.975809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.975835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.975928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.976172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.976433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.976650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.976868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.976991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.977118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.977339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.977554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.977790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.977943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.978061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.978273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.978477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.978743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.978856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.978959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.979181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.979381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.979599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.979837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.979980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.980082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.980291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.980557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.980817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.980934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.981027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.981243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.864 [2024-11-27 21:17:53.981465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.864 [2024-11-27 21:17:53.981584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.864 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.981704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.981824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.981849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.981945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.982157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.982395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.982619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.982891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.982980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.983124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.983415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.983634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.983853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.983963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.984103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.984310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.984628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.984747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.984885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.985131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.985393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.985603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.985869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.985986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.986104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.986336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.986579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.986784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.986923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.987020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.987235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.987443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.987697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.987806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.987932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.988024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.988048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.988134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.988261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.988286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.865 qpair failed and we were unable to recover it. 00:27:57.865 [2024-11-27 21:17:53.988386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.865 [2024-11-27 21:17:53.988473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.988497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.988600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.988691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.988715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.988810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.988934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.988959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.989064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.989304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.989518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.989779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.989902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.990021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.990234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.990449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.990701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.990911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.990996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.991143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.991382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.991640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.991867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.991989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.992078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.992321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.992566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.992781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.992909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.993004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.993232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.993458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.993682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.993821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.993947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.994165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.994410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.994633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.994780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.994897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.995014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.995038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.995194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.995281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.995306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.866 qpair failed and we were unable to recover it. 00:27:57.866 [2024-11-27 21:17:53.995402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.866 [2024-11-27 21:17:53.995499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.995523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.995618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.995715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.995740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.995831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.995923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.995950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.996045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.996247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.996488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.996730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.996883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.997004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.997278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.997550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.997758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.997880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.997974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.998210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.998417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.998633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.998870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.998991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.999117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.999369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.999594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:53.999814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:53.999986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.000112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.000324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.000576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.000813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.000923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.001013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.001251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.001452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.001685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.001894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.001986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.002138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.002412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.867 [2024-11-27 21:17:54.002696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.867 [2024-11-27 21:17:54.002815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.867 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.002917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.003158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.003396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.003623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.003837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.003959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.004084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.004305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.004508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.004752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.004868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.004998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.005233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.005447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.005696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.005817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.005920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.006167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.006381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.006600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.006848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.006994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.007082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.007307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.007534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.007777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.007891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.007984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.008462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.008672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.008821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.008916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.009010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.009036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.868 qpair failed and we were unable to recover it. 00:27:57.868 [2024-11-27 21:17:54.009136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.009250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.868 [2024-11-27 21:17:54.009276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.009397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.009545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.009576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.009678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.009830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.009855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.009955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.010168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.010439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.010689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.010806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.010935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.011208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.011426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.011657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.011874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.011995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.012106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.012321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.012591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.012802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.012955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.013071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.013273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.013529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.013742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.013933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.014025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.014235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.014480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.014726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.014854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.014941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.015103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.015129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.869 qpair failed and we were unable to recover it. 00:27:57.869 [2024-11-27 21:17:54.015224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.869 [2024-11-27 21:17:54.015325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.015350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.015471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.015589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.015615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.015713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.015800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.015825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.015920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.016203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.016445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.016680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.016824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.016920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.017196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.017436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.017699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.017818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.017916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.018142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.018388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.018626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.018869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.018983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.019127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.019394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.019613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.019742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.019892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.020195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.020438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.020655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.020799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.020922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.021130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.021370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.021624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.021891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.021983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.022100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.022308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.022553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.022824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.022949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.023043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.023136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.023162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.870 qpair failed and we were unable to recover it. 00:27:57.870 [2024-11-27 21:17:54.023259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.023385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.870 [2024-11-27 21:17:54.023409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.023499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.023629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.023654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.023756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.023848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.023874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.023993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.024237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.024471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.024677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.024823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.024921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.025017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:57.871 [2024-11-27 21:17:54.025042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:57.871 qpair failed and we were unable to recover it. 00:27:57.871 [2024-11-27 21:17:54.025144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.025380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.025619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.025828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.025967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.026063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.026307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.026548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.026799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.026947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.027039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.027280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.027489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.027713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.027836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.027937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.028174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.028410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.028654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.028867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.028984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.029103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.029313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.029523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.029749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.029859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.151 qpair failed and we were unable to recover it. 00:27:58.151 [2024-11-27 21:17:54.029961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.151 [2024-11-27 21:17:54.030093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.030211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.030422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.030687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.030800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.030889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.031188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.031427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.031651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.031880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.031976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.032097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.032317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.032607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.032843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.032985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.033111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.033381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.033644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.033766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.033892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.034190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.034517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.034755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.034877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.035006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.035249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.035496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.035714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.035869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.035959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.036200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.036469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.036714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.036822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.152 [2024-11-27 21:17:54.036947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.037040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.152 [2024-11-27 21:17:54.037065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.152 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.037169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.037404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.037713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.037865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.037954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.038160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.038373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.038620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.038863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.038989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.039110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.039321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.039570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.039782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.039934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.040034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.040269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.040546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.040816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.040963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.041063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.041339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.041578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.041831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.041959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.042055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.042266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.042482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.042712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.042890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.043007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.043248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.043453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.043682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.153 [2024-11-27 21:17:54.043810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.153 qpair failed and we were unable to recover it. 00:27:58.153 [2024-11-27 21:17:54.043903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.043997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.044147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.044382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.044638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.044848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.044963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.045063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.045272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.045503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.045729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.045847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.045974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.046257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.046494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.046739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.046899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.047017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.047289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.047522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.047766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.047916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.048008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.048278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.048483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.048740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.048894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.048990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.049230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.049536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.049786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.049915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.050006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.050221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.050485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.154 qpair failed and we were unable to recover it. 00:27:58.154 [2024-11-27 21:17:54.050786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.154 [2024-11-27 21:17:54.050901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.051006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.051307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.051520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.051740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.051853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.051970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.052220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.052458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.052759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.052933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.053032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.053243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.053735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.053889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.054008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.054232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.054438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.054728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.054842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.054941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.055210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.055475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.055748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.055859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.055952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.056187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.056395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.155 [2024-11-27 21:17:54.056543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.155 qpair failed and we were unable to recover it. 00:27:58.155 [2024-11-27 21:17:54.056664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.056792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.056818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.056918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.057154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.057373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.057633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.057849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.057976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.058064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.058302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.058607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.058746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.058871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.059128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.059364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.059605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.059834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.059961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.060064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.060300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.060540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.060819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.060933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.061057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.061297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.061539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.061746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.061903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.061991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.062226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.062548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.062768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.062885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.063016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.063107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.063132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.063225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.063308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.063333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.156 qpair failed and we were unable to recover it. 00:27:58.156 [2024-11-27 21:17:54.063482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.156 [2024-11-27 21:17:54.063585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.063611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.063708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.063802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.063828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.063923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.064163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.064437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.064671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.064821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.064945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.065206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.065451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.065733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.065857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.065953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.066191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.066412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.066679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.066802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.066933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.067417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.067682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.067827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.067919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.068141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.068355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.068876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.068985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.069111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.069367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.069620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.069834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.069985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.070110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.070264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.070289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.070381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.070478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.157 [2024-11-27 21:17:54.070504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.157 qpair failed and we were unable to recover it. 00:27:58.157 [2024-11-27 21:17:54.070639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.070737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.070763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.070863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.070988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.071171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.071461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.071697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.071818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.071914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.072187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.072437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.072676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.072791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.072884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.073128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.073399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.073659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.073897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.073987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.074322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.074552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.074798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.074926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.075015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.075258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.075496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.075722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.075866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.075957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.076225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.076455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.076669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.076793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.076915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.077161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.158 [2024-11-27 21:17:54.077389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.158 [2024-11-27 21:17:54.077503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.158 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.077606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.077756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.077781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.077883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.078155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.078374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.078608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.078850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.078959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.079050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.079271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.079513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.079758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.079882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.079971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.080187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.080426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.080690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.080804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.080923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.081170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.081383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.081619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.081833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.081977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.082073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.082311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.082533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.082756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.082946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.083044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.083282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.083487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.083754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.083870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.084005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.084099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.084125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.159 qpair failed and we were unable to recover it. 00:27:58.159 [2024-11-27 21:17:54.084220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.159 [2024-11-27 21:17:54.084335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.084360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.084479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.084571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.084597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.084706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.084829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.084854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.084954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.085193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.085393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.085634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.085876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.085989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.086080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.086299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.086518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.086787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.086935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.087032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.087280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.087502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.087722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.087899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.087992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.088236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.088446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.088720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.088862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.088958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.089203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.089446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.089665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.089879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.089993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.160 qpair failed and we were unable to recover it. 00:27:58.160 [2024-11-27 21:17:54.090088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.160 [2024-11-27 21:17:54.090214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.090335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.090545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.090825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.090942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.091052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.091321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.091561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.091792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.091909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.092007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.092207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.092484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.092729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.092879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.092974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.093213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.093433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.093678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.093882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.093984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.094102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.094351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.094574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.094853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.094965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.095061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.095285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.095552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.095832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.095977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.096077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.096286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.096520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.161 [2024-11-27 21:17:54.096797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.161 [2024-11-27 21:17:54.096928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.161 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.097055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.097315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.097552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.097767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.097886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.097984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.098258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.098476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.098720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.098872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.098965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.099174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.099438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.099691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.099802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.099926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.100129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.100359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.100575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.100823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.100969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.101061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.101284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.101552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.101796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.101913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.102002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.102216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.102430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.102649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.102764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.102891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.103141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.103385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.162 qpair failed and we were unable to recover it. 00:27:58.162 [2024-11-27 21:17:54.103658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.162 [2024-11-27 21:17:54.103747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.103773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.103900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.104151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.104419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.104640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.104815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.104972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.105183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.105424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.105689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.105838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.105957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.106156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.106371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.106652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.106903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.106989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.107134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.107398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.107649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.107764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.107882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.108177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.108428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.108680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.108831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.108919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.109185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.109429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.109677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.109825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.109918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.110157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.110422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.110676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.110793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.163 qpair failed and we were unable to recover it. 00:27:58.163 [2024-11-27 21:17:54.110920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.163 [2024-11-27 21:17:54.111010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.111129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.111355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.111567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.111870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.111998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.112093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.112302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.112551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.112789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.112911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.113007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.113228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.113423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.113677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.113798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.113902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.114124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.114346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.114634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.114811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.114935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.115169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.115408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.115656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.115799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.115895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.116129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.116374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.116617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.116831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.116951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.164 qpair failed and we were unable to recover it. 00:27:58.164 [2024-11-27 21:17:54.117099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.117223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.164 [2024-11-27 21:17:54.117248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.117371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.117598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.117847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.117972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.118124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.118343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.118554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.118852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.118976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.119096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.119335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.119619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.119853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.119979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.120110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.120324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.120593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.120800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.120951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.121504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.121781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.121896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.121995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.122208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.122438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.122681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.122821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.122956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.123205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.123425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.123678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.165 [2024-11-27 21:17:54.123792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.165 qpair failed and we were unable to recover it. 00:27:58.165 [2024-11-27 21:17:54.123885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.124122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.124398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.124621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.124870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.124988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.125091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.125331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.125575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.125868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.125985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.126081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.126317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.126576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.126822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.126932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.127035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.127244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.127512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.127758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.127907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.128238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.128502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.128747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.128892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.128979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.129211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.129448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.129726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.129884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.129979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.130189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.130430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.166 [2024-11-27 21:17:54.130681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.166 [2024-11-27 21:17:54.130821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.166 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.130909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.130998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.131175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.131477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.131684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.131798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.131901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.132150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.132419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.132665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.132778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.132880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.133150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.133358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.133577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.133836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.133952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.134049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.134346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.134599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.134846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.134987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.135140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.135344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.135607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.135819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.135938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.136064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.136307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.136547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.136780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.136896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.137018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.137297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.137523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.167 qpair failed and we were unable to recover it. 00:27:58.167 [2024-11-27 21:17:54.137745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.167 [2024-11-27 21:17:54.137868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.137893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.138023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.138289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.138556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.138798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.138944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.139064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.139279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.139539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.139834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.139947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.140044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.140323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.140570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.140808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.140925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.141054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.141328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.141572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.141812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.141954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.142048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.142288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.142540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.142820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.142938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.143029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.143242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.143519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.143762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.143909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.144007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.144228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.144441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.168 [2024-11-27 21:17:54.144662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.168 [2024-11-27 21:17:54.144812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.168 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.144923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.145166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.145412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.145624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.145867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.145986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.146100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.146371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.146621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.146836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.146988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.147141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.147367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.147675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.147825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.147933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.148169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.148439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.148670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.148815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.148913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.149164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.149403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.149647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.149896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.149993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.150111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.150364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.150666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.150789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.150914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.151014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.151040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.169 qpair failed and we were unable to recover it. 00:27:58.169 [2024-11-27 21:17:54.151135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.169 [2024-11-27 21:17:54.151225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.151340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.151597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.151868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.151993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.152091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.152313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.152648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.152788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.152920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.153138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.153354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.153608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.153826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.153937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.154057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.154360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.154574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.154863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.154981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.155074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.155297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.155558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.155809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.155938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.156029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.156274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.156485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.156785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.156931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.157054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.157336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.157591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.157817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.157967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.158056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.158172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.170 [2024-11-27 21:17:54.158198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.170 qpair failed and we were unable to recover it. 00:27:58.170 [2024-11-27 21:17:54.158288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.158536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.158786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.158904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.159005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.159244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.159479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.159715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.159843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.159937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.160174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.160416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.160623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.160863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.160982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.161074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.161294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.161548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.161768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.161913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.162009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.162226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.162470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.162694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.162806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.162938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.163239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.163454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.163710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.163823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.163950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.164226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.164469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.164716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.164845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.164946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.165067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.171 [2024-11-27 21:17:54.165092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.171 qpair failed and we were unable to recover it. 00:27:58.171 [2024-11-27 21:17:54.165246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.165488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.165714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.165829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.165936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.166169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.166419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.166636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.166784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.166910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.167153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.167380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.167651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.167875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.167993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.168092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.168334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.168549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.168753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.168902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.168999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.169247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.169498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.169756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.169898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.170001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.170210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.170421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.170675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.170855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.170951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.171188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.171430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.171674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.171782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.171942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.172033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.172 [2024-11-27 21:17:54.172059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.172 qpair failed and we were unable to recover it. 00:27:58.172 [2024-11-27 21:17:54.172212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.172480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.172712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.172863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.172960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.173171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.173446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.173675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.173819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.173944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.174162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.174369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.174664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.174783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.174911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.175131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.175397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.175649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.175879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.175978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.176098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.176382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.176631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.176879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.176977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.177160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.177401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.177649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.177762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.177893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.178157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.178375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.178606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.178837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.178952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.173 qpair failed and we were unable to recover it. 00:27:58.173 [2024-11-27 21:17:54.179045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.179137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.173 [2024-11-27 21:17:54.179161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.179257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.179504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.179741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.179863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.179962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.180252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.180511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.180740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.180859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.180980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.181185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.181389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.181652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.181795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.181912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.182173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.182416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.182635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.182852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.182975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.183106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.183332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.183544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.183781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.183899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.184027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.184264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.184491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.184740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.184851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.184957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.185051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.185076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.174 [2024-11-27 21:17:54.185198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.185294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.174 [2024-11-27 21:17:54.185319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.174 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.185421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.185512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.185555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.185654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.185771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.185795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.185889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.185990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.186111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.186360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.186643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.186777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.186904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.187220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.187437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.187673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.187798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.187920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.188202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.188474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.188691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.188803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.188906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.189143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.189393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.189610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.189825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.189976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.190093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.190340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.190602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.190864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.190985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.191072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.191321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.191541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.191774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.191909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.192044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.192162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.192187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.175 qpair failed and we were unable to recover it. 00:27:58.175 [2024-11-27 21:17:54.192284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.175 [2024-11-27 21:17:54.192378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.192404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.192499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.192630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.192656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.192750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.192837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.192869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.192964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.193217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.193462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.193679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.193803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.193902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.194156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.194405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.194633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.194874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.194986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.195138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.195433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.195648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.195895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.195992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.196123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.196420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.196639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.196769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.196866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.197143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.197446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.197713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.197831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.197984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.198257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.198478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.198742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.198860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.198949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.199034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.199059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.176 qpair failed and we were unable to recover it. 00:27:58.176 [2024-11-27 21:17:54.199186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.199276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.176 [2024-11-27 21:17:54.199305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.199412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.199536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.199563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.199659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.199749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.199774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.199902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.199994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.200138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.200380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.200625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.200868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.200986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.201108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.201329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.201586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.201846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.201967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.202060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.202302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.202544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.202782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.202928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.203047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.203319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.203540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.203788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.203906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.203996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.204273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.204493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.204742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.204889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.204982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.205244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.205491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.205742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.205869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.205996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.206231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.206471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.177 [2024-11-27 21:17:54.206702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.177 [2024-11-27 21:17:54.206832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.177 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.206950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.207187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.207397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.207641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.207850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.207991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.208140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.208359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.208612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.208855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.208975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.209070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.209321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.209542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.209786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.209915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.210013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.210251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.210514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.210772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.210889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.211008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.211224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.211489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.211741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.211856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.211981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.212192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.212395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.212640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.212853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.212965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.213058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.213292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.213548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.178 qpair failed and we were unable to recover it. 00:27:58.178 [2024-11-27 21:17:54.213797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.178 [2024-11-27 21:17:54.213917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.214026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.214323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.214565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.214781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.214898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.214987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.215206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.215427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.215645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.215795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.215920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.216140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.216371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.216588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.216815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.216935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.217026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.217251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.217531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.217773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.217916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.218018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.218272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.218480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.218737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.218879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.218970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.219197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.219407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.219649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.219860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.219972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.220093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.220334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.220571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.220777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.220906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.220990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.221258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.179 [2024-11-27 21:17:54.221504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.179 [2024-11-27 21:17:54.221684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.179 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.221786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.221883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.221909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.222015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.222272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.222555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.222809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.222926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.223055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.223264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.223471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.223742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.223892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.224044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.224268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.224542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.224812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.224950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.225079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.225304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.225516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.225746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.225920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.226019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.226236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.226514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.226763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.226908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.227031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.227274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.227487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.227733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.227864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.227966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.228179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.228445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.228698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.228844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.228939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.229157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.229374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.229614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.180 qpair failed and we were unable to recover it. 00:27:58.180 [2024-11-27 21:17:54.229814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.180 [2024-11-27 21:17:54.229938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.229963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.230084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.230332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.230577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.230826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.230977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.231108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.231334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.231571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.231844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.231997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.232089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.232331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.232542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.232770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.232888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.233049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.233297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.233562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.233809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.233917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.234041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.234288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.234499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.234759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.234876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.235007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.235246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.235457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.235711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.235832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.235932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.236200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.236408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.236666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.236872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.236980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.237079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.237333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.237558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-27 21:17:54.237784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.181 [2024-11-27 21:17:54.237899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.237923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.238027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.238281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.238500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.238715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.238831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.238938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.239189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.239413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.239633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.239859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.239983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.240098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.240305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.240540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.240796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.240934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.241069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.241334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.241621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.241870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.241999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.242113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.242423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.242711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.242830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.242948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.243241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.243485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.243742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.243922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.244010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.244232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.244480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.244728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.244852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.244956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.245085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.245110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-27 21:17:54.245202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.182 [2024-11-27 21:17:54.245319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.245433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.245669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.245884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.245979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.246103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.246352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.246593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.246841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.246959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.247064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.247302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.247541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.247782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.247902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.248028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.248262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.248501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.248752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.248892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.249021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.249247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.249490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.249759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.249868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.249967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.250183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.250432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.250647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.250772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.250927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.251157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.251392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.251666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.251896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.251995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.252111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.252325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.252569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.252814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.252963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.253095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.253213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.183 [2024-11-27 21:17:54.253238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-27 21:17:54.253343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.253622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.253860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.253999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.254176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.254447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.254661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.254780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.254904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.255176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.255414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.255691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.255903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.255998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.256118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.256421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.256684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.256897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.256992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.257110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.257389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.257646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.257879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.257996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.258100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.258349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.258600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.258853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.258963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.259060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.259329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.259536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.259783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.259902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.259995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.260236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.260477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.260727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.260899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.261006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.261241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.184 qpair failed and we were unable to recover it. 00:27:58.184 [2024-11-27 21:17:54.261488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.184 [2024-11-27 21:17:54.261650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.261750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.261846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.261872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.261966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.262206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.262511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.262768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.262911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.263015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.263222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.263493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.263726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.263842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.263945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.264185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.264425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.264680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.264841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.264935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.265211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.265450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.265675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.265823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.265947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.266167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.266389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.266642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.266874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.266998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.267118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.267326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.267582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.267827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.267942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.268042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.268247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.268500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.268775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.268916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.269009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.269280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.269488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.185 qpair failed and we were unable to recover it. 00:27:58.185 [2024-11-27 21:17:54.269743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.185 [2024-11-27 21:17:54.269836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.269862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.269950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.270223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.270448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.270716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.270893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.270993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.271200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.271433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.271701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.271843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.271962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.272212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.272444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.272665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.272894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.272985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.273135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.273374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.273632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.273844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.273972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.274068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.274311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.274608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.274757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.274885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.275130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.275340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.275580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.275802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.275973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.276068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.276298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.276538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.276772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.276898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.186 qpair failed and we were unable to recover it. 00:27:58.186 [2024-11-27 21:17:54.277000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.186 [2024-11-27 21:17:54.277089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.277222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.277425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.277654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.277803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.277904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.278150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.278434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.278654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.278808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.278897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.279141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.279375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.279629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.279868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.279991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.280093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.280329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.280599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.280831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.280956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.281186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.281400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.281617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.281881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.281998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.282093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.282337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.282615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.282826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.282942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.283040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.283282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.283530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.283780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.283890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.283985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.284207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.284443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.284687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.284835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.284923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.285039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.285064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.187 qpair failed and we were unable to recover it. 00:27:58.187 [2024-11-27 21:17:54.285157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.187 [2024-11-27 21:17:54.285255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.285280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.285381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.285496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.285522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.285656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.285778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.285804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.285922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.286151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.286361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.286595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.286711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.286908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.287150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.287349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.287589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.287828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.287946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.288099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.288309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.288607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.288820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.288968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.289065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.289336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.289559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.289775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.289927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.290047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.290257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.290519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.290739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.290927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.291017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.291224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.291493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.291742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.291863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.291956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.292222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.292433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.292680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.292825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.292922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.293015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.293045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.188 qpair failed and we were unable to recover it. 00:27:58.188 [2024-11-27 21:17:54.293139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.293259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.188 [2024-11-27 21:17:54.293283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.293373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.293499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.293531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.293632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.293762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.293786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.293884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.294160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.294459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.294713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.294860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.294979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.295215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.295425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.295649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.295867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.295991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.296106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.296382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.296632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.296857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.296970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.297098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.297387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.297609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.297825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.297948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.298055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.298289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.298548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.298762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.298875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.298960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.299237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.299478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.299722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.299847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.299947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.300190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.300449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.300683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.300797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.300886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.301002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.301027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.301173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.301290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.301314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.189 qpair failed and we were unable to recover it. 00:27:58.189 [2024-11-27 21:17:54.301434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.189 [2024-11-27 21:17:54.301533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.301558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.301686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.301806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.301830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.301913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.302176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.302426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.302689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.302841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.302939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.303182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.303430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.303659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.303774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.303926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.304136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.304379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.304636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.304873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.304986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.305078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.305318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.305555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.305858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.305964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.306062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.306310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.306558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.306766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.306919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.307008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.307222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.307495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.307711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.307855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.307961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.308181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.190 [2024-11-27 21:17:54.308435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.190 [2024-11-27 21:17:54.308560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.190 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.308653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.308768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.308794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.308917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.309129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.309369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.309620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.309823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.309946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.310043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.310288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.310533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.310752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.310923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.311021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.311291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.311497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.311741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.311856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.311953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.312192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.312386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.312672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.312807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.312897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.313143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.313392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.313669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.313888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.313974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.314084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.314299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.314548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.314770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.314886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.315011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.315283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.315565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.315786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.315927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.316081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.316174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.316200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.316321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.316404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.316428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.191 qpair failed and we were unable to recover it. 00:27:58.191 [2024-11-27 21:17:54.316553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.191 [2024-11-27 21:17:54.316680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.316705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.316946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.316970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.317068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.317319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.317568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.317810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.317959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.318053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.318301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.318540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.318785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.318930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.319019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.319272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.319486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.319754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.319868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.319992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.320235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.320449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.320656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.320865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.320984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.321111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.321348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.321607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.321852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.321978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.322125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.322361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.322587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.322836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.322956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.323060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.323325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.323601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.323813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.323930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.324088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.324328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.324535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.192 qpair failed and we were unable to recover it. 00:27:58.192 [2024-11-27 21:17:54.324779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.192 [2024-11-27 21:17:54.324927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.324953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.325039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.325277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.325490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.325737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.325884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.325996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.326247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.326461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.326706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.326855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.326947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.327178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.327416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.327666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.327778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.327931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.328189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.328423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.328682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.328798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.328925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.329161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.329396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.329650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.329799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.329916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.330126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.330373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.330627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.330775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.330898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.331142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.331394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.331602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.331869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.331996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.332112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.332380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.332638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.332802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.193 [2024-11-27 21:17:54.332905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.333020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.193 [2024-11-27 21:17:54.333045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.193 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.333195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.333436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.333678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.333823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.333950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.334199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.334419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.334704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.334826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.334920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.335175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.335478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.335732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.335855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.335978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.336246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.336462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.336704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.336840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.336932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.337181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.337445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.337696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.337840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.337964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.338238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.338455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.338701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.338905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.338992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.339149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.339425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.194 [2024-11-27 21:17:54.339682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.194 [2024-11-27 21:17:54.339802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.194 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.339928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.340139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.340387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.340602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.340751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.340875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.341165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.341399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.341672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.341794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.341931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.342186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.342423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.342676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.342805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.342923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.343161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.343426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.343664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.343803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.343929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.344133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.344380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.344605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.344908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.344998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.345024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.345121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.345250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.345277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.195 [2024-11-27 21:17:54.345375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.345501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.195 [2024-11-27 21:17:54.345540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.195 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.345669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.345767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.345793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.345884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.345999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.346121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.346418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.346676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.346794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.346920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.347168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.347405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.347629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.347842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.347984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.348108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.348322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.348565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.348816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.348970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.349062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.349307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.349552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.349795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.349935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.350029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.350278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.350550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.350795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.350970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.351100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.351342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.351551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.351791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.351934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.352031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.352155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.352181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.352305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.352422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.352447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.196 qpair failed and we were unable to recover it. 00:27:58.196 [2024-11-27 21:17:54.352571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.196 [2024-11-27 21:17:54.352703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.352734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.352829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.352976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.353092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.353299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.353521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.353795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.353939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.354028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.354233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.354443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.354711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.354854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.354944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.355201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.355425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.355645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.355864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.355990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.356078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.356313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.356587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.356800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.356916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.357067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.357311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.357549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.357797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.357942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.358045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.358266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.358514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.358765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.358891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.358984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.359075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.359102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.197 [2024-11-27 21:17:54.359191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.359308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.197 [2024-11-27 21:17:54.359334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.197 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.359454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.359552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.359579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.359698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.359790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.359816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.359943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.360155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.360420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.360680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.360829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.360921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.361124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.361374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.361626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.361868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.361982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.362077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.362318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.362562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.362818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.362934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.363061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.363346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.363616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.363866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.363987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.364110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.364356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.364568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.364818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.364966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.365061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.365271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.365517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.365738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.365893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.365989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.366102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.366128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.198 qpair failed and we were unable to recover it. 00:27:58.198 [2024-11-27 21:17:54.366252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.198 [2024-11-27 21:17:54.366372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.366397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.366517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.366618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.366644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.366734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.366857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.366883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.366972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.367225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.367454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.367718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.367864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.367953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.368208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.368409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.199 [2024-11-27 21:17:54.368659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.199 [2024-11-27 21:17:54.368774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.199 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.368870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.368992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.369113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.369327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.369613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.369830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.369976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.370074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.370290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.370509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.370760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.370876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.370974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.371183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.371430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.371661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.371774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.371877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.372123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.372342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.372597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.372750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.372882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.373157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.373359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.373621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.373866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.477 [2024-11-27 21:17:54.373979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.477 qpair failed and we were unable to recover it. 00:27:58.477 [2024-11-27 21:17:54.374066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.374358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.374635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.374763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.374859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.375133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.375407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.375649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.375864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.375989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.376105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.376342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.376653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.376876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.376981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.377096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.377333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.377593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.377815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.377959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.378078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.378293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.378505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.378730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.378855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.378959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.379195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.379435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.379706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.379828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.379916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.380156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.380354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.380563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.478 [2024-11-27 21:17:54.380681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.478 qpair failed and we were unable to recover it. 00:27:58.478 [2024-11-27 21:17:54.380775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.380875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.380902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.381032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.381277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.381519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.381744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.381864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.381966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.382183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.382429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.382669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.382899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.382990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.383110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.383332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.383586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.383746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.383852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.384124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.384435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.384677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.384791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.384916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.385177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.385483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.385736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.385850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.385944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.386203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.386494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.386713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.386855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.386971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.387196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.387450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.479 [2024-11-27 21:17:54.387673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.479 [2024-11-27 21:17:54.387820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.479 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.387914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.388172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.388470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.388714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.388865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.388960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.389199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.389430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.389700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.389846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.389937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.390207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.390455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.390677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.390795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.390919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.391168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.391379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.391602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.391813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.391957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.392085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.392308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.392559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.392805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.392935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.393061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.393304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.393612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.393835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.393952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.394081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.394362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.394612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.480 qpair failed and we were unable to recover it. 00:27:58.480 [2024-11-27 21:17:54.394835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.480 [2024-11-27 21:17:54.394960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.394987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.395134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.395337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.395566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.395782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.395933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.396021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.396251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.396497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.396746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.396855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.396988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.397228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.397442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.397687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.397860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.397951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.398167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.398372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.398622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.398846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.398992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.399114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.399355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.399612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.399828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.399949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.400072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.400308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.400551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.481 [2024-11-27 21:17:54.400674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.481 qpair failed and we were unable to recover it. 00:27:58.481 [2024-11-27 21:17:54.400773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.400867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.400893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.401019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.401297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.401501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.401744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.401865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.401991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.402229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.402448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.402661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.402773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.402922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.403166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.403378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.403603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.403890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.403985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.404113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.404348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.404559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.404812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.404958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.405084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.405354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.405565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.405808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.405957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.406088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.406326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.406558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.406804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.406946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.407041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.407280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.482 [2024-11-27 21:17:54.407577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.482 [2024-11-27 21:17:54.407726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.482 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.407818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.407934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.407959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.408081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.408298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.408518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.408764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.408933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.409061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.409313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.409551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.409754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.409898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.410005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.410313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.410530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.410757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.410877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.410997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.411218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.411455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.411700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.411850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.411939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.412154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.412429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.412688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.412808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.412926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.413168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.413441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.413655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.413877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.413996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.414119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.414328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.483 qpair failed and we were unable to recover it. 00:27:58.483 [2024-11-27 21:17:54.414550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.483 [2024-11-27 21:17:54.414674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.414701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.414796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.414891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.414919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.415048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.415272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.415483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.415705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.415828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.415927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.416212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.416423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.416657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.416831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.416938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.417192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.417402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.417655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.417872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.417991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.418113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.418366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.418643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.418806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.418906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.419154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.419378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.419608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.419881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.419999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.420103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.420373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.420587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.420830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.420945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.421063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.421186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.421212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.484 [2024-11-27 21:17:54.421302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.421389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.484 [2024-11-27 21:17:54.421415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.484 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.421511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.421627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.421654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.421796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.421883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.421909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.422009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.422238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.422483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.422724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.422843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.422963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.423221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.423533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.423759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.423876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.423971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.424214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.424491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.424716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.424831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.424920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.425190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.425450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.425715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.425872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.425965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.426196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.426465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.426692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.426813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.426930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.427180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.427424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.427640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.427879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.427996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.428121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.428212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.428238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.485 [2024-11-27 21:17:54.428349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.428435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.485 [2024-11-27 21:17:54.428459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.485 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.428587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.428684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.428710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.428838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.428930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.428955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.429104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.429334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.429552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.429793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.429943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.430070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.430317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.430572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.430821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.430993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.431085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.431320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.431570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.431777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.431926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.432030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.432291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.432516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.432799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.432914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.433007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.433257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.433503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.433735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.433860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.433950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.434218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.434491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.486 qpair failed and we were unable to recover it. 00:27:58.486 [2024-11-27 21:17:54.434745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.486 [2024-11-27 21:17:54.434837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.434863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.434961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.435216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.435429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.435649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.435869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.435983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.436081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.436293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.436555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.436769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.436883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.436973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.437241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.437520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.437739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.437888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.437975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.438189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.438408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.438654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.438872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.438983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.439104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.439373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.439677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.439792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.439908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.440144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.440394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.440655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.440813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.440923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.441045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.441074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.441206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.441310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.441339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.487 qpair failed and we were unable to recover it. 00:27:58.487 [2024-11-27 21:17:54.441475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.487 [2024-11-27 21:17:54.441584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.441610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.441699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.441853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.441878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.441987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.442242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.442484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.442730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.442845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.442945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.443169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.443383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.443624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.443834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.443946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.444097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.444335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.444599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.444805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.444957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.445078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.445302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.445530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.445784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.445901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.445987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.446225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.446424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.446684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.446792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.446888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.447139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.447376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.447655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.447773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.447900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.448052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.448081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.448200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.448314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.488 [2024-11-27 21:17:54.448339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.488 qpair failed and we were unable to recover it. 00:27:58.488 [2024-11-27 21:17:54.448434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.448640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.448868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.448991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.449112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.449377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.449627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.449852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.449998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.450120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.450333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.450577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.450783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.450934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.451033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.451286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.451587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.451796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.451940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.452029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.452278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.452497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.452743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.452895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.452993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.453217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.453458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.453739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.453888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.453987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.454205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.454421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.454694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.454807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.454929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.455051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.455077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.489 [2024-11-27 21:17:54.455205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.455303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.489 [2024-11-27 21:17:54.455328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.489 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.455452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.455569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.455596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.455729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.455824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.455848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.455944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.456164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.456397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.456702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.456821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.456908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.457155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.457396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.457660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.457783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.457905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.458152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.458391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.458633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.458842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.458966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.459063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.459309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.459555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.459798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.459908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.460027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.460264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.460505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.460655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.460853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.461178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.490 [2024-11-27 21:17:54.461388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.490 [2024-11-27 21:17:54.461546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.490 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.461671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.461765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.461791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.461888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.461975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.462123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.462390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.462621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.462829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.462950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.463057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.463299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.463553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.463769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.463920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.464043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.464258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.464532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.464748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.464865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.464994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.465236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.465454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.465703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.465858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.465957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.466195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.466468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.466713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.466860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.466952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.467050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.467077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.467206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.467331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.467356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.491 qpair failed and we were unable to recover it. 00:27:58.491 [2024-11-27 21:17:54.467451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.491 [2024-11-27 21:17:54.467546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.467572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.467724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.467846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.467872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.467971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.468216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.468476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.468693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.468804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.468900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.469229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.469475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.469701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.469853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.469953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.470318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.470578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.470797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.470972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.471089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.471315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.471569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.471816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.471965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.472097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.472298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.472542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.472788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.472937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.473032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.473304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.473520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.492 qpair failed and we were unable to recover it. 00:27:58.492 [2024-11-27 21:17:54.473764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.492 [2024-11-27 21:17:54.473884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.473973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.474242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.474452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.474695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.474813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.474938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.475182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.475458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.475677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.475795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.475926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.476167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.476407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.476679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.476823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.476918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.477254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.477490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.477708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.477826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.477951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.478174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.478418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.478671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.478826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.478919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.479158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.479389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.479600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.479827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.479947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.480071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.480292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.493 qpair failed and we were unable to recover it. 00:27:58.493 [2024-11-27 21:17:54.480761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.493 [2024-11-27 21:17:54.480882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.480907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.481005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.481250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.481457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.481728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.481847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.482201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.482440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.482688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.482799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.482925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.483182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.483451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.483669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.483789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.483911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.484126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.484337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.484547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.484773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.484918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.485009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.485235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.485515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.485792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.485919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.486007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.486219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.486426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.486714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.486858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.494 [2024-11-27 21:17:54.486975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.487073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.494 [2024-11-27 21:17:54.487098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.494 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.487214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.487427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.487684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.487833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.487931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.488140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.488356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.488576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.488814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.488956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.489046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.489276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.489497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.489737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.489881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.490278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.490519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.490766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.490913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.491004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.491253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.491497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.491736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.491878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.491973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.492184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.492383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.492637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.495 qpair failed and we were unable to recover it. 00:27:58.495 [2024-11-27 21:17:54.492858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.492980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.495 [2024-11-27 21:17:54.493007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.493095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.493335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.493568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.493774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.493926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.494024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.494257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.494518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.494735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.494844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.494942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.495184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.495429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.495713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.495833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.495957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.496201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.496414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.496628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.496841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.496986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.497077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.497290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.497507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.497730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.497849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.497998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.498218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.498434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.498680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.498819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.496 qpair failed and we were unable to recover it. 00:27:58.496 [2024-11-27 21:17:54.498911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.499028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.496 [2024-11-27 21:17:54.499054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.499141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.499400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.499633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.499852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.499968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.500063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.500339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.500580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.500832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.500949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.501072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.501309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.501569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.501819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.501957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.502086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.502330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.502538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.502749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.502898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.502995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.503259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.503461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.503670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.503867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.503995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.504110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.504355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.504567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.504814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.504934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.497 [2024-11-27 21:17:54.505024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.505140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.497 [2024-11-27 21:17:54.505166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.497 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.505257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.505535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.505747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.505895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.506017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.506233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.506473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.506751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.506905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.507006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.507246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.507459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.507683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.507794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.507914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.508123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.508342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.508627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.508864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.508983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.509082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.509344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.509589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.509861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.509977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.510073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.510344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.510580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.510799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.510943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.511042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.511285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.511558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.511772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.511893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.498 qpair failed and we were unable to recover it. 00:27:58.498 [2024-11-27 21:17:54.512065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.498 [2024-11-27 21:17:54.512149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.512281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.512481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.512767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.512884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.512981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.513283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.513530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.513766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.513883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.513976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.514187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.514404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.514666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.514838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.514967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.515183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.515455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.515705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.515827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.515921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.516137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.516378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.516594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.516837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.516961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.517054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.517256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.517508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.517721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.517849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.517981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.518208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.518432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.518674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.499 [2024-11-27 21:17:54.518791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.499 qpair failed and we were unable to recover it. 00:27:58.499 [2024-11-27 21:17:54.518886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.518975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.519119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.519390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.519607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.519818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.519969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.520067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.520306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.520548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.520796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.520918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.521009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.521213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.521496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.521913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.522011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.522224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.522429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.522669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.522881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.522975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.523120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.523363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.523574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.523802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.523953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.524056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.524290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.524568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.500 [2024-11-27 21:17:54.524695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.500 qpair failed and we were unable to recover it. 00:27:58.500 [2024-11-27 21:17:54.524795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.524916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.524943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.525061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.525305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.525566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.525789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.525939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.526057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.526323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.526541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.526786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.526907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.527027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.527270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.527479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.527730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.527877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.527972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.528221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.528488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.528748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.528896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.529021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.529307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.529548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.529772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.529891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.529981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.530246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.530533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.530781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.530910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.531012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.531224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.531434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.501 qpair failed and we were unable to recover it. 00:27:58.501 [2024-11-27 21:17:54.531680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.501 [2024-11-27 21:17:54.531793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.531884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.531972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.531998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.532098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.532309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.532559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.532840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.532984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.533071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.533319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.533544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.533810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.533925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.534023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.534237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.534485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.534737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.534847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.534968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.535204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.535424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.535664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.535881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.535998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.536144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.536380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.536594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.536808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.536919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.537042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.537250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.537521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.537761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.537882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.537975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.538073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.538097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.538227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.538317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.538342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.502 qpair failed and we were unable to recover it. 00:27:58.502 [2024-11-27 21:17:54.538443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.502 [2024-11-27 21:17:54.538559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.538590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.538691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.538781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.538807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.538907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.539156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.539401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.539620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.539835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.539979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.540086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.540335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.540556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.540776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.540890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.540986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.541233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.541488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.541749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.541864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.541956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.542195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.542459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.542709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.542912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.542999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.543128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.543350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.543592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.543825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.543970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.544065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.544329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.544556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.544770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.544951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.545045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.545145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.545172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.503 qpair failed and we were unable to recover it. 00:27:58.503 [2024-11-27 21:17:54.545258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.503 [2024-11-27 21:17:54.545378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.545403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.545535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.545641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.545665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.545765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.545891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.545918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.546049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.546292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.546499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.546714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.546838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.546932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.547200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.547460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.547684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.547796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.547923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.548148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.548453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.548708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.548826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.548918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.549149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.549352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.549624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.549749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.549847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.550115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.550329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.550545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.550782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.550898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.550992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.551211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.551447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.551685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.551838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.551933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.552019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.552045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.504 qpair failed and we were unable to recover it. 00:27:58.504 [2024-11-27 21:17:54.552137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.504 [2024-11-27 21:17:54.552245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.552421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.552642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.552889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.552980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.553125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.553377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.553620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.553887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.553988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.554144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.554354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.554588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.554828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.554953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.555083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.555324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.555557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.555811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.555926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.556023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.556273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.556545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.556796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.556948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.557045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.557286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.557508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.557722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.557838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.557929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.558032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.558057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.505 [2024-11-27 21:17:54.558190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.558285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.505 [2024-11-27 21:17:54.558310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.505 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.558430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.558555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.558581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.558676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.558775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.558801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.558893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.558994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.559118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.559332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.559588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.559828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.559942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.560038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.560275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.560504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.560777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.560924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.561017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.561262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.561517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.561794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.561921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.562016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.562281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.562784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.562909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.563004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.563291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.563551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.563797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.563941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.564035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.564279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.564519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.564739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.564892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.565022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.565174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.565200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.506 qpair failed and we were unable to recover it. 00:27:58.506 [2024-11-27 21:17:54.565295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.506 [2024-11-27 21:17:54.565419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.565444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.565578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.565674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.565705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.565799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.565922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.565947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.566036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.566270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.566479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.566692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.566839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.566926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.567130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.567352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.567561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.567834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.567949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.568085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.568335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.568553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.568762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.568911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.569006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.569230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.569463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.569704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.569820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.569941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.570152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.570362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.570610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.570843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.570996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.571090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.571326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.571564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.507 [2024-11-27 21:17:54.571778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.507 [2024-11-27 21:17:54.571893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.507 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.571984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.572203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.572461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.572675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.572804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.572955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.573167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.573407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.573648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.573847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.573991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.574086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.574325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.574566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.574780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.574959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.575052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.575263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.575490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.575750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.575867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.575957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.576195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.576434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.576686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.576804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.576894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.577129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.577336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.577554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.577800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.577920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.578052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.578272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.508 qpair failed and we were unable to recover it. 00:27:58.508 [2024-11-27 21:17:54.578484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.508 [2024-11-27 21:17:54.578606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.578708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.578832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.578857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.578977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.579228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.579490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.579731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.579883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.579978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.580191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.580431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.580674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.580789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.580916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.581117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.581383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.581605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.581873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.581988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.582084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.582305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.582579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.582846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.582974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.583062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.583318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.583573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.583824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.583958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.584048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.584298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.584542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.509 [2024-11-27 21:17:54.584687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.509 qpair failed and we were unable to recover it. 00:27:58.509 [2024-11-27 21:17:54.584787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.584878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.584905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.585025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.585238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.585453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.585699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.585828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.585930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.586155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.586408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.586638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.586843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.586991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.587141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.587371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.587613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.587836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.587958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.588078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.588346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.588574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.588803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.588921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.589042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.589245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.589490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.589753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.589874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.589965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.590251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.590496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.590723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.590839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.590943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.591166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.510 [2024-11-27 21:17:54.591409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.510 [2024-11-27 21:17:54.591522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.510 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.591649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.591738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.591763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.591859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.592137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.592361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.592603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.592848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.592966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.593055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.593266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.593476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.593713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.593854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.593939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.594204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.594417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.594641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.594862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.594978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.595069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.595306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.595521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.595742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.595849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.595975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.596213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.596438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.596686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.596814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.596915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.597126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.597386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.597625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.597832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.597948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.511 qpair failed and we were unable to recover it. 00:27:58.511 [2024-11-27 21:17:54.598055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.598173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.511 [2024-11-27 21:17:54.598198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.598294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.598500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.598739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.598863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.598958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.599235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.599452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 21:17:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:58.512 [2024-11-27 21:17:54.599680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.599767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 21:17:54 -- common/autotest_common.sh@862 -- # return 0 00:27:58.512 [2024-11-27 21:17:54.599793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.599896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 21:17:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:58.512 [2024-11-27 21:17:54.599990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 21:17:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:58.512 [2024-11-27 21:17:54.600107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.512 [2024-11-27 21:17:54.600206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.600332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.600565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.600823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.600970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.601067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.601288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.601559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.601813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.601958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.602044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.602254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.602501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.602754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.602869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.602972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.603183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.603478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.603707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.603829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.603953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.604212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.604455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.512 qpair failed and we were unable to recover it. 00:27:58.512 [2024-11-27 21:17:54.604667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.512 [2024-11-27 21:17:54.604791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.604816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.604903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.605160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.605398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.605661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.605876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.605995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.606096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.606317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.606530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.606745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.606890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.606991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.607230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.607507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.607851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.607958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.608180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.608450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.608746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.608865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.608958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.609203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.609436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.609707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.609828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.609915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.610135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.610379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.610843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.610984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.611109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.611232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.611257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.513 qpair failed and we were unable to recover it. 00:27:58.513 [2024-11-27 21:17:54.611383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.513 [2024-11-27 21:17:54.611477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.611502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.611662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.611785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.611811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.611904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.611995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.612113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.612343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.612585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.612812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.612924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.613054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.613323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.613577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.613818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.613937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.614032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.614225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.614466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.614708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.614827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.614943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.615198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.615466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.615679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.615828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.615965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.616213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.616463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.616687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.616812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.616909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.617152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.514 [2024-11-27 21:17:54.617394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.514 [2024-11-27 21:17:54.617513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.514 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.617611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.617706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.617733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.617852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.617954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.617981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.618076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.618324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.618577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.618839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.618996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 21:17:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:58.515 [2024-11-27 21:17:54.619091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 21:17:54 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.619341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.515 [2024-11-27 21:17:54.619440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.515 [2024-11-27 21:17:54.619623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.619900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.619997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.620145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.620360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.620573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.620835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.620977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.621075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.621319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.621536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.621761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.621873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.621967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.622205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.622448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.622657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.622803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.622893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.623145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.623387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.623645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.623790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.623892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.624010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.624037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.515 qpair failed and we were unable to recover it. 00:27:58.515 [2024-11-27 21:17:54.624159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.515 [2024-11-27 21:17:54.624280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.624306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.624395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.624517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.624553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.624681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.624775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.624801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.624932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.625156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.625378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.625614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.625896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.625993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.626139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.626346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.626592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.626816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.626992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.627135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.627470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.627742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.627899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.628021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.628274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.628502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.628748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.628871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.629004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.629208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.629468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.629703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.629830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.629920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.630139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.630412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.630638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.630878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.630999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.631026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.516 qpair failed and we were unable to recover it. 00:27:58.516 [2024-11-27 21:17:54.631116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.631219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.516 [2024-11-27 21:17:54.631248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.631348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.631564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.631846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.631969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.632064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.632303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.632535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.632781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.632936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.633037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.633287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.633533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.633836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.633956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.634048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.634264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.634538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.634768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.634923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.635028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.635266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.635516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.635804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.635924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.636020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.636237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.636479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.636735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.636857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.636955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.637249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.637494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.637756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.637914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.517 qpair failed and we were unable to recover it. 00:27:58.517 [2024-11-27 21:17:54.638041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.638132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.517 [2024-11-27 21:17:54.638159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.638259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.638499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.638769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.638920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.639050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.639557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.639817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.639969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.640059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.640312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.640597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.640845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.640959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.641086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.641334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.641555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.641801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.641923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.642017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.642275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.642547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.642834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.642985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.643094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.643317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b9Malloc0 00:27:58.518 0 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.643796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.643932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.518 [2024-11-27 21:17:54.644062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 21:17:54 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:58.518 [2024-11-27 21:17:54.644298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.518 [2024-11-27 21:17:54.644425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.518 [2024-11-27 21:17:54.644452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.644547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.644793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.644913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.518 qpair failed and we were unable to recover it. 00:27:58.518 [2024-11-27 21:17:54.645040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.518 [2024-11-27 21:17:54.645138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.645258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.645495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.645769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.645891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.645994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.646262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.646537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.646748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.646874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.646963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.647211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.647416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647408] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:58.519 [2024-11-27 21:17:54.647505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.647634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.647897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.647992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.648134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.648356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.648592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.648813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.648935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.649058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.649295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.649538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.649782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.649905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.649998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.650215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.650493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.650732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.650908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.519 qpair failed and we were unable to recover it. 00:27:58.519 [2024-11-27 21:17:54.650996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.519 [2024-11-27 21:17:54.651088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.651214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.651444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.651691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.651814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.651942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.652209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.652487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.652732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.652895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.652994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.653215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.653421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.653676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.653798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.653897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.654144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.654399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.654643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.654898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.654986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.655137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.655392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.520 [2024-11-27 21:17:54.655629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.655755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 21:17:54 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.520 [2024-11-27 21:17:54.655879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.520 [2024-11-27 21:17:54.656005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.656156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.656394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.656630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.656891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.656981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.657158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.657377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.520 qpair failed and we were unable to recover it. 00:27:58.520 [2024-11-27 21:17:54.657639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.520 [2024-11-27 21:17:54.657761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.657859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.657951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.657977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.658067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.658330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.658628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.658749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.658876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.659152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.659384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff638000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.659662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.659800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.659953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.660185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.660425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.660658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.660799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.660933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.661153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.661380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.661669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.661813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.661922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.662170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.662437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.662721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.662845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.662940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.663162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.663411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.663664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.521 [2024-11-27 21:17:54.663771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.663796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 21:17:54 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:58.521 [2024-11-27 21:17:54.663921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.521 [2024-11-27 21:17:54.664012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.521 [2024-11-27 21:17:54.664167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.664389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.664625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.521 [2024-11-27 21:17:54.664848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.521 [2024-11-27 21:17:54.664970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.521 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.665101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.665332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.665578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.665796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.665912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.666007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.666502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.666755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.666908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.666995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.667233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.667448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.667705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.667834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.667922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.668162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.668403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.668650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.668868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.668991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.669113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.669332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.669575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.669832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.669957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.670049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.670333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.670547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.670797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.670914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.671066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.671265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.671479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xecbcb0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.522 [2024-11-27 21:17:54.671710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.671851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b9 21:17:54 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:58.522 0 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.671994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.522 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.522 [2024-11-27 21:17:54.672112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.672140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.522 qpair failed and we were unable to recover it. 00:27:58.522 [2024-11-27 21:17:54.672251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.522 [2024-11-27 21:17:54.672340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.672366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.672482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.672609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.672637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.672733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.672842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.672868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.672966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.673205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.673423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.673657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.673888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.673984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.674136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.674401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.674652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.674876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.674996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.675023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.675110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.675225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.675251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.675373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.675488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.523 [2024-11-27 21:17:54.675515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7ff630000b90 with addr=10.0.0.2, port=4420 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 [2024-11-27 21:17:54.675672] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:58.523 [2024-11-27 21:17:54.678092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.523 [2024-11-27 21:17:54.678219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.523 [2024-11-27 21:17:54.678249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.523 [2024-11-27 21:17:54.678265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.523 [2024-11-27 21:17:54.678278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.523 [2024-11-27 21:17:54.678329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.523 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.523 21:17:54 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:58.523 21:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:58.523 21:17:54 -- common/autotest_common.sh@10 -- # set +x 00:27:58.523 21:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:58.523 21:17:54 -- host/target_disconnect.sh@58 -- # wait 4106101 00:27:58.523 [2024-11-27 21:17:54.687939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.523 [2024-11-27 21:17:54.688045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.523 [2024-11-27 21:17:54.688079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.523 [2024-11-27 21:17:54.688095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.523 [2024-11-27 21:17:54.688109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.523 [2024-11-27 21:17:54.688140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.523 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.697983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.698121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.698151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.784 [2024-11-27 21:17:54.698167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.784 [2024-11-27 21:17:54.698181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.784 [2024-11-27 21:17:54.698213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.784 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.708000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.708111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.708141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.784 [2024-11-27 21:17:54.708156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.784 [2024-11-27 21:17:54.708171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.784 [2024-11-27 21:17:54.708202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.784 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.718007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.718113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.718139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.784 [2024-11-27 21:17:54.718154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.784 [2024-11-27 21:17:54.718168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.784 [2024-11-27 21:17:54.718199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.784 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.727997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.728098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.728125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.784 [2024-11-27 21:17:54.728140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.784 [2024-11-27 21:17:54.728153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.784 [2024-11-27 21:17:54.728190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.784 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.738207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.738335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.738363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.784 [2024-11-27 21:17:54.738379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.784 [2024-11-27 21:17:54.738408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.784 [2024-11-27 21:17:54.738440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.784 qpair failed and we were unable to recover it. 00:27:58.784 [2024-11-27 21:17:54.748204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.784 [2024-11-27 21:17:54.748326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.784 [2024-11-27 21:17:54.748352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.748367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.748381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.748426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.758098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.758194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.758219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.758234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.758247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.758277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.768217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.768319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.768348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.768363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.768377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.768408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.778121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.778220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.778253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.778269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.778282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.778313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.788170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.788269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.788296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.788311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.788323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.788353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.798207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.798329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.798355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.798370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.798383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.798413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.808238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.808375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.808404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.808419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.808433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.808463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.818263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.818369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.818395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.818409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.818421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.818458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.828315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.828459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.828487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.828503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.828517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.828559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.838323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.838425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.838451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.838465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.785 [2024-11-27 21:17:54.838479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.785 [2024-11-27 21:17:54.838522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.785 qpair failed and we were unable to recover it. 00:27:58.785 [2024-11-27 21:17:54.848414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.785 [2024-11-27 21:17:54.848513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.785 [2024-11-27 21:17:54.848545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.785 [2024-11-27 21:17:54.848561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.848574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.848604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.858353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.858449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.858475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.858489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.858502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.858553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.868391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.868488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.868522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.868549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.868562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.868592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.878412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.878508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.878541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.878557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.878571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.878600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.888428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.888530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.888556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.888571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.888584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.888626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.898458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.898552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.898578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.898592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.898605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.898634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.908505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.908619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.908644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.908659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.908679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.908711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.918513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.918620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.918645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.918659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.918673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.918703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.928563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.928673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.928698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.928713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.928726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.928757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.938679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.938785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.938811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.938825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.938838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.938868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.948645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.786 [2024-11-27 21:17:54.948746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.786 [2024-11-27 21:17:54.948770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.786 [2024-11-27 21:17:54.948785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.786 [2024-11-27 21:17:54.948798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.786 [2024-11-27 21:17:54.948827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.786 qpair failed and we were unable to recover it. 00:27:58.786 [2024-11-27 21:17:54.958680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:54.958813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:54.958840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:54.958855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:54.958869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:54.958898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:54.968763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:54.968863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:54.968889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:54.968905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:54.968918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:54.968948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:54.978705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:54.978799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:54.978825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:54.978839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:54.978852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:54.978882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:54.988743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:54.988841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:54.988866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:54.988882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:54.988895] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:54.988925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:54.998773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:54.998871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:54.998896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:54.998910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:54.998929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:54.998960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:55.008814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:55.008918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:55.008948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:55.008963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:55.008976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:55.009007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:58.787 [2024-11-27 21:17:55.018838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.787 [2024-11-27 21:17:55.018937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.787 [2024-11-27 21:17:55.018963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.787 [2024-11-27 21:17:55.018978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.787 [2024-11-27 21:17:55.018992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:58.787 [2024-11-27 21:17:55.019022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.787 qpair failed and we were unable to recover it. 00:27:59.046 [2024-11-27 21:17:55.028881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.046 [2024-11-27 21:17:55.028986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.046 [2024-11-27 21:17:55.029014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.046 [2024-11-27 21:17:55.029029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.046 [2024-11-27 21:17:55.029043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.046 [2024-11-27 21:17:55.029074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.046 qpair failed and we were unable to recover it. 00:27:59.046 [2024-11-27 21:17:55.038931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.046 [2024-11-27 21:17:55.039028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.046 [2024-11-27 21:17:55.039055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.046 [2024-11-27 21:17:55.039071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.046 [2024-11-27 21:17:55.039084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.046 [2024-11-27 21:17:55.039128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.046 qpair failed and we were unable to recover it. 00:27:59.046 [2024-11-27 21:17:55.048979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.046 [2024-11-27 21:17:55.049115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.046 [2024-11-27 21:17:55.049144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.046 [2024-11-27 21:17:55.049159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.046 [2024-11-27 21:17:55.049172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.046 [2024-11-27 21:17:55.049203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.046 qpair failed and we were unable to recover it. 00:27:59.046 [2024-11-27 21:17:55.058980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.046 [2024-11-27 21:17:55.059083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.046 [2024-11-27 21:17:55.059113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.046 [2024-11-27 21:17:55.059129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.046 [2024-11-27 21:17:55.059142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.059174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.069062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.069166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.069192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.069207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.069221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.069252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.079043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.079164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.079189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.079204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.079217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.079247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.089032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.089159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.089187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.089207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.089221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.089252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.099059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.099158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.099184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.099198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.099212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.099242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.109108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.109225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.109251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.109266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.109280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.109310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.119210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.119327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.119353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.119368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.119381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.119412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.129201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.129300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.129325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.129341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.129354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.129397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.139203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.139311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.139339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.139354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.139368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.139399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.149324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.149425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.149452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.047 [2024-11-27 21:17:55.149467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.047 [2024-11-27 21:17:55.149480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.047 [2024-11-27 21:17:55.149511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.047 qpair failed and we were unable to recover it. 00:27:59.047 [2024-11-27 21:17:55.159295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.047 [2024-11-27 21:17:55.159430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.047 [2024-11-27 21:17:55.159458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.159473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.159486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.159538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.169275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.169376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.169402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.169417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.169430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.169461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.179305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.179403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.179435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.179452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.179467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.179497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.189341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.189439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.189465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.189480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.189493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.189531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.199357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.199454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.199480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.199495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.199508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.199547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.209382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.209486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.209513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.209535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.209552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.209582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.219409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.219505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.219540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.219557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.219572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.219601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.229458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.229566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.229594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.229609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.229622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.229652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.239498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.239608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.239635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.239650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.239663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.239694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.249596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.249696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.249726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.048 [2024-11-27 21:17:55.249743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.048 [2024-11-27 21:17:55.249757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.048 [2024-11-27 21:17:55.249789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.048 qpair failed and we were unable to recover it. 00:27:59.048 [2024-11-27 21:17:55.259581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.048 [2024-11-27 21:17:55.259675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.048 [2024-11-27 21:17:55.259702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.049 [2024-11-27 21:17:55.259717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.049 [2024-11-27 21:17:55.259730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.049 [2024-11-27 21:17:55.259761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.049 qpair failed and we were unable to recover it. 00:27:59.049 [2024-11-27 21:17:55.269595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.049 [2024-11-27 21:17:55.269699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.049 [2024-11-27 21:17:55.269731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.049 [2024-11-27 21:17:55.269747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.049 [2024-11-27 21:17:55.269761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.049 [2024-11-27 21:17:55.269792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.049 qpair failed and we were unable to recover it. 00:27:59.049 [2024-11-27 21:17:55.279627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.049 [2024-11-27 21:17:55.279750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.049 [2024-11-27 21:17:55.279777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.049 [2024-11-27 21:17:55.279792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.049 [2024-11-27 21:17:55.279805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.049 [2024-11-27 21:17:55.279836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.049 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.289639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.289733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.289762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.289778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.289793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.289824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.299688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.299788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.299817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.299832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.299846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.299878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.309732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.309844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.309872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.309887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.309899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.309937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.319723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.319830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.319858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.319873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.319886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.319917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.329756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.329853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.329880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.329895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.329908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.329938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.339800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.339924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.339951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.339967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.339979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.340010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.349857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.349974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.350000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.350015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.350028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.350058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.359844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.359938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.359971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.359987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.360000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.360042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.369956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.370047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.370073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.370088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.370103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.370133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.379883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.379977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.380003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.380018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.380031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.308 [2024-11-27 21:17:55.380063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.308 qpair failed and we were unable to recover it. 00:27:59.308 [2024-11-27 21:17:55.389939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.308 [2024-11-27 21:17:55.390042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.308 [2024-11-27 21:17:55.390068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.308 [2024-11-27 21:17:55.390083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.308 [2024-11-27 21:17:55.390098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.390129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.400031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.400133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.400159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.400175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.400195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.400226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.409976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.410070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.410097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.410112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.410127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.410157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.420081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.420178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.420205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.420221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.420235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.420265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.430131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.430231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.430259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.430274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.430289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.430318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.440061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.440160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.440187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.440202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.440216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.440246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.450155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.450263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.450290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.450305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.450318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.450348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.460161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.460267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.460294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.460310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.460323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.460354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.470159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.470260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.470286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.470302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.470316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.470346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.480207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.480317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.480346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.480362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.480374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.480407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.490217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.490320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.490348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.490363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.490383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.490415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.500254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.500358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.500386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.500401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.500413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.500456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.510279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.510402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.510430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.510444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.510457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.510488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.520282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.309 [2024-11-27 21:17:55.520386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.309 [2024-11-27 21:17:55.520414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.309 [2024-11-27 21:17:55.520429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.309 [2024-11-27 21:17:55.520442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.309 [2024-11-27 21:17:55.520473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.309 qpair failed and we were unable to recover it. 00:27:59.309 [2024-11-27 21:17:55.530330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.310 [2024-11-27 21:17:55.530453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.310 [2024-11-27 21:17:55.530480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.310 [2024-11-27 21:17:55.530495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.310 [2024-11-27 21:17:55.530508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.310 [2024-11-27 21:17:55.530547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.310 [2024-11-27 21:17:55.540375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.310 [2024-11-27 21:17:55.540476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.310 [2024-11-27 21:17:55.540503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.310 [2024-11-27 21:17:55.540518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.310 [2024-11-27 21:17:55.540538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.310 [2024-11-27 21:17:55.540570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.310 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.550496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.550613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.550644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.550660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.550675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.550706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.560435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.560545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.560575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.560590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.560603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.560635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.570450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.570570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.570598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.570613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.570627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.570659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.580540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.580682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.580709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.580731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.580746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.580776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.590594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.590695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.590722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.590737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.590751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.590782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.600550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.600672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.600700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.600715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.600727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.600758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.610615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.610734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.610761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.610776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.610789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.610820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.620585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.620681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.620707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.620723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.620736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.620767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.630640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.630741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.630768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.630782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.630795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.630827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.640649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.640746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.640774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.640789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.569 [2024-11-27 21:17:55.640802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.569 [2024-11-27 21:17:55.640834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.569 qpair failed and we were unable to recover it. 00:27:59.569 [2024-11-27 21:17:55.650678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.569 [2024-11-27 21:17:55.650771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.569 [2024-11-27 21:17:55.650796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.569 [2024-11-27 21:17:55.650811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.650823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.650851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.660720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.660818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.660845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.660859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.660872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.660902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.670763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.670861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.670887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.670908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.670923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.670953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.680856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.680958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.680986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.681000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.681014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.681044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.690810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.690905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.690932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.690948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.690962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.690991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.700859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.700957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.700986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.701001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.701015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.701058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.710871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.710969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.710995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.711010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.711022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.711053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.721023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.721150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.721177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.721193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.721205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.721236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.730948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.731049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.731076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.731091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.731104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.731134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.740949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.741041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.741067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.741082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.741095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.741125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.750998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.751123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.751150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.751165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.751178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.751232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.761056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.761164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.761199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.761216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.761231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.761262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.771040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.771142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.771169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.771184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.771199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.771229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.570 [2024-11-27 21:17:55.781105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.570 [2024-11-27 21:17:55.781215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.570 [2024-11-27 21:17:55.781242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.570 [2024-11-27 21:17:55.781258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.570 [2024-11-27 21:17:55.781272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.570 [2024-11-27 21:17:55.781301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.570 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-27 21:17:55.791159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.571 [2024-11-27 21:17:55.791268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.571 [2024-11-27 21:17:55.791295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.571 [2024-11-27 21:17:55.791310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.571 [2024-11-27 21:17:55.791325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.571 [2024-11-27 21:17:55.791367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.571 [2024-11-27 21:17:55.801132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.571 [2024-11-27 21:17:55.801235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.571 [2024-11-27 21:17:55.801262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.571 [2024-11-27 21:17:55.801277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.571 [2024-11-27 21:17:55.801291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.571 [2024-11-27 21:17:55.801328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.571 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.811221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.811332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.811362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.811378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.811393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.830 [2024-11-27 21:17:55.811424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.821210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.821334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.821363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.821380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.821395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.830 [2024-11-27 21:17:55.821426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.831326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.831461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.831520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.831545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.831559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:27:59.830 [2024-11-27 21:17:55.831604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.841256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.841371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.841404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.841420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.841434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.830 [2024-11-27 21:17:55.841465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.851335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.851439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.851472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.851488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.851501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.830 [2024-11-27 21:17:55.851544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.861287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.861389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.861416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.861430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.861444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.830 [2024-11-27 21:17:55.861473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.871355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.871471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.871498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.871519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.871542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.830 [2024-11-27 21:17:55.871574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.881369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.830 [2024-11-27 21:17:55.881491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.830 [2024-11-27 21:17:55.881520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.830 [2024-11-27 21:17:55.881544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.830 [2024-11-27 21:17:55.881559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.830 [2024-11-27 21:17:55.881588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.830 qpair failed and we were unable to recover it. 00:27:59.830 [2024-11-27 21:17:55.891498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.891603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.891628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.891644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.891657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.891692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.901433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.901556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.901583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.901598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.901615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.901645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.911487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.911648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.911675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.911689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.911702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.911732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.921491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.921612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.921638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.921653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.921667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.921696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.931517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.931632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.931658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.931673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.931687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.931716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.941517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.941623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.941654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.941669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.941683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.941712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.951612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.951749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.951776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.951791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.951805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.951834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.961674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.961781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.961807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.961821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.961835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.961864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.971685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.971786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.971811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.971826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.971840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.971884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.981673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.981777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.981803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.981817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.981831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.981866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:55.991700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:55.991806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:55.991833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:55.991847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:55.991861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:55.991890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:56.001748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:56.001853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:56.001879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:56.001894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:56.001908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:56.001937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:56.011758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:56.011874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.831 [2024-11-27 21:17:56.011901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.831 [2024-11-27 21:17:56.011916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.831 [2024-11-27 21:17:56.011930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.831 [2024-11-27 21:17:56.011959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.831 qpair failed and we were unable to recover it. 00:27:59.831 [2024-11-27 21:17:56.021779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.831 [2024-11-27 21:17:56.021880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.832 [2024-11-27 21:17:56.021906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.832 [2024-11-27 21:17:56.021921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.832 [2024-11-27 21:17:56.021935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.832 [2024-11-27 21:17:56.021964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.832 qpair failed and we were unable to recover it. 00:27:59.832 [2024-11-27 21:17:56.031802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.832 [2024-11-27 21:17:56.031911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.832 [2024-11-27 21:17:56.031942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.832 [2024-11-27 21:17:56.031958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.832 [2024-11-27 21:17:56.031972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.832 [2024-11-27 21:17:56.032001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.832 qpair failed and we were unable to recover it. 00:27:59.832 [2024-11-27 21:17:56.041834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.832 [2024-11-27 21:17:56.041934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.832 [2024-11-27 21:17:56.041960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.832 [2024-11-27 21:17:56.041975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.832 [2024-11-27 21:17:56.041989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.832 [2024-11-27 21:17:56.042018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.832 qpair failed and we were unable to recover it. 00:27:59.832 [2024-11-27 21:17:56.051892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.832 [2024-11-27 21:17:56.051996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.832 [2024-11-27 21:17:56.052022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.832 [2024-11-27 21:17:56.052037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.832 [2024-11-27 21:17:56.052050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.832 [2024-11-27 21:17:56.052079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.832 qpair failed and we were unable to recover it. 00:27:59.832 [2024-11-27 21:17:56.061909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.832 [2024-11-27 21:17:56.062003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.832 [2024-11-27 21:17:56.062027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.832 [2024-11-27 21:17:56.062042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.832 [2024-11-27 21:17:56.062055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:27:59.832 [2024-11-27 21:17:56.062083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.832 qpair failed and we were unable to recover it. 00:28:00.091 [2024-11-27 21:17:56.071929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.072032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.072057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.072071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.072090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.072119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.081957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.082076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.082101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.082116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.082129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.082159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.092100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.092205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.092230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.092244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.092257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.092301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.102037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.102170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.102197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.102212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.102225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.102254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.112083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.112191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.112215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.112228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.112241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.112270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.122144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.122290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.122317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.122333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.122346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.122376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.132099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.132195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.132219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.132233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.132245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.132274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.142136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.142233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.142261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.142277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.142290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.142320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.152167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.152271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.152297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.152312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.152325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.152353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.162167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.162268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.162292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.162306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.162328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.162358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.172212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.172362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.172389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.172404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.172417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.172446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.182225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.182320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.182344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.182359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.182371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.182400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.192365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.192473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.092 [2024-11-27 21:17:56.192498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.092 [2024-11-27 21:17:56.192512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.092 [2024-11-27 21:17:56.192533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.092 [2024-11-27 21:17:56.192564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.092 qpair failed and we were unable to recover it. 00:28:00.092 [2024-11-27 21:17:56.202281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.092 [2024-11-27 21:17:56.202383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.202407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.202421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.202434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.202463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.212310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.212420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.212445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.212460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.212473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.212502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.222353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.222447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.222472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.222486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.222499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.222535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.232466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.232575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.232600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.232615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.232628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.232657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.242395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.242495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.242520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.242543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.242556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.242585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.252400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.252497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.252521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.252544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.252562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.252592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.262429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.262520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.262555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.262570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.262583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.262611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.272491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.272610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.272636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.272651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.272664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.272693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.282543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.282661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.282686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.282701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.282714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.282743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.292520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.292624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.292648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.292662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.292675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.292704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.302565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.302663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.302688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.302702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.302715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.302744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.312578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.312679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.312703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.312717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.312730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.312758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.093 [2024-11-27 21:17:56.322639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.093 [2024-11-27 21:17:56.322788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.093 [2024-11-27 21:17:56.322815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.093 [2024-11-27 21:17:56.322830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.093 [2024-11-27 21:17:56.322843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.093 [2024-11-27 21:17:56.322871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.093 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.332656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.332758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.332782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.332797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.332810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.332839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.342670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.342764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.342788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.342802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.342820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.342850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.352709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.352817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.352842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.352856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.352869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.352898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.362800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.362918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.362943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.362957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.362970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.363000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.372834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.372929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.372954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.372968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.372981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.373010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.382833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.382935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.382960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.382974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.382987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.383016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.392830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.392942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.392970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.392986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.393000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.393030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.402849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.402949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.402974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.402989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.403003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.403033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.412908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.413011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.413035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.413050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.413063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.413092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.422930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.423028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.423052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.423066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.423080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.423109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.353 [2024-11-27 21:17:56.432976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.353 [2024-11-27 21:17:56.433099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.353 [2024-11-27 21:17:56.433123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.353 [2024-11-27 21:17:56.433138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.353 [2024-11-27 21:17:56.433156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.353 [2024-11-27 21:17:56.433186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.353 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.442987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.443080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.443106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.443121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.443134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.443163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.452994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.453101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.453128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.453143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.453156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.453185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.463024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.463118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.463146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.463162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.463175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.463205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.473064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.473165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.473191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.473206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.473218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.473247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.483115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.483240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.483267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.483282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.483295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.483324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.493129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.493231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.493257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.493272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.493285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.493314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.503148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.503246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.503272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.503287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.503299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.503328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.513197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.513301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.513329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.513344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.513357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.513386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.523208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.523310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.523336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.523356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.523372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.523400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.533257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.533369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.533395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.533410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.533423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.533466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.543290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.543401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.543425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.543446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.543459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.543488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.553305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.553435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.553467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.553482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.553495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.553532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.563359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.563459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.563484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.354 [2024-11-27 21:17:56.563497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.354 [2024-11-27 21:17:56.563510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:00.354 [2024-11-27 21:17:56.563546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:00.354 qpair failed and we were unable to recover it. 00:28:00.354 [2024-11-27 21:17:56.573422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.354 [2024-11-27 21:17:56.573538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.354 [2024-11-27 21:17:56.573573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.355 [2024-11-27 21:17:56.573593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.355 [2024-11-27 21:17:56.573607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.355 [2024-11-27 21:17:56.573640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.355 [2024-11-27 21:17:56.583404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.355 [2024-11-27 21:17:56.583505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.355 [2024-11-27 21:17:56.583543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.355 [2024-11-27 21:17:56.583560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.355 [2024-11-27 21:17:56.583577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.355 [2024-11-27 21:17:56.583608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.355 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.593411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.593518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.593551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.593566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.593579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.593609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.603487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.603594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.603620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.603634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.603646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.603683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.613596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.613725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.613752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.613773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.613786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.613816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.623506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.623616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.623643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.623666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.623679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.623708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.633582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.633689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.633715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.633729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.633742] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.633785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.643566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.643672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.643697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.643712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.643725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.643768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.653579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.653672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.653697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.653712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.653725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.653754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.663638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.663786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.663812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.663827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.663841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.663871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.673657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.673762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.673787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.673801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.673814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.673845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.683681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.683783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.683809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.683823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.683837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.614 [2024-11-27 21:17:56.683866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.614 qpair failed and we were unable to recover it. 00:28:00.614 [2024-11-27 21:17:56.693732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.614 [2024-11-27 21:17:56.693848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.614 [2024-11-27 21:17:56.693873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.614 [2024-11-27 21:17:56.693888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.614 [2024-11-27 21:17:56.693901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.693947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.703786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.703892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.703917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.703937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.703951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.703981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.713904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.714000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.714025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.714040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.714052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.714081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.723790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.723936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.723963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.723978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.723992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.724022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.733816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.733912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.733936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.733951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.733964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.733993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.743864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.743959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.743983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.743998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.744011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.744053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.753891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.753991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.754015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.754029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.754042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.754083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.763925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.764024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.764051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.764066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.764079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.764113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.773932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.774031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.774056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.774070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.774083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.774113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.783957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.784058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.784082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.784096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.784109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.784139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.794040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.794143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.794173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.794188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.794201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.794231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.804017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.804133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.804158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.804172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.804185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.804228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.814082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.814185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.814213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.814228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.814241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.615 [2024-11-27 21:17:56.814273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.615 qpair failed and we were unable to recover it. 00:28:00.615 [2024-11-27 21:17:56.824090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.615 [2024-11-27 21:17:56.824191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.615 [2024-11-27 21:17:56.824216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.615 [2024-11-27 21:17:56.824232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.615 [2024-11-27 21:17:56.824245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.616 [2024-11-27 21:17:56.824287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-27 21:17:56.834116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.616 [2024-11-27 21:17:56.834218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.616 [2024-11-27 21:17:56.834242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.616 [2024-11-27 21:17:56.834256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.616 [2024-11-27 21:17:56.834268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.616 [2024-11-27 21:17:56.834305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.616 [2024-11-27 21:17:56.844150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.616 [2024-11-27 21:17:56.844250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.616 [2024-11-27 21:17:56.844275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.616 [2024-11-27 21:17:56.844289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.616 [2024-11-27 21:17:56.844302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.616 [2024-11-27 21:17:56.844332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.616 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.854160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.854264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.854288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.854303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.854317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.854347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.864204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.864302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.864326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.864341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.864354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.864384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.874222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.874325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.874350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.874364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.874377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.874406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.884268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.884370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.884403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.884419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.884432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.884463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.894371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.894471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.894498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.894513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.894533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.894564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.904300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.904392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.904418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.904433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.904447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.904477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.914371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.914487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.914513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.914539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.914556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.914586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.924400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.924511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.924546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.924572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.924591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.924623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.934389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.934485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.934509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.934531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.934545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.934576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.944485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.944626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.944653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.944668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.944682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.944712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.954483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.954605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.954632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.954646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.875 [2024-11-27 21:17:56.954660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.875 [2024-11-27 21:17:56.954692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.875 qpair failed and we were unable to recover it. 00:28:00.875 [2024-11-27 21:17:56.964493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.875 [2024-11-27 21:17:56.964629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.875 [2024-11-27 21:17:56.964656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.875 [2024-11-27 21:17:56.964671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:56.964684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:56.964715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:56.974603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:56.974742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:56.974768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:56.974783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:56.974796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:56.974827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:56.984560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:56.984661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:56.984687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:56.984702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:56.984717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:56.984747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:56.994626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:56.994732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:56.994757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:56.994772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:56.994784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:56.994818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.004621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.004743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.004770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.004784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.004798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.004828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.014668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.014802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.014832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.014847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.014870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.014902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.024678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.024768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.024793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.024807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.024820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.024850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.034762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.034873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.034901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.034917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.034930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.034961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.044736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.044849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.044874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.044889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.044903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.044933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.054747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.054844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.054868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.054882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.054894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.054924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.064883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.064992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.065018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.065033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.065047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.065077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.074814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.074925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.074952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.074967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.074979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.075011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.084831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.084952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.084978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.084993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.085006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.085037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.094864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.876 [2024-11-27 21:17:57.094962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.876 [2024-11-27 21:17:57.094988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.876 [2024-11-27 21:17:57.095004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.876 [2024-11-27 21:17:57.095017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.876 [2024-11-27 21:17:57.095047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.876 qpair failed and we were unable to recover it. 00:28:00.876 [2024-11-27 21:17:57.104998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.877 [2024-11-27 21:17:57.105131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.877 [2024-11-27 21:17:57.105157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.877 [2024-11-27 21:17:57.105178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.877 [2024-11-27 21:17:57.105192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:00.877 [2024-11-27 21:17:57.105222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:00.877 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.114910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.115003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.115029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.115043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.115056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.115087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.125052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.125190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.125217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.125232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.125244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.125274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.135011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.135115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.135141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.135156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.135171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.135200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.145019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.145124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.145153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.145169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.145182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.145213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.155027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.155164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.155190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.155205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.155218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.155248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.165089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.165195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.165221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.165236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.165249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.165280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.175091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.175195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.175221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.175235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.175248] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.175279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.185124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.185231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.185257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.185272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.185285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.185315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.195236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.195383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.195409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.195430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.195444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.195475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.205204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.205332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.205358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.205373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.205387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.205417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.215221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.215328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.215354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.215368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.215382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.215413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.225257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.136 [2024-11-27 21:17:57.225370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.136 [2024-11-27 21:17:57.225396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.136 [2024-11-27 21:17:57.225411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.136 [2024-11-27 21:17:57.225425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.136 [2024-11-27 21:17:57.225454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.136 qpair failed and we were unable to recover it. 00:28:01.136 [2024-11-27 21:17:57.235301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.235430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.235456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.235471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.235485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.235515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.245333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.245435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.245461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.245476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.245490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.245519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.255389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.255488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.255513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.255535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.255550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.255580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.265437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.265584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.265610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.265625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.265639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.265669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.275380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.275493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.275519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.275545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.275560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.275590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.285505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.285623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.285655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.285671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.285685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.285715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.295441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.295557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.295583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.295598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.295612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.295643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.305548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.305651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.305676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.305691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.305705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.305735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.315511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.315638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.315664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.315679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.315693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.315723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.325547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.325660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.325686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.325700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.325713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.325750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.335575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.335692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.335718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.335733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.335747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.335778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.345575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.345682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.345708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.345723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.345737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.345767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.355641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.355749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.355775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.137 [2024-11-27 21:17:57.355789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.137 [2024-11-27 21:17:57.355802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.137 [2024-11-27 21:17:57.355832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.137 qpair failed and we were unable to recover it. 00:28:01.137 [2024-11-27 21:17:57.365678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.137 [2024-11-27 21:17:57.365795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.137 [2024-11-27 21:17:57.365823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.138 [2024-11-27 21:17:57.365839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.138 [2024-11-27 21:17:57.365853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.138 [2024-11-27 21:17:57.365884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.138 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.375680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.375781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.375812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.375828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.375841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.375884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.385705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.385811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.385838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.385853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.385866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.385896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.395852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.395985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.396013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.396028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.396042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.396072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.405787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.405890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.405916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.405930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.405944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.405974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.415819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.415923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.415949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.415964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.415977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.416014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.425868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.425969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.425994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.426009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.426023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.426052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.435922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.436062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.436088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.436102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.436116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.436146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.445890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.445993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.446019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.446033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.446047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.446077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.455925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.456055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.456081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.456095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.456110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.456139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.466075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.466188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.466214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.466229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.466243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.466273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.476001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.476120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.476146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.476161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.476174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.476205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.397 qpair failed and we were unable to recover it. 00:28:01.397 [2024-11-27 21:17:57.486168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.397 [2024-11-27 21:17:57.486302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.397 [2024-11-27 21:17:57.486328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.397 [2024-11-27 21:17:57.486343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.397 [2024-11-27 21:17:57.486357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.397 [2024-11-27 21:17:57.486386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.496072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.496172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.496198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.496212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.496226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.496256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.506075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.506215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.506241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.506256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.506273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.506316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.516233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.516333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.516359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.516374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.516388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.516418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.526154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.526252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.526282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.526298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.526311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.526341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.536193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.536339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.536366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.536381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.536395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.536425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.546235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.546347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.546373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.546388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.546402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.546432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.556341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.556452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.556481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.556496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.556511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.556551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.566361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.566469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.566495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.566510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.566533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.566567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.576307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.576426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.576453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.576468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.576482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.576523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.586392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.586494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.586520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.586542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.586556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.586586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.596447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.596560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.596587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.596607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.596622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.596651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.606400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.606516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.606553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.606569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.606584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.606618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.616420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.616553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.398 [2024-11-27 21:17:57.616581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.398 [2024-11-27 21:17:57.616596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.398 [2024-11-27 21:17:57.616610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.398 [2024-11-27 21:17:57.616640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.398 qpair failed and we were unable to recover it. 00:28:01.398 [2024-11-27 21:17:57.626448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.398 [2024-11-27 21:17:57.626597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.399 [2024-11-27 21:17:57.626623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.399 [2024-11-27 21:17:57.626638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.399 [2024-11-27 21:17:57.626652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.399 [2024-11-27 21:17:57.626683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.399 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.636471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.636584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.636609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.636625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.636639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.636672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.646483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.646618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.646645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.646659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.646672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.646702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.656489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.656626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.656650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.656664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.656676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.656705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.666558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.666661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.666686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.666701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.666714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.666756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.676585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.676704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.676730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.676744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.676757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.676787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.686669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.686775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.686801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.686822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.686838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.686868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.696649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.696743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.696769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.696783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.696796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.696837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.706671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.706768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.706797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.706812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.706824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.706855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.716690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.716816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.716842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.716856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.716869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.716899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.726696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.726825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.726850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.726864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.726888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.726917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.736752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.736856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.736882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.736897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.736910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.658 [2024-11-27 21:17:57.736939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.658 qpair failed and we were unable to recover it. 00:28:01.658 [2024-11-27 21:17:57.746793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.658 [2024-11-27 21:17:57.746917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.658 [2024-11-27 21:17:57.746943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.658 [2024-11-27 21:17:57.746957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.658 [2024-11-27 21:17:57.746970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.747000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.756836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.756971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.756996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.757011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.757024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.757053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.766814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.766959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.766984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.766998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.767012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.767041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.776878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.776993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.777037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.777053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.777066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.777098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.786869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.787003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.787027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.787041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.787054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.787084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.797009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.797111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.797138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.797152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.797164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.797194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.806972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.807070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.807095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.807109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.807122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.807150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.816952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.817044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.817070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.817084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.817097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.817143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.827055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.827191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.827216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.827229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.827242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.827272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.837029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.837160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.837185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.837198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.837211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.837240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.847071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.847182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.847210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.847225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.847241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.847274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.857068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.857164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.857190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.857204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.857216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.857245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.867137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.867247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.867281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.867297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.867310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.867340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.877238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.659 [2024-11-27 21:17:57.877339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.659 [2024-11-27 21:17:57.877365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.659 [2024-11-27 21:17:57.877378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.659 [2024-11-27 21:17:57.877391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.659 [2024-11-27 21:17:57.877422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.659 qpair failed and we were unable to recover it. 00:28:01.659 [2024-11-27 21:17:57.887230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.660 [2024-11-27 21:17:57.887340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.660 [2024-11-27 21:17:57.887366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.660 [2024-11-27 21:17:57.887381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.660 [2024-11-27 21:17:57.887393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.660 [2024-11-27 21:17:57.887422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.660 qpair failed and we were unable to recover it. 00:28:01.660 [2024-11-27 21:17:57.897209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.660 [2024-11-27 21:17:57.897329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.660 [2024-11-27 21:17:57.897355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.660 [2024-11-27 21:17:57.897368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.660 [2024-11-27 21:17:57.897381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.660 [2024-11-27 21:17:57.897410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.907248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.907345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.907371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.907384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.907397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.907433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.917289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.917411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.917437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.917450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.917462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.917492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.927327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.927419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.927444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.927458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.927470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.927499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.937275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.937377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.937403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.937417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.937430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.937458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.947324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.947424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.947449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.947463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.947476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.947505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.957377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.957479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.957509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.957533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.957549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.957578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.967377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.967476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.967501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.967515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.967536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.967569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.977401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.919 [2024-11-27 21:17:57.977499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.919 [2024-11-27 21:17:57.977531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.919 [2024-11-27 21:17:57.977548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.919 [2024-11-27 21:17:57.977561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.919 [2024-11-27 21:17:57.977592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.919 qpair failed and we were unable to recover it. 00:28:01.919 [2024-11-27 21:17:57.987443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:57.987548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:57.987573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:57.987588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:57.987600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:57.987642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:57.997496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:57.997603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:57.997632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:57.997647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:57.997665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:57.997696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.007489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.007590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.007616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.007631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.007643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.007674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.017520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.017630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.017655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.017668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.017681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.017711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.027562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.027655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.027680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.027694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.027708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.027738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.037594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.037694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.037719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.037733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.037746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.037775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.047599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.047703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.047728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.047742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.047755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.047784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.057662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.057760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.057785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.057799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.057812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.057842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.067645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.067740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.067766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.067779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.067793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.067822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.077724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.077832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.077858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.077871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.077883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.077913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.087761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.087882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.087908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.087922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.087940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.087971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.097743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.097840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.097866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.097880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.097892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.097922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.107762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.107894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.107919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.107933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.920 [2024-11-27 21:17:58.107946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.920 [2024-11-27 21:17:58.107975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.920 qpair failed and we were unable to recover it. 00:28:01.920 [2024-11-27 21:17:58.117826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.920 [2024-11-27 21:17:58.117968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.920 [2024-11-27 21:17:58.117993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.920 [2024-11-27 21:17:58.118007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.921 [2024-11-27 21:17:58.118020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.921 [2024-11-27 21:17:58.118049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.921 qpair failed and we were unable to recover it. 00:28:01.921 [2024-11-27 21:17:58.127912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.921 [2024-11-27 21:17:58.128057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.921 [2024-11-27 21:17:58.128082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.921 [2024-11-27 21:17:58.128097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.921 [2024-11-27 21:17:58.128110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.921 [2024-11-27 21:17:58.128139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.921 qpair failed and we were unable to recover it. 00:28:01.921 [2024-11-27 21:17:58.137937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.921 [2024-11-27 21:17:58.138062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.921 [2024-11-27 21:17:58.138087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.921 [2024-11-27 21:17:58.138102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.921 [2024-11-27 21:17:58.138115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.921 [2024-11-27 21:17:58.138144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.921 qpair failed and we were unable to recover it. 00:28:01.921 [2024-11-27 21:17:58.147879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.921 [2024-11-27 21:17:58.148020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.921 [2024-11-27 21:17:58.148045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.921 [2024-11-27 21:17:58.148059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.921 [2024-11-27 21:17:58.148073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.921 [2024-11-27 21:17:58.148101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.921 qpair failed and we were unable to recover it. 00:28:01.921 [2024-11-27 21:17:58.157944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.921 [2024-11-27 21:17:58.158087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.921 [2024-11-27 21:17:58.158112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.921 [2024-11-27 21:17:58.158126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.921 [2024-11-27 21:17:58.158138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:01.921 [2024-11-27 21:17:58.158168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.921 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.167994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.168101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.168126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.168139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.168152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.168183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.177966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.178058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.178083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.178103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.178116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.178145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.188019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.188116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.188141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.188155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.188168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.188198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.198109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.198227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.198252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.198265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.198279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.198308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.208100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.208202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.208227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.208241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.208254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.208284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.218133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.218248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.218277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.218292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.218305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.218335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.228165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.228262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.228288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.228303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.228316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.228345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.238227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.238336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.238363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.238383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.238397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.238427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.248177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.248272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.248298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.248312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.248325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.248355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.258211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.180 [2024-11-27 21:17:58.258302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.180 [2024-11-27 21:17:58.258328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.180 [2024-11-27 21:17:58.258342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.180 [2024-11-27 21:17:58.258354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.180 [2024-11-27 21:17:58.258385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.180 qpair failed and we were unable to recover it. 00:28:02.180 [2024-11-27 21:17:58.268276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.268398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.268429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.268444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.268457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.268486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.278296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.278399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.278423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.278437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.278449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.278480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.288401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.288501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.288533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.288549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.288562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.288591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.298346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.298487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.298512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.298533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.298548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.298578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.308392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.308488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.308514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.308536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.308551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.308580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.318389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.318518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.318550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.318564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.318576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.318607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.328431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.328550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.328579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.328594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.328607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.328637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.338459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.338563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.338589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.338603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.338616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.338646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.348521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.348650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.348675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.348689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.348702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.348732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.358590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.358689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.358719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.358734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.358747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.358776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.368564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.368697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.368722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.368736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.368750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.368779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.378581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.378715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.378740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.378754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.378767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.378796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.388652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.388771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.388796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.388811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.181 [2024-11-27 21:17:58.388823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.181 [2024-11-27 21:17:58.388864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.181 qpair failed and we were unable to recover it. 00:28:02.181 [2024-11-27 21:17:58.398671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.181 [2024-11-27 21:17:58.398775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.181 [2024-11-27 21:17:58.398800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.181 [2024-11-27 21:17:58.398814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.182 [2024-11-27 21:17:58.398827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.182 [2024-11-27 21:17:58.398862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-27 21:17:58.408673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.182 [2024-11-27 21:17:58.408771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.182 [2024-11-27 21:17:58.408796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.182 [2024-11-27 21:17:58.408810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.182 [2024-11-27 21:17:58.408822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.182 [2024-11-27 21:17:58.408851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.182 [2024-11-27 21:17:58.418720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.182 [2024-11-27 21:17:58.418815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.182 [2024-11-27 21:17:58.418844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.182 [2024-11-27 21:17:58.418859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.182 [2024-11-27 21:17:58.418872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.182 [2024-11-27 21:17:58.418901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.182 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.428773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.428879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.428904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.428918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.428931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.428960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.438894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.438997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.439023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.439037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.439049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.439080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.448957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.449088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.449120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.449136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.449153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.449184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.458851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.458975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.459000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.459014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.459027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.459056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.468860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.468955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.468980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.468994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.469006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.469036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.478911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.479042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.479067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.479081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.479094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.479136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.489000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.489097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.489122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.489136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.489157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.489189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.498977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.499066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.499091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.499105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.499118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.499148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.509012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.509106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.509132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.509145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.509157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.509185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.519056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.519162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.519188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.519202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.519214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.519257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.529057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.529178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.529204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.529218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.441 [2024-11-27 21:17:58.529230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.441 [2024-11-27 21:17:58.529259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-27 21:17:58.539098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.441 [2024-11-27 21:17:58.539206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.441 [2024-11-27 21:17:58.539231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.441 [2024-11-27 21:17:58.539245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.539258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.539287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.549106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.549223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.549249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.549263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.549275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.549305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.559129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.559238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.559264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.559278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.559290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.559320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.569187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.569295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.569321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.569336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.569348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.569389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.579232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.579350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.579376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.579390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.579409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.579439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.589221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.589321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.589346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.589360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.589372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.589402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.599295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.599400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.599425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.599439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.599452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.599482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.609300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.609419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.609445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.609459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.609472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.609514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.619309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.619401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.619427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.619440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.619453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.619483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.629342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.629438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.629463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.629476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.629488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.629518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.639375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.639474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.639500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.639514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.639533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.639580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.649422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.649538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.649565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.649580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.649597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.649629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.659434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.659536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.659561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.659574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.659587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.659616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.669471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.442 [2024-11-27 21:17:58.669578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.442 [2024-11-27 21:17:58.669606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.442 [2024-11-27 21:17:58.669627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.442 [2024-11-27 21:17:58.669640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.442 [2024-11-27 21:17:58.669682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-27 21:17:58.679608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.443 [2024-11-27 21:17:58.679711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.443 [2024-11-27 21:17:58.679736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.443 [2024-11-27 21:17:58.679750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.443 [2024-11-27 21:17:58.679762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.443 [2024-11-27 21:17:58.679792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.689551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.689660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.689689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.689705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.689717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.689747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.699596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.699743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.699768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.699782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.699795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.699826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.709616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.709727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.709753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.709766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.709780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.709822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.719640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.719751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.719776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.719790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.719803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.719834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.729737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.729880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.729906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.729920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.729933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.729962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.739724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.739823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.739848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.739863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.739875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.739905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.749729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.749825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.749851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.749865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.749878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.749907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.759743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.759839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.759864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.759884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.759898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.759928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.769762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.769867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.769893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.769907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.769920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.769949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.779801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.779903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.779928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.779942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.779955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.779985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.789792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.702 [2024-11-27 21:17:58.789887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.702 [2024-11-27 21:17:58.789913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.702 [2024-11-27 21:17:58.789927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.702 [2024-11-27 21:17:58.789940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.702 [2024-11-27 21:17:58.789970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.702 qpair failed and we were unable to recover it. 00:28:02.702 [2024-11-27 21:17:58.799897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.800003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.800029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.800043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.800056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.800085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.809913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.810014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.810039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.810054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.810066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.810096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.819944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.820042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.820066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.820080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.820093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.820123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.829934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.830034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.830059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.830073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.830085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.830115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.840015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.840116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.840142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.840155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.840169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.840199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.850024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.850127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.850158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.850173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.850186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.850214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.860055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.860155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.860180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.860194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.860206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.860236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.870069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.870180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.870205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.870220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.870232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.870261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.880115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.880218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.880243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.880257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.880269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.880298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.890148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.890270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.890295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.890309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.890322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.890357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.900163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.900265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.900291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.900304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.900317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.900358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.910172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.910267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.910294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.910308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.910320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.910363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.920194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.920299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.920325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.920339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.703 [2024-11-27 21:17:58.920351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.703 [2024-11-27 21:17:58.920382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.703 qpair failed and we were unable to recover it. 00:28:02.703 [2024-11-27 21:17:58.930248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.703 [2024-11-27 21:17:58.930349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.703 [2024-11-27 21:17:58.930374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.703 [2024-11-27 21:17:58.930388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.704 [2024-11-27 21:17:58.930400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.704 [2024-11-27 21:17:58.930429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.704 qpair failed and we were unable to recover it. 00:28:02.704 [2024-11-27 21:17:58.940285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.704 [2024-11-27 21:17:58.940408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.704 [2024-11-27 21:17:58.940439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.704 [2024-11-27 21:17:58.940454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.704 [2024-11-27 21:17:58.940467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.704 [2024-11-27 21:17:58.940495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.704 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:58.950276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:58.950409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:58.950434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:58.950448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:58.950460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:58.950490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:58.960325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:58.960424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:58.960449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:58.960463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:58.960476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:58.960505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:58.970353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:58.970486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:58.970511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:58.970533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:58.970548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:58.970577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:58.980454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:58.980560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:58.980585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:58.980599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:58.980612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:58.980647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:58.990406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:58.990506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:58.990542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:58.990558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:58.990571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:58.990600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.000448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.000555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.000581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.000596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.000609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.000652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.010442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.010556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.010585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.010599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.010612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.010641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.020509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.020619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.020645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.020659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.020672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.020702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.030542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.030656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.030682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.030696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.030708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.030737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.040689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.040791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.040817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.040831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.040844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.040874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.050599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.050708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.050733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.050747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.050760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.050791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.060643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.060747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.963 [2024-11-27 21:17:59.060773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.963 [2024-11-27 21:17:59.060787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.963 [2024-11-27 21:17:59.060800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.963 [2024-11-27 21:17:59.060842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.963 qpair failed and we were unable to recover it. 00:28:02.963 [2024-11-27 21:17:59.070625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.963 [2024-11-27 21:17:59.070720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.070744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.070759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.070777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.070809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.080815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.080944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.080970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.080984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.080996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.081025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.090771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.090871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.090896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.090909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.090922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.090951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.100777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.100879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.100904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.100918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.100931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.100961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.110772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.110889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.110914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.110928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.110941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.110970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.120855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.120964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.120990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.121004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.121016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.121046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.130812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.130913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.130938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.130952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.130965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.130996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.140833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.140965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.140990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.141004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.141016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.141046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.150881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.151004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.151030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.151043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.151056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.151086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.160896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.160995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.161021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.161041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.161055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.161083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.171005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.171118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.171144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.171158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.171170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.171198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.964 [2024-11-27 21:17:59.180961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.964 [2024-11-27 21:17:59.181111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.964 [2024-11-27 21:17:59.181136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.964 [2024-11-27 21:17:59.181149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.964 [2024-11-27 21:17:59.181162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.964 [2024-11-27 21:17:59.181192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.964 qpair failed and we were unable to recover it. 00:28:02.965 [2024-11-27 21:17:59.191041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.965 [2024-11-27 21:17:59.191135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.965 [2024-11-27 21:17:59.191160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.965 [2024-11-27 21:17:59.191174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.965 [2024-11-27 21:17:59.191186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.965 [2024-11-27 21:17:59.191216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.965 qpair failed and we were unable to recover it. 00:28:02.965 [2024-11-27 21:17:59.201062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:02.965 [2024-11-27 21:17:59.201163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:02.965 [2024-11-27 21:17:59.201191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:02.965 [2024-11-27 21:17:59.201206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:02.965 [2024-11-27 21:17:59.201219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:02.965 [2024-11-27 21:17:59.201248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.965 qpair failed and we were unable to recover it. 00:28:03.222 [2024-11-27 21:17:59.211078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.222 [2024-11-27 21:17:59.211180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.222 [2024-11-27 21:17:59.211206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.222 [2024-11-27 21:17:59.211221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.222 [2024-11-27 21:17:59.211234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.222 [2024-11-27 21:17:59.211264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.222 qpair failed and we were unable to recover it. 00:28:03.222 [2024-11-27 21:17:59.221141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.222 [2024-11-27 21:17:59.221259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.222 [2024-11-27 21:17:59.221285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.222 [2024-11-27 21:17:59.221299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.222 [2024-11-27 21:17:59.221312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.222 [2024-11-27 21:17:59.221342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.222 qpair failed and we were unable to recover it. 00:28:03.222 [2024-11-27 21:17:59.231156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.222 [2024-11-27 21:17:59.231262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.222 [2024-11-27 21:17:59.231288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.231302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.231315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.231344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.241270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.241403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.241428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.241442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.241455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.241484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.251194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.251328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.251353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.251373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.251387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.251416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.261204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.261317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.261344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.261358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.261377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.261409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.271237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.271333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.271359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.271374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.271387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.271417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.281287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.281388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.281413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.281428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.281441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.281471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.291315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.291425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.291449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.291464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.291477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.291506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.301314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.301405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.301430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.301444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.301457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.301486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.311339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.311433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.311459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.311473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.311485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.311516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.321389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.321487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.321513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.321534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.321548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.321590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.331417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.331553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.331579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.331593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.331606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.331637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.341463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.341567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.341598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.341614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.341626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.341656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.351453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.351554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.351580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.351594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.351606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.351636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.361586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.361686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.361712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.361727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.361739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.361768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.371581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.371688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.371717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.371731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.371744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.371775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.381562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.381659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.381687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.381702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.381715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.381750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.391598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.391701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.391726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.391740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.391752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.391782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.401644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.401751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.401777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.401790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.401803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.223 [2024-11-27 21:17:59.401832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.223 qpair failed and we were unable to recover it. 00:28:03.223 [2024-11-27 21:17:59.411640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.223 [2024-11-27 21:17:59.411781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.223 [2024-11-27 21:17:59.411806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.223 [2024-11-27 21:17:59.411820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.223 [2024-11-27 21:17:59.411832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.411862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.224 [2024-11-27 21:17:59.421686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.224 [2024-11-27 21:17:59.421812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.224 [2024-11-27 21:17:59.421837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.224 [2024-11-27 21:17:59.421851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.224 [2024-11-27 21:17:59.421864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.421894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.224 [2024-11-27 21:17:59.431850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.224 [2024-11-27 21:17:59.431953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.224 [2024-11-27 21:17:59.431984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.224 [2024-11-27 21:17:59.431999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.224 [2024-11-27 21:17:59.432011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.432041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.224 [2024-11-27 21:17:59.441739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.224 [2024-11-27 21:17:59.441835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.224 [2024-11-27 21:17:59.441860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.224 [2024-11-27 21:17:59.441874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.224 [2024-11-27 21:17:59.441887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.441917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.224 [2024-11-27 21:17:59.451793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.224 [2024-11-27 21:17:59.451893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.224 [2024-11-27 21:17:59.451918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.224 [2024-11-27 21:17:59.451932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.224 [2024-11-27 21:17:59.451945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.451973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.224 [2024-11-27 21:17:59.461786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.224 [2024-11-27 21:17:59.461913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.224 [2024-11-27 21:17:59.461939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.224 [2024-11-27 21:17:59.461952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.224 [2024-11-27 21:17:59.461965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.224 [2024-11-27 21:17:59.462010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.224 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-27 21:17:59.471824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.482 [2024-11-27 21:17:59.471962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.482 [2024-11-27 21:17:59.471987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.482 [2024-11-27 21:17:59.472000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.482 [2024-11-27 21:17:59.472014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.482 [2024-11-27 21:17:59.472049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-27 21:17:59.481849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.482 [2024-11-27 21:17:59.481951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.482 [2024-11-27 21:17:59.481980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.482 [2024-11-27 21:17:59.481995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.482 [2024-11-27 21:17:59.482007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.482 [2024-11-27 21:17:59.482048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-27 21:17:59.491849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.482 [2024-11-27 21:17:59.491947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.482 [2024-11-27 21:17:59.491972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.482 [2024-11-27 21:17:59.491986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.482 [2024-11-27 21:17:59.492000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.482 [2024-11-27 21:17:59.492029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-27 21:17:59.501888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.482 [2024-11-27 21:17:59.501982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.482 [2024-11-27 21:17:59.502008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.482 [2024-11-27 21:17:59.502022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.482 [2024-11-27 21:17:59.502034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.482 [2024-11-27 21:17:59.502063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-27 21:17:59.511949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.482 [2024-11-27 21:17:59.512056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.482 [2024-11-27 21:17:59.512083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.482 [2024-11-27 21:17:59.512097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.482 [2024-11-27 21:17:59.512109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.512150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.521969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.522070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.522101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.522116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.522129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.522159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.532041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.532141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.532167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.532181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.532194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.532224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.542019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.542133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.542159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.542173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.542186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.542226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.552064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.552161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.552187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.552201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.552213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.552242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.562203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.562333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.562358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.562372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.562390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.562421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.572120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.572257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.572282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.572296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.572310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.572340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.582168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.582274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.582299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.582313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.582326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.582355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.592166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.592265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.592294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.592308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.592321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.592350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.602196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.602296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.602321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.602335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.602348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.602377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.612271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.612379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.612404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.612418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.612431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.612460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.622288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.622390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.622416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.622429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.622442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.622471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.632338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.632478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.632503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.632517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.632536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.483 [2024-11-27 21:17:59.632568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-27 21:17:59.642302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.483 [2024-11-27 21:17:59.642412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.483 [2024-11-27 21:17:59.642438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.483 [2024-11-27 21:17:59.642451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.483 [2024-11-27 21:17:59.642463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.642493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.652326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.652421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.652446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.652460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.652478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.652521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.662354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.662447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.662470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.662483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.662495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.662531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.672421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.672534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.672561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.672575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.672588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.672618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.682408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.682517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.682551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.682565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.682578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.682609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.692445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.692551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.692576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.692590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.692603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.484 [2024-11-27 21:17:59.692632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.702497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.702615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.702648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.702664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.702677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.484 [2024-11-27 21:17:59.702707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-27 21:17:59.712516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.484 [2024-11-27 21:17:59.712648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.484 [2024-11-27 21:17:59.712674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.484 [2024-11-27 21:17:59.712689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.484 [2024-11-27 21:17:59.712703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.484 [2024-11-27 21:17:59.712732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.743 [2024-11-27 21:17:59.722531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.743 [2024-11-27 21:17:59.722628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.743 [2024-11-27 21:17:59.722654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.743 [2024-11-27 21:17:59.722668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.743 [2024-11-27 21:17:59.722681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.743 [2024-11-27 21:17:59.722710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.743 qpair failed and we were unable to recover it. 00:28:03.743 [2024-11-27 21:17:59.732557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.743 [2024-11-27 21:17:59.732671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.743 [2024-11-27 21:17:59.732697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.743 [2024-11-27 21:17:59.732711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.743 [2024-11-27 21:17:59.732725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.743 [2024-11-27 21:17:59.732753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.743 qpair failed and we were unable to recover it. 00:28:03.743 [2024-11-27 21:17:59.742596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.743 [2024-11-27 21:17:59.742711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.743 [2024-11-27 21:17:59.742738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.743 [2024-11-27 21:17:59.742759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.743 [2024-11-27 21:17:59.742772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.743 [2024-11-27 21:17:59.742802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.743 qpair failed and we were unable to recover it. 00:28:03.743 [2024-11-27 21:17:59.752629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.743 [2024-11-27 21:17:59.752751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.743 [2024-11-27 21:17:59.752776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.743 [2024-11-27 21:17:59.752791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.743 [2024-11-27 21:17:59.752804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.743 [2024-11-27 21:17:59.752831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.743 qpair failed and we were unable to recover it. 00:28:03.743 [2024-11-27 21:17:59.762691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.743 [2024-11-27 21:17:59.762796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.743 [2024-11-27 21:17:59.762825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.743 [2024-11-27 21:17:59.762843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.743 [2024-11-27 21:17:59.762855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.743 [2024-11-27 21:17:59.762884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.743 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.772664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.772767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.772793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.772806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.772818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.772847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.782692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.782787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.782812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.782826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.782838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.782866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.792849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.792949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.792975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.792989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.793001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.793029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.802769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.802874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.802899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.802913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.802926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.802955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.812842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.812959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.812985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.812999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.813013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.813041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.822894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.823012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.823038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.823052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.823064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.823093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.832860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.832953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.832982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.833005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.833019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.833049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.842908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.843013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.843039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.843053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.843066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.843094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.852994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.853095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.853120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.853134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.853147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xecbcb0 00:28:03.744 [2024-11-27 21:17:59.853175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.863019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.744 [2024-11-27 21:17:59.863162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.744 [2024-11-27 21:17:59.863196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.744 [2024-11-27 21:17:59.863212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.744 [2024-11-27 21:17:59.863225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff62c000b90 00:28:03.744 [2024-11-27 21:17:59.863258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:03.744 qpair failed and we were unable to recover it. 00:28:03.744 [2024-11-27 21:17:59.872977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.745 [2024-11-27 21:17:59.873075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.745 [2024-11-27 21:17:59.873103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.745 [2024-11-27 21:17:59.873118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.745 [2024-11-27 21:17:59.873131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff62c000b90 00:28:03.745 [2024-11-27 21:17:59.873162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:03.745 qpair failed and we were unable to recover it. 00:28:03.745 [2024-11-27 21:17:59.883036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.745 [2024-11-27 21:17:59.883140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.745 [2024-11-27 21:17:59.883172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.745 [2024-11-27 21:17:59.883187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.745 [2024-11-27 21:17:59.883201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.745 [2024-11-27 21:17:59.883232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.745 qpair failed and we were unable to recover it. 00:28:03.745 [2024-11-27 21:17:59.893027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.745 [2024-11-27 21:17:59.893123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.745 [2024-11-27 21:17:59.893151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.745 [2024-11-27 21:17:59.893165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.745 [2024-11-27 21:17:59.893178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff638000b90 00:28:03.745 [2024-11-27 21:17:59.893207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:03.745 qpair failed and we were unable to recover it. 00:28:03.745 [2024-11-27 21:17:59.893343] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:03.745 A controller has encountered a failure and is being reset. 00:28:03.745 [2024-11-27 21:17:59.903066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.745 [2024-11-27 21:17:59.903165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.745 [2024-11-27 21:17:59.903199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.745 [2024-11-27 21:17:59.903214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.745 [2024-11-27 21:17:59.903228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:28:03.745 [2024-11-27 21:17:59.903259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:03.745 qpair failed and we were unable to recover it. 00:28:03.745 [2024-11-27 21:17:59.913094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:03.745 [2024-11-27 21:17:59.913198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:03.745 [2024-11-27 21:17:59.913227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:03.745 [2024-11-27 21:17:59.913242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:03.745 [2024-11-27 21:17:59.913255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7ff630000b90 00:28:03.745 [2024-11-27 21:17:59.913287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:03.745 qpair failed and we were unable to recover it. 00:28:03.745 Controller properly reset. 00:28:03.745 Initializing NVMe Controllers 00:28:03.745 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:03.745 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:03.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:03.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:03.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:03.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:03.745 Initialization complete. Launching workers. 00:28:03.745 Starting thread on core 1 00:28:03.745 Starting thread on core 2 00:28:03.745 Starting thread on core 3 00:28:03.745 Starting thread on core 0 00:28:03.745 21:17:59 -- host/target_disconnect.sh@59 -- # sync 00:28:03.745 00:28:03.745 real 0m11.623s 00:28:03.745 user 0m21.711s 00:28:03.745 sys 0m5.140s 00:28:03.745 21:17:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:03.745 21:17:59 -- common/autotest_common.sh@10 -- # set +x 00:28:03.745 ************************************ 00:28:03.745 END TEST nvmf_target_disconnect_tc2 00:28:03.745 ************************************ 00:28:03.745 21:17:59 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:03.745 21:17:59 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:03.745 21:17:59 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:03.745 21:17:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:03.745 21:17:59 -- nvmf/common.sh@116 -- # sync 00:28:03.745 21:17:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:03.745 21:17:59 -- nvmf/common.sh@119 -- # set +e 00:28:03.745 21:17:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:03.745 21:17:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:03.745 rmmod nvme_tcp 00:28:03.745 rmmod nvme_fabrics 00:28:04.004 rmmod nvme_keyring 00:28:04.004 21:18:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:04.004 21:18:00 -- nvmf/common.sh@123 -- # set -e 00:28:04.004 21:18:00 -- nvmf/common.sh@124 -- # return 0 00:28:04.004 21:18:00 -- nvmf/common.sh@477 -- # '[' -n 4106645 ']' 00:28:04.004 21:18:00 -- nvmf/common.sh@478 -- # killprocess 4106645 00:28:04.004 21:18:00 -- common/autotest_common.sh@936 -- # '[' -z 4106645 ']' 00:28:04.004 21:18:00 -- common/autotest_common.sh@940 -- # kill -0 4106645 00:28:04.004 21:18:00 -- common/autotest_common.sh@941 -- # uname 00:28:04.004 21:18:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:04.004 21:18:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4106645 00:28:04.004 21:18:00 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:04.004 21:18:00 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:04.004 21:18:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4106645' 00:28:04.004 killing process with pid 4106645 00:28:04.004 21:18:00 -- common/autotest_common.sh@955 -- # kill 4106645 00:28:04.004 21:18:00 -- common/autotest_common.sh@960 -- # wait 4106645 00:28:04.263 21:18:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:04.263 21:18:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:04.263 21:18:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:04.263 21:18:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:04.263 21:18:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:04.263 21:18:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:04.263 21:18:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:04.263 21:18:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:06.164 21:18:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:06.164 00:28:06.164 real 0m16.435s 00:28:06.164 user 0m48.422s 00:28:06.164 sys 0m7.021s 00:28:06.164 21:18:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:06.164 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.164 ************************************ 00:28:06.164 END TEST nvmf_target_disconnect 00:28:06.164 ************************************ 00:28:06.423 21:18:02 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:06.423 21:18:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.423 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.423 21:18:02 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:06.423 00:28:06.423 real 21m26.480s 00:28:06.423 user 61m56.883s 00:28:06.423 sys 5m3.481s 00:28:06.423 21:18:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:06.423 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.423 ************************************ 00:28:06.423 END TEST nvmf_tcp 00:28:06.423 ************************************ 00:28:06.423 21:18:02 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:06.423 21:18:02 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:06.423 21:18:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:06.423 21:18:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:06.423 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.423 ************************************ 00:28:06.423 START TEST spdkcli_nvmf_tcp 00:28:06.423 ************************************ 00:28:06.423 21:18:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:06.423 * Looking for test storage... 00:28:06.423 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:06.423 21:18:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:06.423 21:18:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:06.423 21:18:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:06.423 21:18:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:06.423 21:18:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:06.423 21:18:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:06.423 21:18:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:06.423 21:18:02 -- scripts/common.sh@335 -- # IFS=.-: 00:28:06.423 21:18:02 -- scripts/common.sh@335 -- # read -ra ver1 00:28:06.423 21:18:02 -- scripts/common.sh@336 -- # IFS=.-: 00:28:06.423 21:18:02 -- scripts/common.sh@336 -- # read -ra ver2 00:28:06.423 21:18:02 -- scripts/common.sh@337 -- # local 'op=<' 00:28:06.423 21:18:02 -- scripts/common.sh@339 -- # ver1_l=2 00:28:06.423 21:18:02 -- scripts/common.sh@340 -- # ver2_l=1 00:28:06.423 21:18:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:06.423 21:18:02 -- scripts/common.sh@343 -- # case "$op" in 00:28:06.423 21:18:02 -- scripts/common.sh@344 -- # : 1 00:28:06.423 21:18:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:06.423 21:18:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:06.423 21:18:02 -- scripts/common.sh@364 -- # decimal 1 00:28:06.423 21:18:02 -- scripts/common.sh@352 -- # local d=1 00:28:06.423 21:18:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:06.423 21:18:02 -- scripts/common.sh@354 -- # echo 1 00:28:06.423 21:18:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:06.423 21:18:02 -- scripts/common.sh@365 -- # decimal 2 00:28:06.423 21:18:02 -- scripts/common.sh@352 -- # local d=2 00:28:06.423 21:18:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:06.423 21:18:02 -- scripts/common.sh@354 -- # echo 2 00:28:06.423 21:18:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:06.423 21:18:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:06.423 21:18:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:06.423 21:18:02 -- scripts/common.sh@367 -- # return 0 00:28:06.423 21:18:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:06.423 21:18:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:06.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:06.424 --rc genhtml_branch_coverage=1 00:28:06.424 --rc genhtml_function_coverage=1 00:28:06.424 --rc genhtml_legend=1 00:28:06.424 --rc geninfo_all_blocks=1 00:28:06.424 --rc geninfo_unexecuted_blocks=1 00:28:06.424 00:28:06.424 ' 00:28:06.424 21:18:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:06.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:06.424 --rc genhtml_branch_coverage=1 00:28:06.424 --rc genhtml_function_coverage=1 00:28:06.424 --rc genhtml_legend=1 00:28:06.424 --rc geninfo_all_blocks=1 00:28:06.424 --rc geninfo_unexecuted_blocks=1 00:28:06.424 00:28:06.424 ' 00:28:06.424 21:18:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:06.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:06.424 --rc genhtml_branch_coverage=1 00:28:06.424 --rc genhtml_function_coverage=1 00:28:06.424 --rc genhtml_legend=1 00:28:06.424 --rc geninfo_all_blocks=1 00:28:06.424 --rc geninfo_unexecuted_blocks=1 00:28:06.424 00:28:06.424 ' 00:28:06.424 21:18:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:06.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:06.424 --rc genhtml_branch_coverage=1 00:28:06.424 --rc genhtml_function_coverage=1 00:28:06.424 --rc genhtml_legend=1 00:28:06.424 --rc geninfo_all_blocks=1 00:28:06.424 --rc geninfo_unexecuted_blocks=1 00:28:06.424 00:28:06.424 ' 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:06.424 21:18:02 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:06.424 21:18:02 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:06.424 21:18:02 -- nvmf/common.sh@7 -- # uname -s 00:28:06.424 21:18:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:06.424 21:18:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:06.424 21:18:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:06.424 21:18:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:06.424 21:18:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:06.424 21:18:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:06.424 21:18:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:06.424 21:18:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:06.424 21:18:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:06.424 21:18:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:06.424 21:18:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:06.424 21:18:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:06.424 21:18:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:06.424 21:18:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:06.424 21:18:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:06.424 21:18:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:06.424 21:18:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:06.424 21:18:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:06.424 21:18:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:06.424 21:18:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.424 21:18:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.424 21:18:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.424 21:18:02 -- paths/export.sh@5 -- # export PATH 00:28:06.424 21:18:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:06.424 21:18:02 -- nvmf/common.sh@46 -- # : 0 00:28:06.424 21:18:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:06.424 21:18:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:06.424 21:18:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:06.424 21:18:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:06.424 21:18:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:06.424 21:18:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:06.424 21:18:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:06.424 21:18:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:06.424 21:18:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:06.424 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.424 21:18:02 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:06.424 21:18:02 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=4107986 00:28:06.424 21:18:02 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:06.424 21:18:02 -- spdkcli/common.sh@34 -- # waitforlisten 4107986 00:28:06.424 21:18:02 -- common/autotest_common.sh@829 -- # '[' -z 4107986 ']' 00:28:06.424 21:18:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:06.424 21:18:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:06.424 21:18:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:06.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:06.424 21:18:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:06.424 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.683 [2024-11-27 21:18:02.683996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:06.683 [2024-11-27 21:18:02.684081] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107986 ] 00:28:06.683 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.683 [2024-11-27 21:18:02.750954] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:06.683 [2024-11-27 21:18:02.861838] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:06.683 [2024-11-27 21:18:02.862014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:06.683 [2024-11-27 21:18:02.862020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:07.618 21:18:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:07.618 21:18:03 -- common/autotest_common.sh@862 -- # return 0 00:28:07.618 21:18:03 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:07.618 21:18:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:07.618 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:28:07.618 21:18:03 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:07.618 21:18:03 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:07.618 21:18:03 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:07.618 21:18:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.618 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:28:07.618 21:18:03 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:07.618 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:07.618 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:07.618 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:07.618 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:07.618 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:07.618 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:07.618 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:07.618 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:07.618 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:07.618 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:07.618 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:07.618 ' 00:28:07.876 [2024-11-27 21:18:04.084754] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:10.405 [2024-11-27 21:18:06.273440] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:11.338 [2024-11-27 21:18:07.525918] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:13.867 [2024-11-27 21:18:09.845420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:15.767 [2024-11-27 21:18:11.847995] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:17.140 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:17.140 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:17.140 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:17.140 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:17.140 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:17.140 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:17.140 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:17.398 21:18:13 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:17.398 21:18:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:17.398 21:18:13 -- common/autotest_common.sh@10 -- # set +x 00:28:17.398 21:18:13 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:17.398 21:18:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:17.398 21:18:13 -- common/autotest_common.sh@10 -- # set +x 00:28:17.398 21:18:13 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:17.398 21:18:13 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:17.965 21:18:13 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:17.965 21:18:13 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:17.965 21:18:13 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:17.965 21:18:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:17.965 21:18:13 -- common/autotest_common.sh@10 -- # set +x 00:28:17.965 21:18:14 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:17.965 21:18:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:17.965 21:18:14 -- common/autotest_common.sh@10 -- # set +x 00:28:17.965 21:18:14 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:17.965 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:17.965 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:17.965 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:17.965 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:17.965 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:17.965 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:17.965 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:17.965 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:17.965 ' 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:23.227 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:23.227 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:23.227 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:23.227 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:23.227 21:18:19 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:23.227 21:18:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.227 21:18:19 -- common/autotest_common.sh@10 -- # set +x 00:28:23.227 21:18:19 -- spdkcli/nvmf.sh@90 -- # killprocess 4107986 00:28:23.227 21:18:19 -- common/autotest_common.sh@936 -- # '[' -z 4107986 ']' 00:28:23.227 21:18:19 -- common/autotest_common.sh@940 -- # kill -0 4107986 00:28:23.227 21:18:19 -- common/autotest_common.sh@941 -- # uname 00:28:23.227 21:18:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:23.227 21:18:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4107986 00:28:23.227 21:18:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:23.227 21:18:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:23.227 21:18:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4107986' 00:28:23.227 killing process with pid 4107986 00:28:23.227 21:18:19 -- common/autotest_common.sh@955 -- # kill 4107986 00:28:23.227 [2024-11-27 21:18:19.331960] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:23.227 21:18:19 -- common/autotest_common.sh@960 -- # wait 4107986 00:28:23.485 21:18:19 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:23.485 21:18:19 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:23.485 21:18:19 -- spdkcli/common.sh@13 -- # '[' -n 4107986 ']' 00:28:23.485 21:18:19 -- spdkcli/common.sh@14 -- # killprocess 4107986 00:28:23.485 21:18:19 -- common/autotest_common.sh@936 -- # '[' -z 4107986 ']' 00:28:23.485 21:18:19 -- common/autotest_common.sh@940 -- # kill -0 4107986 00:28:23.485 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4107986) - No such process 00:28:23.485 21:18:19 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4107986 is not found' 00:28:23.485 Process with pid 4107986 is not found 00:28:23.486 21:18:19 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:23.486 21:18:19 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:23.486 21:18:19 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:23.486 00:28:23.486 real 0m17.145s 00:28:23.486 user 0m36.553s 00:28:23.486 sys 0m0.820s 00:28:23.486 21:18:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:23.486 21:18:19 -- common/autotest_common.sh@10 -- # set +x 00:28:23.486 ************************************ 00:28:23.486 END TEST spdkcli_nvmf_tcp 00:28:23.486 ************************************ 00:28:23.486 21:18:19 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:23.486 21:18:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:23.486 21:18:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:23.486 21:18:19 -- common/autotest_common.sh@10 -- # set +x 00:28:23.486 ************************************ 00:28:23.486 START TEST nvmf_identify_passthru 00:28:23.486 ************************************ 00:28:23.486 21:18:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:23.486 * Looking for test storage... 00:28:23.486 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:23.486 21:18:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:23.486 21:18:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:23.486 21:18:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:23.745 21:18:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:23.745 21:18:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:23.745 21:18:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:23.745 21:18:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:23.745 21:18:19 -- scripts/common.sh@335 -- # IFS=.-: 00:28:23.745 21:18:19 -- scripts/common.sh@335 -- # read -ra ver1 00:28:23.745 21:18:19 -- scripts/common.sh@336 -- # IFS=.-: 00:28:23.745 21:18:19 -- scripts/common.sh@336 -- # read -ra ver2 00:28:23.745 21:18:19 -- scripts/common.sh@337 -- # local 'op=<' 00:28:23.745 21:18:19 -- scripts/common.sh@339 -- # ver1_l=2 00:28:23.745 21:18:19 -- scripts/common.sh@340 -- # ver2_l=1 00:28:23.745 21:18:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:23.745 21:18:19 -- scripts/common.sh@343 -- # case "$op" in 00:28:23.745 21:18:19 -- scripts/common.sh@344 -- # : 1 00:28:23.745 21:18:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:23.745 21:18:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:23.745 21:18:19 -- scripts/common.sh@364 -- # decimal 1 00:28:23.746 21:18:19 -- scripts/common.sh@352 -- # local d=1 00:28:23.746 21:18:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:23.746 21:18:19 -- scripts/common.sh@354 -- # echo 1 00:28:23.746 21:18:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:23.746 21:18:19 -- scripts/common.sh@365 -- # decimal 2 00:28:23.746 21:18:19 -- scripts/common.sh@352 -- # local d=2 00:28:23.746 21:18:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:23.746 21:18:19 -- scripts/common.sh@354 -- # echo 2 00:28:23.746 21:18:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:23.746 21:18:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:23.746 21:18:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:23.746 21:18:19 -- scripts/common.sh@367 -- # return 0 00:28:23.746 21:18:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:23.746 21:18:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:23.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:23.746 --rc genhtml_branch_coverage=1 00:28:23.746 --rc genhtml_function_coverage=1 00:28:23.746 --rc genhtml_legend=1 00:28:23.746 --rc geninfo_all_blocks=1 00:28:23.746 --rc geninfo_unexecuted_blocks=1 00:28:23.746 00:28:23.746 ' 00:28:23.746 21:18:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:23.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:23.746 --rc genhtml_branch_coverage=1 00:28:23.746 --rc genhtml_function_coverage=1 00:28:23.746 --rc genhtml_legend=1 00:28:23.746 --rc geninfo_all_blocks=1 00:28:23.746 --rc geninfo_unexecuted_blocks=1 00:28:23.746 00:28:23.746 ' 00:28:23.746 21:18:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:23.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:23.746 --rc genhtml_branch_coverage=1 00:28:23.746 --rc genhtml_function_coverage=1 00:28:23.746 --rc genhtml_legend=1 00:28:23.746 --rc geninfo_all_blocks=1 00:28:23.746 --rc geninfo_unexecuted_blocks=1 00:28:23.746 00:28:23.746 ' 00:28:23.746 21:18:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:23.746 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:23.746 --rc genhtml_branch_coverage=1 00:28:23.746 --rc genhtml_function_coverage=1 00:28:23.746 --rc genhtml_legend=1 00:28:23.746 --rc geninfo_all_blocks=1 00:28:23.746 --rc geninfo_unexecuted_blocks=1 00:28:23.746 00:28:23.746 ' 00:28:23.746 21:18:19 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:23.746 21:18:19 -- nvmf/common.sh@7 -- # uname -s 00:28:23.746 21:18:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:23.746 21:18:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:23.746 21:18:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:23.746 21:18:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:23.746 21:18:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:23.746 21:18:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:23.746 21:18:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:23.746 21:18:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:23.746 21:18:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:23.746 21:18:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:23.746 21:18:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:23.746 21:18:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:23.746 21:18:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:23.746 21:18:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:23.746 21:18:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:23.746 21:18:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:23.746 21:18:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:23.746 21:18:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:23.746 21:18:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:23.746 21:18:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@5 -- # export PATH 00:28:23.746 21:18:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- nvmf/common.sh@46 -- # : 0 00:28:23.746 21:18:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:23.746 21:18:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:23.746 21:18:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:23.746 21:18:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:23.746 21:18:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:23.746 21:18:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:23.746 21:18:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:23.746 21:18:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:23.746 21:18:19 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:23.746 21:18:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:23.746 21:18:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:23.746 21:18:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:23.746 21:18:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- paths/export.sh@5 -- # export PATH 00:28:23.746 21:18:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:23.746 21:18:19 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:23.746 21:18:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:23.746 21:18:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:23.746 21:18:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:23.746 21:18:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:23.746 21:18:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:23.746 21:18:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:23.746 21:18:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:23.746 21:18:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:23.746 21:18:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:23.746 21:18:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:23.746 21:18:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:23.746 21:18:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.651 21:18:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:25.651 21:18:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:25.651 21:18:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:25.651 21:18:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:25.651 21:18:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:25.651 21:18:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:25.651 21:18:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:25.651 21:18:21 -- nvmf/common.sh@294 -- # net_devs=() 00:28:25.651 21:18:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:25.651 21:18:21 -- nvmf/common.sh@295 -- # e810=() 00:28:25.651 21:18:21 -- nvmf/common.sh@295 -- # local -ga e810 00:28:25.651 21:18:21 -- nvmf/common.sh@296 -- # x722=() 00:28:25.651 21:18:21 -- nvmf/common.sh@296 -- # local -ga x722 00:28:25.651 21:18:21 -- nvmf/common.sh@297 -- # mlx=() 00:28:25.651 21:18:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:25.651 21:18:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:25.651 21:18:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:25.651 21:18:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:25.651 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:25.651 21:18:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:25.651 21:18:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:25.651 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:25.651 21:18:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:25.651 21:18:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:25.651 21:18:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:25.651 21:18:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:25.651 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:25.651 21:18:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:25.651 21:18:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:25.651 21:18:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:25.651 21:18:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:25.651 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:25.651 21:18:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:25.651 21:18:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:25.651 21:18:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:25.651 21:18:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:25.651 21:18:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:25.651 21:18:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:25.651 21:18:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:25.651 21:18:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:25.651 21:18:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:25.651 21:18:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:25.651 21:18:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:25.651 21:18:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:25.651 21:18:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:25.651 21:18:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:25.651 21:18:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:25.651 21:18:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:25.651 21:18:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:25.651 21:18:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:25.651 21:18:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:25.651 21:18:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:25.651 21:18:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:25.651 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:25.651 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:28:25.651 00:28:25.651 --- 10.0.0.2 ping statistics --- 00:28:25.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:25.651 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:28:25.651 21:18:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:25.651 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:25.651 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:28:25.651 00:28:25.651 --- 10.0.0.1 ping statistics --- 00:28:25.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:25.651 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:28:25.651 21:18:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:25.651 21:18:21 -- nvmf/common.sh@410 -- # return 0 00:28:25.651 21:18:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:25.651 21:18:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:25.651 21:18:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:25.651 21:18:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:25.651 21:18:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:25.651 21:18:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:25.651 21:18:21 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:25.651 21:18:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:25.651 21:18:21 -- common/autotest_common.sh@10 -- # set +x 00:28:25.651 21:18:21 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:25.651 21:18:21 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:25.651 21:18:21 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:25.651 21:18:21 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:25.651 21:18:21 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:25.910 21:18:21 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:25.910 21:18:21 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:25.910 21:18:21 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:25.910 21:18:21 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:25.910 21:18:21 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:25.910 21:18:21 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:25.910 21:18:21 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:25.910 21:18:21 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:25.910 21:18:21 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:25.910 21:18:21 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:25.910 21:18:21 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:25.910 21:18:21 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:25.910 21:18:21 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:25.910 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.097 21:18:26 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:30.097 21:18:26 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:30.097 21:18:26 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:30.097 21:18:26 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:30.097 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.283 21:18:30 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:34.283 21:18:30 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:34.283 21:18:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:34.283 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.283 21:18:30 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:34.283 21:18:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:34.283 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.283 21:18:30 -- target/identify_passthru.sh@31 -- # nvmfpid=4113249 00:28:34.283 21:18:30 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:34.283 21:18:30 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:34.283 21:18:30 -- target/identify_passthru.sh@35 -- # waitforlisten 4113249 00:28:34.283 21:18:30 -- common/autotest_common.sh@829 -- # '[' -z 4113249 ']' 00:28:34.283 21:18:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:34.283 21:18:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:34.283 21:18:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:34.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:34.283 21:18:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:34.283 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.283 [2024-11-27 21:18:30.439576] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:34.283 [2024-11-27 21:18:30.439657] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:34.283 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.283 [2024-11-27 21:18:30.504138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:34.541 [2024-11-27 21:18:30.615987] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:34.541 [2024-11-27 21:18:30.616128] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:34.541 [2024-11-27 21:18:30.616145] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:34.541 [2024-11-27 21:18:30.616157] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:34.541 [2024-11-27 21:18:30.616208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:34.541 [2024-11-27 21:18:30.616268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:34.541 [2024-11-27 21:18:30.616290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:34.541 [2024-11-27 21:18:30.616292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:34.541 21:18:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:34.541 21:18:30 -- common/autotest_common.sh@862 -- # return 0 00:28:34.541 21:18:30 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:34.541 21:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.541 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.541 INFO: Log level set to 20 00:28:34.541 INFO: Requests: 00:28:34.541 { 00:28:34.541 "jsonrpc": "2.0", 00:28:34.541 "method": "nvmf_set_config", 00:28:34.541 "id": 1, 00:28:34.541 "params": { 00:28:34.541 "admin_cmd_passthru": { 00:28:34.541 "identify_ctrlr": true 00:28:34.541 } 00:28:34.541 } 00:28:34.541 } 00:28:34.541 00:28:34.541 INFO: response: 00:28:34.541 { 00:28:34.541 "jsonrpc": "2.0", 00:28:34.541 "id": 1, 00:28:34.541 "result": true 00:28:34.541 } 00:28:34.541 00:28:34.541 21:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.541 21:18:30 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:34.541 21:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.541 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.541 INFO: Setting log level to 20 00:28:34.541 INFO: Setting log level to 20 00:28:34.541 INFO: Log level set to 20 00:28:34.541 INFO: Log level set to 20 00:28:34.541 INFO: Requests: 00:28:34.541 { 00:28:34.541 "jsonrpc": "2.0", 00:28:34.541 "method": "framework_start_init", 00:28:34.541 "id": 1 00:28:34.541 } 00:28:34.541 00:28:34.541 INFO: Requests: 00:28:34.541 { 00:28:34.541 "jsonrpc": "2.0", 00:28:34.541 "method": "framework_start_init", 00:28:34.541 "id": 1 00:28:34.541 } 00:28:34.541 00:28:34.800 [2024-11-27 21:18:30.789878] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:34.800 INFO: response: 00:28:34.800 { 00:28:34.800 "jsonrpc": "2.0", 00:28:34.800 "id": 1, 00:28:34.800 "result": true 00:28:34.800 } 00:28:34.800 00:28:34.800 INFO: response: 00:28:34.800 { 00:28:34.800 "jsonrpc": "2.0", 00:28:34.800 "id": 1, 00:28:34.800 "result": true 00:28:34.800 } 00:28:34.800 00:28:34.800 21:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.800 21:18:30 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:34.800 21:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.800 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.800 INFO: Setting log level to 40 00:28:34.800 INFO: Setting log level to 40 00:28:34.800 INFO: Setting log level to 40 00:28:34.800 [2024-11-27 21:18:30.799920] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:34.800 21:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.800 21:18:30 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:34.800 21:18:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:34.800 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:34.800 21:18:30 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:34.800 21:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.800 21:18:30 -- common/autotest_common.sh@10 -- # set +x 00:28:38.077 Nvme0n1 00:28:38.077 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.077 21:18:33 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:38.077 21:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.077 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.077 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.077 21:18:33 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:38.077 21:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.077 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.077 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.077 21:18:33 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:38.077 21:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.077 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.077 [2024-11-27 21:18:33.694490] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:38.077 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.077 21:18:33 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:38.077 21:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.077 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.077 [2024-11-27 21:18:33.702244] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:38.077 [ 00:28:38.077 { 00:28:38.077 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:38.077 "subtype": "Discovery", 00:28:38.077 "listen_addresses": [], 00:28:38.077 "allow_any_host": true, 00:28:38.077 "hosts": [] 00:28:38.078 }, 00:28:38.078 { 00:28:38.078 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:38.078 "subtype": "NVMe", 00:28:38.078 "listen_addresses": [ 00:28:38.078 { 00:28:38.078 "transport": "TCP", 00:28:38.078 "trtype": "TCP", 00:28:38.078 "adrfam": "IPv4", 00:28:38.078 "traddr": "10.0.0.2", 00:28:38.078 "trsvcid": "4420" 00:28:38.078 } 00:28:38.078 ], 00:28:38.078 "allow_any_host": true, 00:28:38.078 "hosts": [], 00:28:38.078 "serial_number": "SPDK00000000000001", 00:28:38.078 "model_number": "SPDK bdev Controller", 00:28:38.078 "max_namespaces": 1, 00:28:38.078 "min_cntlid": 1, 00:28:38.078 "max_cntlid": 65519, 00:28:38.078 "namespaces": [ 00:28:38.078 { 00:28:38.078 "nsid": 1, 00:28:38.078 "bdev_name": "Nvme0n1", 00:28:38.078 "name": "Nvme0n1", 00:28:38.078 "nguid": "8D4FDA5B2D7240EB8B12E1E98A1307C3", 00:28:38.078 "uuid": "8d4fda5b-2d72-40eb-8b12-e1e98a1307c3" 00:28:38.078 } 00:28:38.078 ] 00:28:38.078 } 00:28:38.078 ] 00:28:38.078 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.078 21:18:33 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:38.078 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.078 21:18:33 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:38.078 21:18:33 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:38.078 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.078 21:18:33 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:38.078 21:18:33 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:38.078 21:18:33 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:38.078 21:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.078 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.078 21:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.078 21:18:33 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:38.078 21:18:33 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:38.078 21:18:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:38.078 21:18:33 -- nvmf/common.sh@116 -- # sync 00:28:38.078 21:18:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:38.078 21:18:33 -- nvmf/common.sh@119 -- # set +e 00:28:38.078 21:18:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:38.078 21:18:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:38.078 rmmod nvme_tcp 00:28:38.078 rmmod nvme_fabrics 00:28:38.078 rmmod nvme_keyring 00:28:38.078 21:18:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:38.078 21:18:34 -- nvmf/common.sh@123 -- # set -e 00:28:38.078 21:18:34 -- nvmf/common.sh@124 -- # return 0 00:28:38.078 21:18:34 -- nvmf/common.sh@477 -- # '[' -n 4113249 ']' 00:28:38.078 21:18:34 -- nvmf/common.sh@478 -- # killprocess 4113249 00:28:38.078 21:18:34 -- common/autotest_common.sh@936 -- # '[' -z 4113249 ']' 00:28:38.078 21:18:34 -- common/autotest_common.sh@940 -- # kill -0 4113249 00:28:38.078 21:18:34 -- common/autotest_common.sh@941 -- # uname 00:28:38.078 21:18:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:38.078 21:18:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4113249 00:28:38.078 21:18:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:38.078 21:18:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:38.078 21:18:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4113249' 00:28:38.078 killing process with pid 4113249 00:28:38.078 21:18:34 -- common/autotest_common.sh@955 -- # kill 4113249 00:28:38.078 [2024-11-27 21:18:34.078849] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:38.078 21:18:34 -- common/autotest_common.sh@960 -- # wait 4113249 00:28:39.450 21:18:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:39.450 21:18:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:39.450 21:18:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:39.450 21:18:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:39.450 21:18:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:39.450 21:18:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:39.450 21:18:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:39.450 21:18:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:41.985 21:18:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:41.985 00:28:41.986 real 0m18.069s 00:28:41.986 user 0m26.683s 00:28:41.986 sys 0m2.261s 00:28:41.986 21:18:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:41.986 21:18:37 -- common/autotest_common.sh@10 -- # set +x 00:28:41.986 ************************************ 00:28:41.986 END TEST nvmf_identify_passthru 00:28:41.986 ************************************ 00:28:41.986 21:18:37 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:41.986 21:18:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:41.986 21:18:37 -- common/autotest_common.sh@10 -- # set +x 00:28:41.986 ************************************ 00:28:41.986 START TEST nvmf_dif 00:28:41.986 ************************************ 00:28:41.986 21:18:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:41.986 * Looking for test storage... 00:28:41.986 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:41.986 21:18:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:41.986 21:18:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:41.986 21:18:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:41.986 21:18:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:41.986 21:18:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:41.986 21:18:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:41.986 21:18:37 -- scripts/common.sh@335 -- # IFS=.-: 00:28:41.986 21:18:37 -- scripts/common.sh@335 -- # read -ra ver1 00:28:41.986 21:18:37 -- scripts/common.sh@336 -- # IFS=.-: 00:28:41.986 21:18:37 -- scripts/common.sh@336 -- # read -ra ver2 00:28:41.986 21:18:37 -- scripts/common.sh@337 -- # local 'op=<' 00:28:41.986 21:18:37 -- scripts/common.sh@339 -- # ver1_l=2 00:28:41.986 21:18:37 -- scripts/common.sh@340 -- # ver2_l=1 00:28:41.986 21:18:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:41.986 21:18:37 -- scripts/common.sh@343 -- # case "$op" in 00:28:41.986 21:18:37 -- scripts/common.sh@344 -- # : 1 00:28:41.986 21:18:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:41.986 21:18:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:41.986 21:18:37 -- scripts/common.sh@364 -- # decimal 1 00:28:41.986 21:18:37 -- scripts/common.sh@352 -- # local d=1 00:28:41.986 21:18:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:41.986 21:18:37 -- scripts/common.sh@354 -- # echo 1 00:28:41.986 21:18:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:41.986 21:18:37 -- scripts/common.sh@365 -- # decimal 2 00:28:41.986 21:18:37 -- scripts/common.sh@352 -- # local d=2 00:28:41.986 21:18:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:41.986 21:18:37 -- scripts/common.sh@354 -- # echo 2 00:28:41.986 21:18:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:41.986 21:18:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:41.986 21:18:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:41.986 21:18:37 -- scripts/common.sh@367 -- # return 0 00:28:41.986 21:18:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:41.986 --rc genhtml_branch_coverage=1 00:28:41.986 --rc genhtml_function_coverage=1 00:28:41.986 --rc genhtml_legend=1 00:28:41.986 --rc geninfo_all_blocks=1 00:28:41.986 --rc geninfo_unexecuted_blocks=1 00:28:41.986 00:28:41.986 ' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:41.986 --rc genhtml_branch_coverage=1 00:28:41.986 --rc genhtml_function_coverage=1 00:28:41.986 --rc genhtml_legend=1 00:28:41.986 --rc geninfo_all_blocks=1 00:28:41.986 --rc geninfo_unexecuted_blocks=1 00:28:41.986 00:28:41.986 ' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:41.986 --rc genhtml_branch_coverage=1 00:28:41.986 --rc genhtml_function_coverage=1 00:28:41.986 --rc genhtml_legend=1 00:28:41.986 --rc geninfo_all_blocks=1 00:28:41.986 --rc geninfo_unexecuted_blocks=1 00:28:41.986 00:28:41.986 ' 00:28:41.986 21:18:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:41.986 --rc genhtml_branch_coverage=1 00:28:41.986 --rc genhtml_function_coverage=1 00:28:41.986 --rc genhtml_legend=1 00:28:41.986 --rc geninfo_all_blocks=1 00:28:41.986 --rc geninfo_unexecuted_blocks=1 00:28:41.986 00:28:41.986 ' 00:28:41.986 21:18:37 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:41.986 21:18:37 -- nvmf/common.sh@7 -- # uname -s 00:28:41.986 21:18:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:41.986 21:18:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:41.986 21:18:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:41.986 21:18:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:41.986 21:18:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:41.986 21:18:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:41.986 21:18:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:41.986 21:18:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:41.986 21:18:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:41.986 21:18:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:41.986 21:18:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:41.986 21:18:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:41.986 21:18:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:41.986 21:18:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:41.986 21:18:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:41.986 21:18:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:41.986 21:18:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:41.986 21:18:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:41.986 21:18:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:41.986 21:18:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:41.986 21:18:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:41.986 21:18:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:41.986 21:18:37 -- paths/export.sh@5 -- # export PATH 00:28:41.986 21:18:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:41.986 21:18:37 -- nvmf/common.sh@46 -- # : 0 00:28:41.986 21:18:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:41.986 21:18:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:41.986 21:18:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:41.986 21:18:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:41.986 21:18:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:41.986 21:18:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:41.986 21:18:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:41.986 21:18:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:41.986 21:18:37 -- target/dif.sh@15 -- # NULL_META=16 00:28:41.986 21:18:37 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:41.986 21:18:37 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:41.986 21:18:37 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:41.986 21:18:37 -- target/dif.sh@135 -- # nvmftestinit 00:28:41.986 21:18:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:41.986 21:18:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:41.986 21:18:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:41.986 21:18:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:41.986 21:18:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:41.986 21:18:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:41.986 21:18:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:41.986 21:18:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:41.986 21:18:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:41.986 21:18:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:41.986 21:18:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:41.986 21:18:37 -- common/autotest_common.sh@10 -- # set +x 00:28:43.913 21:18:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:43.913 21:18:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:43.913 21:18:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:43.913 21:18:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:43.913 21:18:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:43.913 21:18:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:43.913 21:18:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:43.913 21:18:39 -- nvmf/common.sh@294 -- # net_devs=() 00:28:43.913 21:18:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:43.913 21:18:39 -- nvmf/common.sh@295 -- # e810=() 00:28:43.913 21:18:39 -- nvmf/common.sh@295 -- # local -ga e810 00:28:43.913 21:18:39 -- nvmf/common.sh@296 -- # x722=() 00:28:43.913 21:18:39 -- nvmf/common.sh@296 -- # local -ga x722 00:28:43.913 21:18:39 -- nvmf/common.sh@297 -- # mlx=() 00:28:43.913 21:18:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:43.913 21:18:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:43.913 21:18:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:43.914 21:18:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:43.914 21:18:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:43.914 21:18:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:43.914 21:18:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:43.914 21:18:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:43.914 21:18:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:43.914 21:18:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:43.914 21:18:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:43.914 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:43.914 21:18:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:43.914 21:18:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:43.914 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:43.914 21:18:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:43.914 21:18:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:43.914 21:18:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:43.914 21:18:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:43.914 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:43.914 21:18:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:43.914 21:18:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:43.914 21:18:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:43.914 21:18:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:43.914 21:18:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:43.914 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:43.914 21:18:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:43.914 21:18:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:43.914 21:18:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:43.914 21:18:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:43.914 21:18:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:43.914 21:18:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:43.914 21:18:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:43.914 21:18:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:43.914 21:18:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:43.914 21:18:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:43.914 21:18:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:43.914 21:18:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:43.914 21:18:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:43.914 21:18:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:43.914 21:18:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:43.914 21:18:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:43.914 21:18:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:43.914 21:18:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:43.914 21:18:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:43.914 21:18:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:43.914 21:18:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:43.914 21:18:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:43.914 21:18:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:43.914 21:18:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:43.914 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:43.914 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:28:43.914 00:28:43.914 --- 10.0.0.2 ping statistics --- 00:28:43.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:43.914 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:28:43.914 21:18:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:43.914 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:43.914 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:28:43.914 00:28:43.914 --- 10.0.0.1 ping statistics --- 00:28:43.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:43.914 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:28:43.914 21:18:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:43.914 21:18:40 -- nvmf/common.sh@410 -- # return 0 00:28:43.914 21:18:40 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:43.914 21:18:40 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:44.895 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:44.895 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:44.895 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:44.895 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:44.895 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:44.895 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:45.153 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:45.153 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:45.153 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:45.153 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:45.153 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:45.153 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:45.153 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:45.153 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:45.153 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:45.153 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:45.153 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:45.153 21:18:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:45.153 21:18:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:45.153 21:18:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:45.153 21:18:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:45.153 21:18:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:45.153 21:18:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:45.153 21:18:41 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:45.153 21:18:41 -- target/dif.sh@137 -- # nvmfappstart 00:28:45.153 21:18:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:45.153 21:18:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:45.153 21:18:41 -- common/autotest_common.sh@10 -- # set +x 00:28:45.153 21:18:41 -- nvmf/common.sh@469 -- # nvmfpid=4116573 00:28:45.153 21:18:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:45.153 21:18:41 -- nvmf/common.sh@470 -- # waitforlisten 4116573 00:28:45.153 21:18:41 -- common/autotest_common.sh@829 -- # '[' -z 4116573 ']' 00:28:45.153 21:18:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:45.153 21:18:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:45.153 21:18:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:45.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:45.153 21:18:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:45.153 21:18:41 -- common/autotest_common.sh@10 -- # set +x 00:28:45.153 [2024-11-27 21:18:41.388819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:45.153 [2024-11-27 21:18:41.388915] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:45.411 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.411 [2024-11-27 21:18:41.456792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:45.411 [2024-11-27 21:18:41.571329] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:45.411 [2024-11-27 21:18:41.571470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:45.411 [2024-11-27 21:18:41.571486] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:45.411 [2024-11-27 21:18:41.571519] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:45.411 [2024-11-27 21:18:41.571567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:46.346 21:18:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:46.346 21:18:42 -- common/autotest_common.sh@862 -- # return 0 00:28:46.346 21:18:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:46.346 21:18:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 21:18:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:46.346 21:18:42 -- target/dif.sh@139 -- # create_transport 00:28:46.346 21:18:42 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:46.346 21:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 [2024-11-27 21:18:42.393888] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:46.346 21:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.346 21:18:42 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:46.346 21:18:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:46.346 21:18:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 ************************************ 00:28:46.346 START TEST fio_dif_1_default 00:28:46.346 ************************************ 00:28:46.346 21:18:42 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:46.346 21:18:42 -- target/dif.sh@86 -- # create_subsystems 0 00:28:46.346 21:18:42 -- target/dif.sh@28 -- # local sub 00:28:46.346 21:18:42 -- target/dif.sh@30 -- # for sub in "$@" 00:28:46.346 21:18:42 -- target/dif.sh@31 -- # create_subsystem 0 00:28:46.346 21:18:42 -- target/dif.sh@18 -- # local sub_id=0 00:28:46.346 21:18:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:46.346 21:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 bdev_null0 00:28:46.346 21:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.346 21:18:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:46.346 21:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 21:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.346 21:18:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:46.346 21:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 21:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.346 21:18:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:46.346 21:18:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.346 21:18:42 -- common/autotest_common.sh@10 -- # set +x 00:28:46.346 [2024-11-27 21:18:42.430144] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:46.346 21:18:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.346 21:18:42 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:46.346 21:18:42 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:46.346 21:18:42 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:46.346 21:18:42 -- nvmf/common.sh@520 -- # config=() 00:28:46.346 21:18:42 -- nvmf/common.sh@520 -- # local subsystem config 00:28:46.346 21:18:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:46.346 21:18:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:46.346 { 00:28:46.346 "params": { 00:28:46.346 "name": "Nvme$subsystem", 00:28:46.346 "trtype": "$TEST_TRANSPORT", 00:28:46.346 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:46.346 "adrfam": "ipv4", 00:28:46.346 "trsvcid": "$NVMF_PORT", 00:28:46.346 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:46.346 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:46.346 "hdgst": ${hdgst:-false}, 00:28:46.346 "ddgst": ${ddgst:-false} 00:28:46.346 }, 00:28:46.346 "method": "bdev_nvme_attach_controller" 00:28:46.346 } 00:28:46.346 EOF 00:28:46.346 )") 00:28:46.346 21:18:42 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:46.346 21:18:42 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:46.346 21:18:42 -- target/dif.sh@82 -- # gen_fio_conf 00:28:46.346 21:18:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:46.347 21:18:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:46.347 21:18:42 -- target/dif.sh@54 -- # local file 00:28:46.347 21:18:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:46.347 21:18:42 -- target/dif.sh@56 -- # cat 00:28:46.347 21:18:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:46.347 21:18:42 -- common/autotest_common.sh@1330 -- # shift 00:28:46.347 21:18:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:46.347 21:18:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:46.347 21:18:42 -- nvmf/common.sh@542 -- # cat 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:46.347 21:18:42 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:46.347 21:18:42 -- target/dif.sh@72 -- # (( file <= files )) 00:28:46.347 21:18:42 -- nvmf/common.sh@544 -- # jq . 00:28:46.347 21:18:42 -- nvmf/common.sh@545 -- # IFS=, 00:28:46.347 21:18:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:46.347 "params": { 00:28:46.347 "name": "Nvme0", 00:28:46.347 "trtype": "tcp", 00:28:46.347 "traddr": "10.0.0.2", 00:28:46.347 "adrfam": "ipv4", 00:28:46.347 "trsvcid": "4420", 00:28:46.347 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:46.347 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:46.347 "hdgst": false, 00:28:46.347 "ddgst": false 00:28:46.347 }, 00:28:46.347 "method": "bdev_nvme_attach_controller" 00:28:46.347 }' 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:46.347 21:18:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:46.347 21:18:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:46.347 21:18:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:46.347 21:18:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:46.347 21:18:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:46.347 21:18:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:46.605 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:46.605 fio-3.35 00:28:46.605 Starting 1 thread 00:28:46.605 EAL: No free 2048 kB hugepages reported on node 1 00:28:47.171 [2024-11-27 21:18:43.184648] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:47.171 [2024-11-27 21:18:43.184706] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:57.130 00:28:57.130 filename0: (groupid=0, jobs=1): err= 0: pid=4116931: Wed Nov 27 21:18:53 2024 00:28:57.130 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:28:57.130 slat (nsec): min=4040, max=70359, avg=9097.79, stdev=3632.64 00:28:57.130 clat (usec): min=40777, max=44691, avg=40990.68, stdev=246.58 00:28:57.130 lat (usec): min=40785, max=44717, avg=40999.78, stdev=246.64 00:28:57.130 clat percentiles (usec): 00:28:57.130 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:57.130 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:57.130 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:57.130 | 99.00th=[41157], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:28:57.130 | 99.99th=[44827] 00:28:57.130 bw ( KiB/s): min= 384, max= 416, per=99.47%, avg=388.80, stdev=11.72, samples=20 00:28:57.130 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:57.130 lat (msec) : 50=100.00% 00:28:57.130 cpu : usr=91.98%, sys=7.72%, ctx=16, majf=0, minf=261 00:28:57.130 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:57.130 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:57.130 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:57.130 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:57.130 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:57.130 00:28:57.130 Run status group 0 (all jobs): 00:28:57.130 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10009-10009msec 00:28:57.387 21:18:53 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:57.387 21:18:53 -- target/dif.sh@43 -- # local sub 00:28:57.387 21:18:53 -- target/dif.sh@45 -- # for sub in "$@" 00:28:57.387 21:18:53 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:57.387 21:18:53 -- target/dif.sh@36 -- # local sub_id=0 00:28:57.387 21:18:53 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:57.387 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.387 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.387 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.387 21:18:53 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:57.387 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.387 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.387 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.387 00:28:57.387 real 0m11.172s 00:28:57.387 user 0m10.441s 00:28:57.387 sys 0m1.097s 00:28:57.387 21:18:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:57.387 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.388 ************************************ 00:28:57.388 END TEST fio_dif_1_default 00:28:57.388 ************************************ 00:28:57.388 21:18:53 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:57.388 21:18:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:57.388 21:18:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:57.388 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.388 ************************************ 00:28:57.388 START TEST fio_dif_1_multi_subsystems 00:28:57.388 ************************************ 00:28:57.388 21:18:53 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:57.388 21:18:53 -- target/dif.sh@92 -- # local files=1 00:28:57.388 21:18:53 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:57.388 21:18:53 -- target/dif.sh@28 -- # local sub 00:28:57.388 21:18:53 -- target/dif.sh@30 -- # for sub in "$@" 00:28:57.388 21:18:53 -- target/dif.sh@31 -- # create_subsystem 0 00:28:57.388 21:18:53 -- target/dif.sh@18 -- # local sub_id=0 00:28:57.388 21:18:53 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:57.388 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.388 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.388 bdev_null0 00:28:57.388 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.388 21:18:53 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:57.388 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.388 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.388 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.388 21:18:53 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:57.388 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.388 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:57.646 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.646 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 [2024-11-27 21:18:53.634125] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@30 -- # for sub in "$@" 00:28:57.646 21:18:53 -- target/dif.sh@31 -- # create_subsystem 1 00:28:57.646 21:18:53 -- target/dif.sh@18 -- # local sub_id=1 00:28:57.646 21:18:53 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:57.646 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.646 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 bdev_null1 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:57.646 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.646 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:57.646 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.646 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:57.646 21:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.646 21:18:53 -- common/autotest_common.sh@10 -- # set +x 00:28:57.646 21:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.646 21:18:53 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:57.646 21:18:53 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:57.646 21:18:53 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:57.646 21:18:53 -- nvmf/common.sh@520 -- # config=() 00:28:57.646 21:18:53 -- nvmf/common.sh@520 -- # local subsystem config 00:28:57.646 21:18:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:57.646 21:18:53 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.646 21:18:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:57.646 { 00:28:57.646 "params": { 00:28:57.646 "name": "Nvme$subsystem", 00:28:57.646 "trtype": "$TEST_TRANSPORT", 00:28:57.646 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:57.646 "adrfam": "ipv4", 00:28:57.646 "trsvcid": "$NVMF_PORT", 00:28:57.646 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:57.646 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:57.646 "hdgst": ${hdgst:-false}, 00:28:57.646 "ddgst": ${ddgst:-false} 00:28:57.646 }, 00:28:57.646 "method": "bdev_nvme_attach_controller" 00:28:57.646 } 00:28:57.646 EOF 00:28:57.646 )") 00:28:57.646 21:18:53 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.646 21:18:53 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:57.646 21:18:53 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:57.646 21:18:53 -- target/dif.sh@82 -- # gen_fio_conf 00:28:57.646 21:18:53 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:57.646 21:18:53 -- target/dif.sh@54 -- # local file 00:28:57.646 21:18:53 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.646 21:18:53 -- common/autotest_common.sh@1330 -- # shift 00:28:57.646 21:18:53 -- target/dif.sh@56 -- # cat 00:28:57.646 21:18:53 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:57.646 21:18:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.646 21:18:53 -- nvmf/common.sh@542 -- # cat 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:57.646 21:18:53 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:57.646 21:18:53 -- target/dif.sh@72 -- # (( file <= files )) 00:28:57.646 21:18:53 -- target/dif.sh@73 -- # cat 00:28:57.646 21:18:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:57.646 21:18:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:57.646 { 00:28:57.646 "params": { 00:28:57.646 "name": "Nvme$subsystem", 00:28:57.646 "trtype": "$TEST_TRANSPORT", 00:28:57.646 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:57.646 "adrfam": "ipv4", 00:28:57.646 "trsvcid": "$NVMF_PORT", 00:28:57.646 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:57.646 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:57.646 "hdgst": ${hdgst:-false}, 00:28:57.646 "ddgst": ${ddgst:-false} 00:28:57.646 }, 00:28:57.646 "method": "bdev_nvme_attach_controller" 00:28:57.646 } 00:28:57.646 EOF 00:28:57.646 )") 00:28:57.646 21:18:53 -- nvmf/common.sh@542 -- # cat 00:28:57.646 21:18:53 -- target/dif.sh@72 -- # (( file++ )) 00:28:57.646 21:18:53 -- target/dif.sh@72 -- # (( file <= files )) 00:28:57.646 21:18:53 -- nvmf/common.sh@544 -- # jq . 00:28:57.646 21:18:53 -- nvmf/common.sh@545 -- # IFS=, 00:28:57.646 21:18:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:57.646 "params": { 00:28:57.646 "name": "Nvme0", 00:28:57.646 "trtype": "tcp", 00:28:57.646 "traddr": "10.0.0.2", 00:28:57.646 "adrfam": "ipv4", 00:28:57.646 "trsvcid": "4420", 00:28:57.646 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:57.646 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:57.646 "hdgst": false, 00:28:57.646 "ddgst": false 00:28:57.646 }, 00:28:57.646 "method": "bdev_nvme_attach_controller" 00:28:57.646 },{ 00:28:57.646 "params": { 00:28:57.646 "name": "Nvme1", 00:28:57.646 "trtype": "tcp", 00:28:57.646 "traddr": "10.0.0.2", 00:28:57.646 "adrfam": "ipv4", 00:28:57.646 "trsvcid": "4420", 00:28:57.646 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:57.646 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:57.646 "hdgst": false, 00:28:57.646 "ddgst": false 00:28:57.646 }, 00:28:57.646 "method": "bdev_nvme_attach_controller" 00:28:57.646 }' 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:57.646 21:18:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:57.646 21:18:53 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:57.646 21:18:53 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:57.646 21:18:53 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:57.646 21:18:53 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:57.646 21:18:53 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.904 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:57.904 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:57.904 fio-3.35 00:28:57.904 Starting 2 threads 00:28:57.904 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.469 [2024-11-27 21:18:54.585337] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:58.469 [2024-11-27 21:18:54.585394] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:10.659 00:29:10.659 filename0: (groupid=0, jobs=1): err= 0: pid=4118377: Wed Nov 27 21:19:04 2024 00:29:10.659 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10012msec) 00:29:10.659 slat (nsec): min=4193, max=29814, avg=9299.25, stdev=2612.41 00:29:10.659 clat (usec): min=40872, max=47978, avg=40999.70, stdev=448.08 00:29:10.659 lat (usec): min=40880, max=47989, avg=41009.00, stdev=447.94 00:29:10.659 clat percentiles (usec): 00:29:10.659 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:10.659 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:10.659 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:10.659 | 99.00th=[41157], 99.50th=[41157], 99.90th=[47973], 99.95th=[47973], 00:29:10.659 | 99.99th=[47973] 00:29:10.659 bw ( KiB/s): min= 384, max= 416, per=49.76%, avg=388.80, stdev=11.72, samples=20 00:29:10.659 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:10.659 lat (msec) : 50=100.00% 00:29:10.659 cpu : usr=95.61%, sys=4.10%, ctx=13, majf=0, minf=201 00:29:10.659 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.659 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.659 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.659 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:10.659 filename1: (groupid=0, jobs=1): err= 0: pid=4118378: Wed Nov 27 21:19:04 2024 00:29:10.659 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10013msec) 00:29:10.659 slat (nsec): min=4098, max=18446, avg=9198.83, stdev=2314.51 00:29:10.659 clat (usec): min=40892, max=48114, avg=41004.61, stdev=460.19 00:29:10.659 lat (usec): min=40900, max=48128, avg=41013.81, stdev=460.09 00:29:10.659 clat percentiles (usec): 00:29:10.659 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:10.659 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:10.659 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:10.659 | 99.00th=[41157], 99.50th=[41681], 99.90th=[47973], 99.95th=[47973], 00:29:10.659 | 99.99th=[47973] 00:29:10.659 bw ( KiB/s): min= 383, max= 416, per=49.76%, avg=388.75, stdev=11.75, samples=20 00:29:10.659 iops : min= 95, max= 104, avg=97.15, stdev= 2.96, samples=20 00:29:10.659 lat (msec) : 50=100.00% 00:29:10.659 cpu : usr=95.05%, sys=4.67%, ctx=18, majf=0, minf=116 00:29:10.659 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.659 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.659 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.659 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:10.659 00:29:10.659 Run status group 0 (all jobs): 00:29:10.659 READ: bw=780KiB/s (799kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=7808KiB (7995kB), run=10012-10013msec 00:29:10.659 21:19:04 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:10.659 21:19:04 -- target/dif.sh@43 -- # local sub 00:29:10.659 21:19:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:10.659 21:19:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:10.659 21:19:04 -- target/dif.sh@36 -- # local sub_id=0 00:29:10.659 21:19:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:10.659 21:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.659 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.659 21:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.659 21:19:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:10.659 21:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.659 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.659 21:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.659 21:19:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:10.659 21:19:04 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:10.659 21:19:04 -- target/dif.sh@36 -- # local sub_id=1 00:29:10.659 21:19:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:10.659 21:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.659 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.659 21:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.659 21:19:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:10.659 21:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.659 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.659 21:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.659 00:29:10.659 real 0m11.363s 00:29:10.659 user 0m20.523s 00:29:10.659 sys 0m1.160s 00:29:10.659 21:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:10.659 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.659 ************************************ 00:29:10.659 END TEST fio_dif_1_multi_subsystems 00:29:10.659 ************************************ 00:29:10.659 21:19:04 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:10.660 21:19:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:10.660 21:19:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:10.660 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.660 ************************************ 00:29:10.660 START TEST fio_dif_rand_params 00:29:10.660 ************************************ 00:29:10.660 21:19:04 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:10.660 21:19:04 -- target/dif.sh@100 -- # local NULL_DIF 00:29:10.660 21:19:04 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:10.660 21:19:04 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:10.660 21:19:04 -- target/dif.sh@103 -- # bs=128k 00:29:10.660 21:19:04 -- target/dif.sh@103 -- # numjobs=3 00:29:10.660 21:19:04 -- target/dif.sh@103 -- # iodepth=3 00:29:10.660 21:19:04 -- target/dif.sh@103 -- # runtime=5 00:29:10.660 21:19:04 -- target/dif.sh@105 -- # create_subsystems 0 00:29:10.660 21:19:04 -- target/dif.sh@28 -- # local sub 00:29:10.660 21:19:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.660 21:19:04 -- target/dif.sh@31 -- # create_subsystem 0 00:29:10.660 21:19:04 -- target/dif.sh@18 -- # local sub_id=0 00:29:10.660 21:19:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:10.660 21:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.660 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.660 bdev_null0 00:29:10.660 21:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.660 21:19:05 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:10.660 21:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.660 21:19:05 -- common/autotest_common.sh@10 -- # set +x 00:29:10.660 21:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.660 21:19:05 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:10.660 21:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.660 21:19:05 -- common/autotest_common.sh@10 -- # set +x 00:29:10.660 21:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.660 21:19:05 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:10.660 21:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.660 21:19:05 -- common/autotest_common.sh@10 -- # set +x 00:29:10.660 [2024-11-27 21:19:05.024440] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:10.660 21:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.660 21:19:05 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:10.660 21:19:05 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:10.660 21:19:05 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:10.660 21:19:05 -- nvmf/common.sh@520 -- # config=() 00:29:10.660 21:19:05 -- nvmf/common.sh@520 -- # local subsystem config 00:29:10.660 21:19:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:10.660 21:19:05 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.660 21:19:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:10.660 { 00:29:10.660 "params": { 00:29:10.660 "name": "Nvme$subsystem", 00:29:10.660 "trtype": "$TEST_TRANSPORT", 00:29:10.660 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:10.660 "adrfam": "ipv4", 00:29:10.660 "trsvcid": "$NVMF_PORT", 00:29:10.660 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:10.660 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:10.660 "hdgst": ${hdgst:-false}, 00:29:10.660 "ddgst": ${ddgst:-false} 00:29:10.660 }, 00:29:10.660 "method": "bdev_nvme_attach_controller" 00:29:10.660 } 00:29:10.660 EOF 00:29:10.660 )") 00:29:10.660 21:19:05 -- target/dif.sh@82 -- # gen_fio_conf 00:29:10.660 21:19:05 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.660 21:19:05 -- target/dif.sh@54 -- # local file 00:29:10.660 21:19:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:10.660 21:19:05 -- target/dif.sh@56 -- # cat 00:29:10.660 21:19:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:10.660 21:19:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:10.660 21:19:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.660 21:19:05 -- common/autotest_common.sh@1330 -- # shift 00:29:10.660 21:19:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:10.660 21:19:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:10.660 21:19:05 -- nvmf/common.sh@542 -- # cat 00:29:10.660 21:19:05 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.660 21:19:05 -- target/dif.sh@72 -- # (( file <= files )) 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:10.660 21:19:05 -- nvmf/common.sh@544 -- # jq . 00:29:10.660 21:19:05 -- nvmf/common.sh@545 -- # IFS=, 00:29:10.660 21:19:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:10.660 "params": { 00:29:10.660 "name": "Nvme0", 00:29:10.660 "trtype": "tcp", 00:29:10.660 "traddr": "10.0.0.2", 00:29:10.660 "adrfam": "ipv4", 00:29:10.660 "trsvcid": "4420", 00:29:10.660 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:10.660 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:10.660 "hdgst": false, 00:29:10.660 "ddgst": false 00:29:10.660 }, 00:29:10.660 "method": "bdev_nvme_attach_controller" 00:29:10.660 }' 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:10.660 21:19:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:10.660 21:19:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:10.660 21:19:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:10.660 21:19:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:10.660 21:19:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:10.660 21:19:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:10.660 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:10.660 ... 00:29:10.660 fio-3.35 00:29:10.660 Starting 3 threads 00:29:10.660 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.660 [2024-11-27 21:19:05.672247] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:10.660 [2024-11-27 21:19:05.672320] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:14.839 00:29:14.839 filename0: (groupid=0, jobs=1): err= 0: pid=4119697: Wed Nov 27 21:19:10 2024 00:29:14.839 read: IOPS=231, BW=28.9MiB/s (30.3MB/s)(145MiB/5003msec) 00:29:14.839 slat (nsec): min=4782, max=44707, avg=16816.64, stdev=4883.49 00:29:14.839 clat (usec): min=4061, max=88709, avg=12947.94, stdev=10488.25 00:29:14.839 lat (usec): min=4093, max=88728, avg=12964.76, stdev=10488.49 00:29:14.839 clat percentiles (usec): 00:29:14.839 | 1.00th=[ 5669], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455], 00:29:14.839 | 30.00th=[ 9503], 40.00th=[10421], 50.00th=[10945], 60.00th=[11207], 00:29:14.839 | 70.00th=[11731], 80.00th=[12125], 90.00th=[12780], 95.00th=[49546], 00:29:14.839 | 99.00th=[52691], 99.50th=[53216], 99.90th=[88605], 99.95th=[88605], 00:29:14.839 | 99.99th=[88605] 00:29:14.839 bw ( KiB/s): min=20224, max=36864, per=33.58%, avg=29593.60, stdev=5121.71, samples=10 00:29:14.839 iops : min= 158, max= 288, avg=231.20, stdev=40.01, samples=10 00:29:14.839 lat (msec) : 10=34.92%, 20=58.86%, 50=1.56%, 100=4.67% 00:29:14.839 cpu : usr=88.64%, sys=8.76%, ctx=290, majf=0, minf=86 00:29:14.839 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 issued rwts: total=1157,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.839 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.839 filename0: (groupid=0, jobs=1): err= 0: pid=4119698: Wed Nov 27 21:19:10 2024 00:29:14.839 read: IOPS=207, BW=25.9MiB/s (27.2MB/s)(131MiB/5044msec) 00:29:14.839 slat (nsec): min=4061, max=29363, avg=13104.87, stdev=1636.05 00:29:14.839 clat (usec): min=4682, max=91639, avg=14408.12, stdev=11969.86 00:29:14.839 lat (usec): min=4695, max=91653, avg=14421.23, stdev=11969.78 00:29:14.839 clat percentiles (usec): 00:29:14.839 | 1.00th=[ 5407], 5.00th=[ 7373], 10.00th=[ 8029], 20.00th=[ 8717], 00:29:14.839 | 30.00th=[10552], 40.00th=[11076], 50.00th=[11469], 60.00th=[11994], 00:29:14.839 | 70.00th=[12387], 80.00th=[12911], 90.00th=[14222], 95.00th=[51119], 00:29:14.839 | 99.00th=[53216], 99.50th=[53740], 99.90th=[91751], 99.95th=[91751], 00:29:14.839 | 99.99th=[91751] 00:29:14.839 bw ( KiB/s): min=17152, max=38400, per=30.33%, avg=26726.40, stdev=6636.50, samples=10 00:29:14.839 iops : min= 134, max= 300, avg=208.80, stdev=51.85, samples=10 00:29:14.839 lat (msec) : 10=26.77%, 20=64.72%, 50=2.68%, 100=5.83% 00:29:14.839 cpu : usr=93.40%, sys=6.03%, ctx=15, majf=0, minf=106 00:29:14.839 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 issued rwts: total=1046,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.839 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.839 filename0: (groupid=0, jobs=1): err= 0: pid=4119699: Wed Nov 27 21:19:10 2024 00:29:14.839 read: IOPS=251, BW=31.5MiB/s (33.0MB/s)(159MiB/5045msec) 00:29:14.839 slat (nsec): min=4696, max=31530, avg=13795.01, stdev=1995.35 00:29:14.839 clat (usec): min=3993, max=56001, avg=11865.21, stdev=7289.97 00:29:14.839 lat (usec): min=4008, max=56015, avg=11879.01, stdev=7289.81 00:29:14.839 clat percentiles (usec): 00:29:14.839 | 1.00th=[ 4686], 5.00th=[ 5342], 10.00th=[ 6325], 20.00th=[ 7963], 00:29:14.839 | 30.00th=[ 8356], 40.00th=[ 9372], 50.00th=[10945], 60.00th=[11994], 00:29:14.839 | 70.00th=[12649], 80.00th=[14615], 90.00th=[15926], 95.00th=[16581], 00:29:14.839 | 99.00th=[51643], 99.50th=[52691], 99.90th=[54789], 99.95th=[55837], 00:29:14.839 | 99.99th=[55837] 00:29:14.839 bw ( KiB/s): min=28416, max=44800, per=36.82%, avg=32441.40, stdev=4870.28, samples=10 00:29:14.839 iops : min= 222, max= 350, avg=253.40, stdev=38.06, samples=10 00:29:14.839 lat (msec) : 4=0.08%, 10=44.41%, 20=52.52%, 50=1.65%, 100=1.34% 00:29:14.839 cpu : usr=92.19%, sys=6.70%, ctx=312, majf=0, minf=79 00:29:14.839 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.839 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.839 issued rwts: total=1270,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.839 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.839 00:29:14.839 Run status group 0 (all jobs): 00:29:14.839 READ: bw=86.0MiB/s (90.2MB/s), 25.9MiB/s-31.5MiB/s (27.2MB/s-33.0MB/s), io=434MiB (455MB), run=5003-5045msec 00:29:14.839 21:19:11 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:14.839 21:19:11 -- target/dif.sh@43 -- # local sub 00:29:14.839 21:19:11 -- target/dif.sh@45 -- # for sub in "$@" 00:29:14.839 21:19:11 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:14.839 21:19:11 -- target/dif.sh@36 -- # local sub_id=0 00:29:14.839 21:19:11 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:14.839 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.839 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.839 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.839 21:19:11 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:14.839 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.839 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:14.839 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.839 21:19:11 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:14.839 21:19:11 -- target/dif.sh@109 -- # bs=4k 00:29:14.839 21:19:11 -- target/dif.sh@109 -- # numjobs=8 00:29:14.840 21:19:11 -- target/dif.sh@109 -- # iodepth=16 00:29:14.840 21:19:11 -- target/dif.sh@109 -- # runtime= 00:29:14.840 21:19:11 -- target/dif.sh@109 -- # files=2 00:29:14.840 21:19:11 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:14.840 21:19:11 -- target/dif.sh@28 -- # local sub 00:29:14.840 21:19:11 -- target/dif.sh@30 -- # for sub in "$@" 00:29:14.840 21:19:11 -- target/dif.sh@31 -- # create_subsystem 0 00:29:14.840 21:19:11 -- target/dif.sh@18 -- # local sub_id=0 00:29:14.840 21:19:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:14.840 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.840 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.098 bdev_null0 00:29:15.098 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.098 21:19:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:15.098 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.098 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.098 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 [2024-11-27 21:19:11.102731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@30 -- # for sub in "$@" 00:29:15.099 21:19:11 -- target/dif.sh@31 -- # create_subsystem 1 00:29:15.099 21:19:11 -- target/dif.sh@18 -- # local sub_id=1 00:29:15.099 21:19:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 bdev_null1 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@30 -- # for sub in "$@" 00:29:15.099 21:19:11 -- target/dif.sh@31 -- # create_subsystem 2 00:29:15.099 21:19:11 -- target/dif.sh@18 -- # local sub_id=2 00:29:15.099 21:19:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 bdev_null2 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:15.099 21:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.099 21:19:11 -- common/autotest_common.sh@10 -- # set +x 00:29:15.099 21:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.099 21:19:11 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:15.099 21:19:11 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:15.099 21:19:11 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:15.099 21:19:11 -- nvmf/common.sh@520 -- # config=() 00:29:15.099 21:19:11 -- nvmf/common.sh@520 -- # local subsystem config 00:29:15.099 21:19:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:15.099 { 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme$subsystem", 00:29:15.099 "trtype": "$TEST_TRANSPORT", 00:29:15.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "$NVMF_PORT", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:15.099 "hdgst": ${hdgst:-false}, 00:29:15.099 "ddgst": ${ddgst:-false} 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 } 00:29:15.099 EOF 00:29:15.099 )") 00:29:15.099 21:19:11 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.099 21:19:11 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.099 21:19:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:15.099 21:19:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:15.099 21:19:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:15.099 21:19:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.099 21:19:11 -- common/autotest_common.sh@1330 -- # shift 00:29:15.099 21:19:11 -- target/dif.sh@82 -- # gen_fio_conf 00:29:15.099 21:19:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:15.099 21:19:11 -- target/dif.sh@54 -- # local file 00:29:15.099 21:19:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:15.099 21:19:11 -- target/dif.sh@56 -- # cat 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # cat 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file <= files )) 00:29:15.099 21:19:11 -- target/dif.sh@73 -- # cat 00:29:15.099 21:19:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:15.099 { 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme$subsystem", 00:29:15.099 "trtype": "$TEST_TRANSPORT", 00:29:15.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "$NVMF_PORT", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:15.099 "hdgst": ${hdgst:-false}, 00:29:15.099 "ddgst": ${ddgst:-false} 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 } 00:29:15.099 EOF 00:29:15.099 )") 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # cat 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file++ )) 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file <= files )) 00:29:15.099 21:19:11 -- target/dif.sh@73 -- # cat 00:29:15.099 21:19:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:15.099 { 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme$subsystem", 00:29:15.099 "trtype": "$TEST_TRANSPORT", 00:29:15.099 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "$NVMF_PORT", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:15.099 "hdgst": ${hdgst:-false}, 00:29:15.099 "ddgst": ${ddgst:-false} 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 } 00:29:15.099 EOF 00:29:15.099 )") 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file++ )) 00:29:15.099 21:19:11 -- target/dif.sh@72 -- # (( file <= files )) 00:29:15.099 21:19:11 -- nvmf/common.sh@542 -- # cat 00:29:15.099 21:19:11 -- nvmf/common.sh@544 -- # jq . 00:29:15.099 21:19:11 -- nvmf/common.sh@545 -- # IFS=, 00:29:15.099 21:19:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme0", 00:29:15.099 "trtype": "tcp", 00:29:15.099 "traddr": "10.0.0.2", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "4420", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:15.099 "hdgst": false, 00:29:15.099 "ddgst": false 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 },{ 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme1", 00:29:15.099 "trtype": "tcp", 00:29:15.099 "traddr": "10.0.0.2", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "4420", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:15.099 "hdgst": false, 00:29:15.099 "ddgst": false 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 },{ 00:29:15.099 "params": { 00:29:15.099 "name": "Nvme2", 00:29:15.099 "trtype": "tcp", 00:29:15.099 "traddr": "10.0.0.2", 00:29:15.099 "adrfam": "ipv4", 00:29:15.099 "trsvcid": "4420", 00:29:15.099 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:15.099 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:15.099 "hdgst": false, 00:29:15.099 "ddgst": false 00:29:15.099 }, 00:29:15.099 "method": "bdev_nvme_attach_controller" 00:29:15.099 }' 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:15.099 21:19:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:15.099 21:19:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.099 21:19:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:15.100 21:19:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:15.100 21:19:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:15.100 21:19:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:15.100 21:19:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:15.100 21:19:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.358 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:15.358 ... 00:29:15.358 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:15.358 ... 00:29:15.358 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:15.358 ... 00:29:15.358 fio-3.35 00:29:15.358 Starting 24 threads 00:29:15.358 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.291 [2024-11-27 21:19:12.408633] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:16.291 [2024-11-27 21:19:12.408683] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:28.494 00:29:28.494 filename0: (groupid=0, jobs=1): err= 0: pid=4120581: Wed Nov 27 21:19:22 2024 00:29:28.494 read: IOPS=365, BW=1463KiB/s (1498kB/s)(14.6MiB/10234msec) 00:29:28.494 slat (usec): min=8, max=135, avg=47.75, stdev=34.48 00:29:28.494 clat (msec): min=8, max=352, avg=43.33, stdev=54.43 00:29:28.494 lat (msec): min=8, max=352, avg=43.37, stdev=54.42 00:29:28.494 clat percentiles (msec): 00:29:28.494 | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.494 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.494 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 40], 00:29:28.494 | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 355], 00:29:28.494 | 99.99th=[ 355] 00:29:28.494 bw ( KiB/s): min= 128, max= 2048, per=4.29%, avg=1491.20, stdev=793.70, samples=20 00:29:28.494 iops : min= 32, max= 512, avg=372.80, stdev=198.43, samples=20 00:29:28.494 lat (msec) : 10=0.43%, 20=0.43%, 50=94.44%, 250=0.43%, 500=4.27% 00:29:28.494 cpu : usr=98.41%, sys=1.16%, ctx=25, majf=0, minf=34 00:29:28.494 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 issued rwts: total=3744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.494 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.494 filename0: (groupid=0, jobs=1): err= 0: pid=4120582: Wed Nov 27 21:19:22 2024 00:29:28.494 read: IOPS=360, BW=1441KiB/s (1475kB/s)(14.4MiB/10212msec) 00:29:28.494 slat (usec): min=7, max=124, avg=28.36, stdev=18.67 00:29:28.494 clat (msec): min=20, max=615, avg=44.11, stdev=60.23 00:29:28.494 lat (msec): min=20, max=615, avg=44.14, stdev=60.23 00:29:28.494 clat percentiles (msec): 00:29:28.494 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.494 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.494 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 40], 00:29:28.494 | 99.00th=[ 355], 99.50th=[ 430], 99.90th=[ 468], 99.95th=[ 617], 00:29:28.494 | 99.99th=[ 617] 00:29:28.494 bw ( KiB/s): min= 128, max= 2048, per=4.22%, avg=1464.80, stdev=810.25, samples=20 00:29:28.494 iops : min= 32, max= 512, avg=366.20, stdev=202.56, samples=20 00:29:28.494 lat (msec) : 50=95.27%, 100=0.44%, 250=0.44%, 500=3.81%, 750=0.05% 00:29:28.494 cpu : usr=97.42%, sys=1.48%, ctx=124, majf=0, minf=31 00:29:28.494 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 issued rwts: total=3678,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.494 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.494 filename0: (groupid=0, jobs=1): err= 0: pid=4120583: Wed Nov 27 21:19:22 2024 00:29:28.494 read: IOPS=362, BW=1450KiB/s (1485kB/s)(14.5MiB/10235msec) 00:29:28.494 slat (usec): min=5, max=223, avg=32.11, stdev=21.04 00:29:28.494 clat (msec): min=23, max=501, avg=43.84, stdev=56.47 00:29:28.494 lat (msec): min=23, max=501, avg=43.87, stdev=56.47 00:29:28.494 clat percentiles (msec): 00:29:28.494 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.494 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.494 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 39], 00:29:28.494 | 99.00th=[ 342], 99.50th=[ 355], 99.90th=[ 397], 99.95th=[ 502], 00:29:28.494 | 99.99th=[ 502] 00:29:28.494 bw ( KiB/s): min= 128, max= 2048, per=4.25%, avg=1477.60, stdev=789.78, samples=20 00:29:28.494 iops : min= 32, max= 512, avg=369.40, stdev=197.45, samples=20 00:29:28.494 lat (msec) : 50=95.31%, 250=0.86%, 500=3.77%, 750=0.05% 00:29:28.494 cpu : usr=97.13%, sys=1.67%, ctx=114, majf=0, minf=42 00:29:28.494 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 issued rwts: total=3710,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.494 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.494 filename0: (groupid=0, jobs=1): err= 0: pid=4120584: Wed Nov 27 21:19:22 2024 00:29:28.494 read: IOPS=356, BW=1425KiB/s (1459kB/s)(14.2MiB/10195msec) 00:29:28.494 slat (usec): min=9, max=124, avg=41.45, stdev=22.17 00:29:28.494 clat (msec): min=21, max=637, avg=44.55, stdev=71.77 00:29:28.494 lat (msec): min=21, max=637, avg=44.59, stdev=71.77 00:29:28.494 clat percentiles (msec): 00:29:28.494 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.494 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.494 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:28.494 | 99.00th=[ 447], 99.50th=[ 523], 99.90th=[ 592], 99.95th=[ 642], 00:29:28.494 | 99.99th=[ 642] 00:29:28.494 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=1446.40, stdev=836.77, samples=20 00:29:28.494 iops : min= 32, max= 512, avg=361.60, stdev=209.19, samples=20 00:29:28.494 lat (msec) : 50=96.48%, 100=0.44%, 500=2.15%, 750=0.94% 00:29:28.494 cpu : usr=98.60%, sys=0.96%, ctx=14, majf=0, minf=40 00:29:28.494 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.494 issued rwts: total=3632,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.494 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.494 filename0: (groupid=0, jobs=1): err= 0: pid=4120585: Wed Nov 27 21:19:22 2024 00:29:28.494 read: IOPS=362, BW=1451KiB/s (1486kB/s)(14.5MiB/10228msec) 00:29:28.494 slat (usec): min=5, max=241, avg=61.54, stdev=31.52 00:29:28.494 clat (msec): min=18, max=426, avg=43.50, stdev=56.47 00:29:28.494 lat (msec): min=18, max=426, avg=43.56, stdev=56.46 00:29:28.494 clat percentiles (msec): 00:29:28.494 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.494 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.494 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 39], 00:29:28.494 | 99.00th=[ 338], 99.50th=[ 363], 99.90th=[ 409], 99.95th=[ 426], 00:29:28.494 | 99.99th=[ 426] 00:29:28.494 bw ( KiB/s): min= 128, max= 2048, per=4.25%, avg=1477.60, stdev=801.70, samples=20 00:29:28.494 iops : min= 32, max= 512, avg=369.40, stdev=200.43, samples=20 00:29:28.494 lat (msec) : 20=0.43%, 50=94.88%, 100=0.05%, 250=0.81%, 500=3.83% 00:29:28.494 cpu : usr=97.79%, sys=1.34%, ctx=79, majf=0, minf=31 00:29:28.494 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.494 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3710,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename0: (groupid=0, jobs=1): err= 0: pid=4120586: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=361, BW=1446KiB/s (1481kB/s)(14.4MiB/10216msec) 00:29:28.495 slat (usec): min=8, max=143, avg=49.42, stdev=28.97 00:29:28.495 clat (msec): min=22, max=451, avg=43.74, stdev=56.70 00:29:28.495 lat (msec): min=22, max=451, avg=43.79, stdev=56.69 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 42], 00:29:28.495 | 99.00th=[ 338], 99.50th=[ 380], 99.90th=[ 409], 99.95th=[ 451], 00:29:28.495 | 99.99th=[ 451] 00:29:28.495 bw ( KiB/s): min= 144, max= 2048, per=4.24%, avg=1471.20, stdev=809.10, samples=20 00:29:28.495 iops : min= 36, max= 512, avg=367.80, stdev=202.28, samples=20 00:29:28.495 lat (msec) : 50=95.29%, 100=0.05%, 250=0.81%, 500=3.84% 00:29:28.495 cpu : usr=98.11%, sys=1.04%, ctx=40, majf=0, minf=24 00:29:28.495 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3694,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename0: (groupid=0, jobs=1): err= 0: pid=4120587: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=370, BW=1482KiB/s (1518kB/s)(14.8MiB/10192msec) 00:29:28.495 slat (usec): min=7, max=111, avg=22.42, stdev=21.32 00:29:28.495 clat (msec): min=15, max=536, avg=42.81, stdev=57.83 00:29:28.495 lat (msec): min=15, max=536, avg=42.84, stdev=57.83 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 28], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 33], 80.00th=[ 36], 90.00th=[ 38], 95.00th=[ 67], 00:29:28.495 | 99.00th=[ 342], 99.50th=[ 447], 99.90th=[ 535], 99.95th=[ 535], 00:29:28.495 | 99.99th=[ 535] 00:29:28.495 bw ( KiB/s): min= 176, max= 2192, per=4.33%, avg=1504.00, stdev=832.08, samples=20 00:29:28.495 iops : min= 44, max= 548, avg=376.00, stdev=208.02, samples=20 00:29:28.495 lat (msec) : 20=1.24%, 50=93.56%, 100=1.22%, 250=0.85%, 500=2.91% 00:29:28.495 lat (msec) : 750=0.21% 00:29:28.495 cpu : usr=98.45%, sys=1.05%, ctx=29, majf=0, minf=34 00:29:28.495 IO depths : 1=0.1%, 2=0.3%, 4=3.4%, 8=80.2%, 16=16.0%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=89.1%, 8=8.7%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3776,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename0: (groupid=0, jobs=1): err= 0: pid=4120588: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=359, BW=1439KiB/s (1474kB/s)(14.2MiB/10137msec) 00:29:28.495 slat (nsec): min=8108, max=76868, avg=27313.16, stdev=10331.64 00:29:28.495 clat (msec): min=21, max=500, avg=44.21, stdev=64.55 00:29:28.495 lat (msec): min=21, max=500, avg=44.23, stdev=64.55 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 37], 00:29:28.495 | 99.00th=[ 401], 99.50th=[ 418], 99.90th=[ 502], 99.95th=[ 502], 00:29:28.495 | 99.99th=[ 502] 00:29:28.495 bw ( KiB/s): min= 128, max= 2048, per=4.18%, avg=1452.95, stdev=826.74, samples=20 00:29:28.495 iops : min= 32, max= 512, avg=363.20, stdev=206.67, samples=20 00:29:28.495 lat (msec) : 50=96.05%, 100=0.44%, 500=3.07%, 750=0.44% 00:29:28.495 cpu : usr=96.52%, sys=1.88%, ctx=180, majf=0, minf=36 00:29:28.495 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3648,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename1: (groupid=0, jobs=1): err= 0: pid=4120589: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=362, BW=1451KiB/s (1486kB/s)(14.5MiB/10228msec) 00:29:28.495 slat (nsec): min=6428, max=76221, avg=30823.14, stdev=9456.23 00:29:28.495 clat (msec): min=16, max=437, avg=43.77, stdev=56.49 00:29:28.495 lat (msec): min=16, max=437, avg=43.80, stdev=56.49 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 39], 00:29:28.495 | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 409], 99.95th=[ 439], 00:29:28.495 | 99.99th=[ 439] 00:29:28.495 bw ( KiB/s): min= 144, max= 2048, per=4.25%, avg=1477.60, stdev=801.59, samples=20 00:29:28.495 iops : min= 36, max= 512, avg=369.40, stdev=200.40, samples=20 00:29:28.495 lat (msec) : 20=0.38%, 50=94.93%, 100=0.05%, 250=0.81%, 500=3.83% 00:29:28.495 cpu : usr=98.62%, sys=0.96%, ctx=23, majf=0, minf=38 00:29:28.495 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3710,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename1: (groupid=0, jobs=1): err= 0: pid=4120590: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=365, BW=1463KiB/s (1498kB/s)(14.6MiB/10233msec) 00:29:28.495 slat (nsec): min=5825, max=93628, avg=23532.22, stdev=12083.81 00:29:28.495 clat (msec): min=8, max=407, avg=43.46, stdev=54.51 00:29:28.495 lat (msec): min=8, max=407, avg=43.48, stdev=54.51 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 22], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 40], 00:29:28.495 | 99.00th=[ 313], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 409], 00:29:28.495 | 99.99th=[ 409] 00:29:28.495 bw ( KiB/s): min= 128, max= 2048, per=4.29%, avg=1490.55, stdev=795.11, samples=20 00:29:28.495 iops : min= 32, max= 512, avg=372.60, stdev=198.76, samples=20 00:29:28.495 lat (msec) : 10=0.43%, 20=0.43%, 50=94.49%, 250=0.43%, 500=4.22% 00:29:28.495 cpu : usr=97.45%, sys=1.49%, ctx=67, majf=0, minf=69 00:29:28.495 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 issued rwts: total=3742,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.495 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.495 filename1: (groupid=0, jobs=1): err= 0: pid=4120591: Wed Nov 27 21:19:22 2024 00:29:28.495 read: IOPS=361, BW=1447KiB/s (1482kB/s)(14.4MiB/10216msec) 00:29:28.495 slat (nsec): min=7959, max=71117, avg=31637.42, stdev=9915.48 00:29:28.495 clat (msec): min=25, max=408, avg=43.93, stdev=56.16 00:29:28.495 lat (msec): min=25, max=408, avg=43.96, stdev=56.15 00:29:28.495 clat percentiles (msec): 00:29:28.495 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.495 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.495 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 43], 00:29:28.495 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 409], 99.95th=[ 409], 00:29:28.495 | 99.99th=[ 409] 00:29:28.495 bw ( KiB/s): min= 128, max= 2048, per=4.24%, avg=1472.00, stdev=807.94, samples=20 00:29:28.495 iops : min= 32, max= 512, avg=368.00, stdev=201.99, samples=20 00:29:28.495 lat (msec) : 50=95.18%, 100=0.05%, 250=0.87%, 500=3.90% 00:29:28.495 cpu : usr=98.11%, sys=1.08%, ctx=26, majf=0, minf=32 00:29:28.495 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.495 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.495 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3696,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename1: (groupid=0, jobs=1): err= 0: pid=4120592: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=362, BW=1450KiB/s (1485kB/s)(14.5MiB/10232msec) 00:29:28.496 slat (usec): min=5, max=186, avg=60.32, stdev=33.74 00:29:28.496 clat (msec): min=21, max=557, avg=43.52, stdev=56.44 00:29:28.496 lat (msec): min=21, max=557, avg=43.59, stdev=56.43 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.496 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 39], 00:29:28.496 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 409], 99.95th=[ 558], 00:29:28.496 | 99.99th=[ 558] 00:29:28.496 bw ( KiB/s): min= 128, max= 2048, per=4.25%, avg=1477.75, stdev=787.66, samples=20 00:29:28.496 iops : min= 32, max= 512, avg=369.40, stdev=196.90, samples=20 00:29:28.496 lat (msec) : 50=95.31%, 250=0.86%, 500=3.77%, 750=0.05% 00:29:28.496 cpu : usr=97.75%, sys=1.38%, ctx=64, majf=0, minf=27 00:29:28.496 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.496 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3710,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename1: (groupid=0, jobs=1): err= 0: pid=4120593: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=356, BW=1425KiB/s (1459kB/s)(14.2MiB/10197msec) 00:29:28.496 slat (usec): min=7, max=124, avg=56.65, stdev=29.43 00:29:28.496 clat (msec): min=22, max=542, avg=44.42, stdev=71.40 00:29:28.496 lat (msec): min=22, max=543, avg=44.47, stdev=71.40 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.496 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:28.496 | 99.00th=[ 447], 99.50th=[ 523], 99.90th=[ 542], 99.95th=[ 542], 00:29:28.496 | 99.99th=[ 542] 00:29:28.496 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=1446.40, stdev=836.88, samples=20 00:29:28.496 iops : min= 32, max= 512, avg=361.60, stdev=209.22, samples=20 00:29:28.496 lat (msec) : 50=96.48%, 100=0.44%, 500=2.20%, 750=0.88% 00:29:28.496 cpu : usr=98.60%, sys=0.97%, ctx=15, majf=0, minf=32 00:29:28.496 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.496 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3632,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename1: (groupid=0, jobs=1): err= 0: pid=4120594: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=360, BW=1441KiB/s (1475kB/s)(14.4MiB/10218msec) 00:29:28.496 slat (usec): min=6, max=116, avg=42.20, stdev=20.84 00:29:28.496 clat (msec): min=20, max=554, avg=44.04, stdev=59.55 00:29:28.496 lat (msec): min=20, max=554, avg=44.08, stdev=59.55 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.496 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 40], 00:29:28.496 | 99.00th=[ 351], 99.50th=[ 397], 99.90th=[ 468], 99.95th=[ 558], 00:29:28.496 | 99.99th=[ 558] 00:29:28.496 bw ( KiB/s): min= 128, max= 2048, per=4.22%, avg=1465.60, stdev=818.52, samples=20 00:29:28.496 iops : min= 32, max= 512, avg=366.40, stdev=204.63, samples=20 00:29:28.496 lat (msec) : 50=95.65%, 250=0.43%, 500=3.86%, 750=0.05% 00:29:28.496 cpu : usr=98.29%, sys=1.15%, ctx=48, majf=0, minf=38 00:29:28.496 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.496 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename1: (groupid=0, jobs=1): err= 0: pid=4120595: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=375, BW=1501KiB/s (1537kB/s)(14.9MiB/10193msec) 00:29:28.496 slat (usec): min=7, max=137, avg=35.75, stdev=34.63 00:29:28.496 clat (msec): min=14, max=545, avg=42.47, stdev=62.28 00:29:28.496 lat (msec): min=14, max=545, avg=42.51, stdev=62.27 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 27], 00:29:28.496 | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 33], 80.00th=[ 35], 90.00th=[ 39], 95.00th=[ 51], 00:29:28.496 | 99.00th=[ 397], 99.50th=[ 531], 99.90th=[ 542], 99.95th=[ 542], 00:29:28.496 | 99.99th=[ 542] 00:29:28.496 bw ( KiB/s): min= 176, max= 2160, per=4.62%, avg=1604.21, stdev=802.98, samples=19 00:29:28.496 iops : min= 44, max= 540, avg=401.05, stdev=200.74, samples=19 00:29:28.496 lat (msec) : 20=1.02%, 50=93.99%, 100=1.23%, 250=0.78%, 500=2.46% 00:29:28.496 lat (msec) : 750=0.52% 00:29:28.496 cpu : usr=98.54%, sys=1.00%, ctx=9, majf=0, minf=47 00:29:28.496 IO depths : 1=0.1%, 2=0.3%, 4=3.4%, 8=80.5%, 16=15.7%, 32=0.0%, >=64=0.0% 00:29:28.496 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 complete : 0=0.0%, 4=89.0%, 8=8.6%, 16=2.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3826,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename1: (groupid=0, jobs=1): err= 0: pid=4120596: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=359, BW=1436KiB/s (1471kB/s)(14.3MiB/10203msec) 00:29:28.496 slat (usec): min=8, max=132, avg=43.94, stdev=30.05 00:29:28.496 clat (msec): min=22, max=429, avg=44.18, stdev=61.17 00:29:28.496 lat (msec): min=22, max=429, avg=44.22, stdev=61.17 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.496 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 37], 00:29:28.496 | 99.00th=[ 393], 99.50th=[ 401], 99.90th=[ 430], 99.95th=[ 430], 00:29:28.496 | 99.99th=[ 430] 00:29:28.496 bw ( KiB/s): min= 128, max= 2048, per=4.20%, avg=1459.20, stdev=816.33, samples=20 00:29:28.496 iops : min= 32, max= 512, avg=364.80, stdev=204.08, samples=20 00:29:28.496 lat (msec) : 50=95.63%, 100=0.44%, 500=3.93% 00:29:28.496 cpu : usr=98.70%, sys=0.88%, ctx=14, majf=0, minf=21 00:29:28.496 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.496 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.496 issued rwts: total=3664,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.496 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.496 filename2: (groupid=0, jobs=1): err= 0: pid=4120597: Wed Nov 27 21:19:22 2024 00:29:28.496 read: IOPS=381, BW=1527KiB/s (1564kB/s)(15.3MiB/10234msec) 00:29:28.496 slat (usec): min=7, max=117, avg=35.37, stdev=17.51 00:29:28.496 clat (msec): min=8, max=414, avg=41.57, stdev=56.03 00:29:28.496 lat (msec): min=8, max=414, avg=41.60, stdev=56.02 00:29:28.496 clat percentiles (msec): 00:29:28.496 | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 31], 00:29:28.496 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.496 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 33], 95.00th=[ 39], 00:29:28.496 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 414], 00:29:28.496 | 99.99th=[ 414] 00:29:28.496 bw ( KiB/s): min= 128, max= 2544, per=4.48%, avg=1556.40, stdev=865.47, samples=20 00:29:28.496 iops : min= 32, max= 636, avg=389.10, stdev=216.37, samples=20 00:29:28.497 lat (msec) : 10=0.41%, 20=2.69%, 50=92.86%, 500=4.04% 00:29:28.497 cpu : usr=96.97%, sys=1.62%, ctx=160, majf=0, minf=25 00:29:28.497 IO depths : 1=4.7%, 2=9.6%, 4=20.8%, 8=57.0%, 16=7.9%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=92.9%, 8=1.5%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3907,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120598: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=363, BW=1453KiB/s (1488kB/s)(14.5MiB/10192msec) 00:29:28.497 slat (usec): min=7, max=143, avg=40.05, stdev=34.61 00:29:28.497 clat (msec): min=16, max=400, avg=43.50, stdev=55.64 00:29:28.497 lat (msec): min=16, max=400, avg=43.54, stdev=55.64 00:29:28.497 clat percentiles (msec): 00:29:28.497 | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 31], 00:29:28.497 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.497 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 37], 95.00th=[ 47], 00:29:28.497 | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 401], 00:29:28.497 | 99.99th=[ 401] 00:29:28.497 bw ( KiB/s): min= 176, max= 2112, per=4.24%, avg=1474.40, stdev=822.02, samples=20 00:29:28.497 iops : min= 44, max= 528, avg=368.60, stdev=205.50, samples=20 00:29:28.497 lat (msec) : 20=0.32%, 50=94.71%, 100=0.43%, 250=0.65%, 500=3.89% 00:29:28.497 cpu : usr=98.59%, sys=0.88%, ctx=23, majf=0, minf=28 00:29:28.497 IO depths : 1=2.8%, 2=5.8%, 4=13.0%, 8=66.5%, 16=11.8%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=91.3%, 8=5.1%, 16=3.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3702,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120599: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=360, BW=1441KiB/s (1475kB/s)(14.4MiB/10218msec) 00:29:28.497 slat (nsec): min=7954, max=73481, avg=27946.48, stdev=10990.35 00:29:28.497 clat (msec): min=20, max=547, avg=44.17, stdev=59.59 00:29:28.497 lat (msec): min=20, max=547, avg=44.20, stdev=59.59 00:29:28.497 clat percentiles (msec): 00:29:28.497 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.497 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.497 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 40], 00:29:28.497 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 468], 99.95th=[ 550], 00:29:28.497 | 99.99th=[ 550] 00:29:28.497 bw ( KiB/s): min= 128, max= 2048, per=4.22%, avg=1465.60, stdev=818.52, samples=20 00:29:28.497 iops : min= 32, max= 512, avg=366.40, stdev=204.63, samples=20 00:29:28.497 lat (msec) : 50=95.65%, 100=0.05%, 250=0.38%, 500=3.86%, 750=0.05% 00:29:28.497 cpu : usr=98.63%, sys=0.97%, ctx=9, majf=0, minf=34 00:29:28.497 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120600: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=360, BW=1441KiB/s (1475kB/s)(14.4MiB/10218msec) 00:29:28.497 slat (usec): min=8, max=153, avg=48.94, stdev=31.54 00:29:28.497 clat (msec): min=20, max=467, avg=43.77, stdev=58.41 00:29:28.497 lat (msec): min=20, max=467, avg=43.82, stdev=58.40 00:29:28.497 clat percentiles (msec): 00:29:28.497 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:28.497 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.497 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 39], 00:29:28.497 | 99.00th=[ 342], 99.50th=[ 401], 99.90th=[ 468], 99.95th=[ 468], 00:29:28.497 | 99.99th=[ 468] 00:29:28.497 bw ( KiB/s): min= 128, max= 2048, per=4.22%, avg=1465.60, stdev=818.52, samples=20 00:29:28.497 iops : min= 32, max= 512, avg=366.40, stdev=204.63, samples=20 00:29:28.497 lat (msec) : 50=95.71%, 250=0.38%, 500=3.91% 00:29:28.497 cpu : usr=96.49%, sys=1.96%, ctx=451, majf=0, minf=41 00:29:28.497 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120601: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=362, BW=1451KiB/s (1486kB/s)(14.5MiB/10232msec) 00:29:28.497 slat (usec): min=6, max=151, avg=35.89, stdev=23.38 00:29:28.497 clat (msec): min=21, max=361, avg=43.70, stdev=55.28 00:29:28.497 lat (msec): min=21, max=361, avg=43.73, stdev=55.28 00:29:28.497 clat percentiles (msec): 00:29:28.497 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.497 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.497 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 39], 00:29:28.497 | 99.00th=[ 342], 99.50th=[ 347], 99.90th=[ 351], 99.95th=[ 363], 00:29:28.497 | 99.99th=[ 363] 00:29:28.497 bw ( KiB/s): min= 128, max= 2048, per=4.26%, avg=1478.40, stdev=788.08, samples=20 00:29:28.497 iops : min= 32, max= 512, avg=369.60, stdev=197.02, samples=20 00:29:28.497 lat (msec) : 50=95.26%, 250=0.86%, 500=3.88% 00:29:28.497 cpu : usr=97.48%, sys=1.39%, ctx=117, majf=0, minf=28 00:29:28.497 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3712,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120602: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=356, BW=1425KiB/s (1459kB/s)(14.2MiB/10197msec) 00:29:28.497 slat (usec): min=7, max=114, avg=28.43, stdev=11.94 00:29:28.497 clat (msec): min=17, max=588, avg=44.67, stdev=71.61 00:29:28.497 lat (msec): min=17, max=588, avg=44.70, stdev=71.61 00:29:28.497 clat percentiles (msec): 00:29:28.497 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.497 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.497 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:28.497 | 99.00th=[ 447], 99.50th=[ 523], 99.90th=[ 542], 99.95th=[ 592], 00:29:28.497 | 99.99th=[ 592] 00:29:28.497 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=1446.40, stdev=836.77, samples=20 00:29:28.497 iops : min= 32, max= 512, avg=361.60, stdev=209.19, samples=20 00:29:28.497 lat (msec) : 20=0.06%, 50=96.42%, 100=0.44%, 500=2.15%, 750=0.94% 00:29:28.497 cpu : usr=98.49%, sys=0.93%, ctx=32, majf=0, minf=32 00:29:28.497 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:28.497 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.497 issued rwts: total=3632,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.497 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.497 filename2: (groupid=0, jobs=1): err= 0: pid=4120603: Wed Nov 27 21:19:22 2024 00:29:28.497 read: IOPS=358, BW=1435KiB/s (1470kB/s)(14.3MiB/10206msec) 00:29:28.498 slat (usec): min=8, max=118, avg=34.53, stdev=20.53 00:29:28.498 clat (msec): min=17, max=630, avg=44.27, stdev=61.81 00:29:28.498 lat (msec): min=17, max=630, avg=44.30, stdev=61.80 00:29:28.498 clat percentiles (msec): 00:29:28.498 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:28.498 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.498 | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 37], 00:29:28.498 | 99.00th=[ 393], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 634], 00:29:28.498 | 99.99th=[ 634] 00:29:28.498 bw ( KiB/s): min= 128, max= 2048, per=4.20%, avg=1458.40, stdev=817.58, samples=20 00:29:28.498 iops : min= 32, max= 512, avg=364.60, stdev=204.39, samples=20 00:29:28.498 lat (msec) : 20=0.05%, 50=95.63%, 100=0.44%, 500=3.82%, 750=0.05% 00:29:28.498 cpu : usr=98.65%, sys=0.91%, ctx=20, majf=0, minf=32 00:29:28.498 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:28.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.498 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.498 issued rwts: total=3662,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.498 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.498 filename2: (groupid=0, jobs=1): err= 0: pid=4120604: Wed Nov 27 21:19:22 2024 00:29:28.498 read: IOPS=356, BW=1425KiB/s (1459kB/s)(14.2MiB/10193msec) 00:29:28.498 slat (usec): min=7, max=150, avg=60.50, stdev=34.38 00:29:28.498 clat (msec): min=28, max=637, avg=44.37, stdev=71.74 00:29:28.498 lat (msec): min=29, max=637, avg=44.43, stdev=71.74 00:29:28.498 clat percentiles (msec): 00:29:28.498 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:28.498 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:28.498 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 34], 95.00th=[ 36], 00:29:28.498 | 99.00th=[ 447], 99.50th=[ 523], 99.90th=[ 592], 99.95th=[ 642], 00:29:28.498 | 99.99th=[ 642] 00:29:28.498 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=1446.40, stdev=836.77, samples=20 00:29:28.498 iops : min= 32, max= 512, avg=361.60, stdev=209.19, samples=20 00:29:28.498 lat (msec) : 50=96.48%, 100=0.44%, 500=2.15%, 750=0.94% 00:29:28.498 cpu : usr=97.73%, sys=1.33%, ctx=62, majf=0, minf=30 00:29:28.498 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:28.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.498 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:28.498 issued rwts: total=3632,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:28.498 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:28.498 00:29:28.498 Run status group 0 (all jobs): 00:29:28.498 READ: bw=33.9MiB/s (35.6MB/s), 1425KiB/s-1527KiB/s (1459kB/s-1564kB/s), io=347MiB (364MB), run=10137-10235msec 00:29:28.498 21:19:23 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:28.498 21:19:23 -- target/dif.sh@43 -- # local sub 00:29:28.498 21:19:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.498 21:19:23 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:28.498 21:19:23 -- target/dif.sh@36 -- # local sub_id=0 00:29:28.498 21:19:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.498 21:19:23 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:28.498 21:19:23 -- target/dif.sh@36 -- # local sub_id=1 00:29:28.498 21:19:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@45 -- # for sub in "$@" 00:29:28.498 21:19:23 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:28.498 21:19:23 -- target/dif.sh@36 -- # local sub_id=2 00:29:28.498 21:19:23 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # numjobs=2 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # iodepth=8 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # runtime=5 00:29:28.498 21:19:23 -- target/dif.sh@115 -- # files=1 00:29:28.498 21:19:23 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:28.498 21:19:23 -- target/dif.sh@28 -- # local sub 00:29:28.498 21:19:23 -- target/dif.sh@30 -- # for sub in "$@" 00:29:28.498 21:19:23 -- target/dif.sh@31 -- # create_subsystem 0 00:29:28.498 21:19:23 -- target/dif.sh@18 -- # local sub_id=0 00:29:28.498 21:19:23 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 bdev_null0 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 [2024-11-27 21:19:23.169906] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@30 -- # for sub in "$@" 00:29:28.498 21:19:23 -- target/dif.sh@31 -- # create_subsystem 1 00:29:28.498 21:19:23 -- target/dif.sh@18 -- # local sub_id=1 00:29:28.498 21:19:23 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 bdev_null1 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:28.498 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.498 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.498 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.498 21:19:23 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:28.499 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.499 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.499 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.499 21:19:23 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:28.499 21:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.499 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:29:28.499 21:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.499 21:19:23 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:28.499 21:19:23 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:28.499 21:19:23 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:28.499 21:19:23 -- nvmf/common.sh@520 -- # config=() 00:29:28.499 21:19:23 -- nvmf/common.sh@520 -- # local subsystem config 00:29:28.499 21:19:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:28.499 21:19:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:28.499 { 00:29:28.499 "params": { 00:29:28.499 "name": "Nvme$subsystem", 00:29:28.499 "trtype": "$TEST_TRANSPORT", 00:29:28.499 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:28.499 "adrfam": "ipv4", 00:29:28.499 "trsvcid": "$NVMF_PORT", 00:29:28.499 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:28.499 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:28.499 "hdgst": ${hdgst:-false}, 00:29:28.499 "ddgst": ${ddgst:-false} 00:29:28.499 }, 00:29:28.499 "method": "bdev_nvme_attach_controller" 00:29:28.499 } 00:29:28.499 EOF 00:29:28.499 )") 00:29:28.499 21:19:23 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:28.499 21:19:23 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:28.499 21:19:23 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:28.499 21:19:23 -- target/dif.sh@82 -- # gen_fio_conf 00:29:28.499 21:19:23 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:28.499 21:19:23 -- target/dif.sh@54 -- # local file 00:29:28.499 21:19:23 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:28.499 21:19:23 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.499 21:19:23 -- target/dif.sh@56 -- # cat 00:29:28.499 21:19:23 -- common/autotest_common.sh@1330 -- # shift 00:29:28.499 21:19:23 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:28.499 21:19:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:28.499 21:19:23 -- nvmf/common.sh@542 -- # cat 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:28.499 21:19:23 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:28.499 21:19:23 -- target/dif.sh@72 -- # (( file <= files )) 00:29:28.499 21:19:23 -- target/dif.sh@73 -- # cat 00:29:28.499 21:19:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:28.499 21:19:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:28.499 { 00:29:28.499 "params": { 00:29:28.499 "name": "Nvme$subsystem", 00:29:28.499 "trtype": "$TEST_TRANSPORT", 00:29:28.499 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:28.499 "adrfam": "ipv4", 00:29:28.499 "trsvcid": "$NVMF_PORT", 00:29:28.499 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:28.499 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:28.499 "hdgst": ${hdgst:-false}, 00:29:28.499 "ddgst": ${ddgst:-false} 00:29:28.499 }, 00:29:28.499 "method": "bdev_nvme_attach_controller" 00:29:28.499 } 00:29:28.499 EOF 00:29:28.499 )") 00:29:28.499 21:19:23 -- nvmf/common.sh@542 -- # cat 00:29:28.499 21:19:23 -- target/dif.sh@72 -- # (( file++ )) 00:29:28.499 21:19:23 -- target/dif.sh@72 -- # (( file <= files )) 00:29:28.499 21:19:23 -- nvmf/common.sh@544 -- # jq . 00:29:28.499 21:19:23 -- nvmf/common.sh@545 -- # IFS=, 00:29:28.499 21:19:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:28.499 "params": { 00:29:28.499 "name": "Nvme0", 00:29:28.499 "trtype": "tcp", 00:29:28.499 "traddr": "10.0.0.2", 00:29:28.499 "adrfam": "ipv4", 00:29:28.499 "trsvcid": "4420", 00:29:28.499 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:28.499 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:28.499 "hdgst": false, 00:29:28.499 "ddgst": false 00:29:28.499 }, 00:29:28.499 "method": "bdev_nvme_attach_controller" 00:29:28.499 },{ 00:29:28.499 "params": { 00:29:28.499 "name": "Nvme1", 00:29:28.499 "trtype": "tcp", 00:29:28.499 "traddr": "10.0.0.2", 00:29:28.499 "adrfam": "ipv4", 00:29:28.499 "trsvcid": "4420", 00:29:28.499 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:28.499 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:28.499 "hdgst": false, 00:29:28.499 "ddgst": false 00:29:28.499 }, 00:29:28.499 "method": "bdev_nvme_attach_controller" 00:29:28.499 }' 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:28.499 21:19:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:28.499 21:19:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:28.499 21:19:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:28.499 21:19:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:28.499 21:19:23 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:28.499 21:19:23 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:28.499 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:28.499 ... 00:29:28.499 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:28.499 ... 00:29:28.499 fio-3.35 00:29:28.499 Starting 4 threads 00:29:28.499 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.499 [2024-11-27 21:19:24.057269] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:28.499 [2024-11-27 21:19:24.057318] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:33.764 00:29:33.764 filename0: (groupid=0, jobs=1): err= 0: pid=4122033: Wed Nov 27 21:19:29 2024 00:29:33.764 read: IOPS=1863, BW=14.6MiB/s (15.3MB/s)(72.8MiB/5001msec) 00:29:33.764 slat (nsec): min=4802, max=68450, avg=17360.43, stdev=8842.06 00:29:33.764 clat (usec): min=614, max=7713, avg=4235.28, stdev=626.89 00:29:33.764 lat (usec): min=622, max=7732, avg=4252.64, stdev=627.13 00:29:33.764 clat percentiles (usec): 00:29:33.764 | 1.00th=[ 2671], 5.00th=[ 3359], 10.00th=[ 3654], 20.00th=[ 3916], 00:29:33.764 | 30.00th=[ 4015], 40.00th=[ 4113], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:33.764 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4817], 95.00th=[ 5276], 00:29:33.764 | 99.00th=[ 6587], 99.50th=[ 6849], 99.90th=[ 7308], 99.95th=[ 7439], 00:29:33.764 | 99.99th=[ 7701] 00:29:33.764 bw ( KiB/s): min=14224, max=15856, per=24.94%, avg=14938.56, stdev=577.66, samples=9 00:29:33.764 iops : min= 1778, max= 1982, avg=1867.22, stdev=72.06, samples=9 00:29:33.764 lat (usec) : 750=0.08%, 1000=0.11% 00:29:33.764 lat (msec) : 2=0.34%, 4=28.16%, 10=71.32% 00:29:33.764 cpu : usr=94.70%, sys=4.38%, ctx=175, majf=0, minf=9 00:29:33.764 IO depths : 1=0.1%, 2=9.5%, 4=62.7%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:33.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 issued rwts: total=9319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:33.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:33.764 filename0: (groupid=0, jobs=1): err= 0: pid=4122034: Wed Nov 27 21:19:29 2024 00:29:33.764 read: IOPS=1900, BW=14.8MiB/s (15.6MB/s)(74.3MiB/5003msec) 00:29:33.764 slat (nsec): min=5265, max=68224, avg=14209.96, stdev=8482.08 00:29:33.764 clat (usec): min=791, max=7714, avg=4163.93, stdev=648.73 00:29:33.764 lat (usec): min=803, max=7731, avg=4178.14, stdev=648.86 00:29:33.764 clat percentiles (usec): 00:29:33.764 | 1.00th=[ 2573], 5.00th=[ 3228], 10.00th=[ 3490], 20.00th=[ 3818], 00:29:33.764 | 30.00th=[ 3949], 40.00th=[ 4047], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:33.764 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4686], 95.00th=[ 5407], 00:29:33.764 | 99.00th=[ 6521], 99.50th=[ 6980], 99.90th=[ 7439], 99.95th=[ 7439], 00:29:33.764 | 99.99th=[ 7701] 00:29:33.764 bw ( KiB/s): min=14544, max=15824, per=25.38%, avg=15201.60, stdev=405.51, samples=10 00:29:33.764 iops : min= 1818, max= 1978, avg=1900.20, stdev=50.69, samples=10 00:29:33.764 lat (usec) : 1000=0.02% 00:29:33.764 lat (msec) : 2=0.22%, 4=35.39%, 10=64.37% 00:29:33.764 cpu : usr=94.04%, sys=5.40%, ctx=9, majf=0, minf=9 00:29:33.764 IO depths : 1=0.2%, 2=7.6%, 4=63.7%, 8=28.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:33.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 complete : 0=0.0%, 4=93.2%, 8=6.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 issued rwts: total=9506,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:33.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:33.764 filename1: (groupid=0, jobs=1): err= 0: pid=4122035: Wed Nov 27 21:19:29 2024 00:29:33.764 read: IOPS=1847, BW=14.4MiB/s (15.1MB/s)(72.8MiB/5042msec) 00:29:33.764 slat (nsec): min=4741, max=66082, avg=15316.70, stdev=8950.56 00:29:33.764 clat (usec): min=779, max=42477, avg=4255.29, stdev=937.71 00:29:33.764 lat (usec): min=792, max=42494, avg=4270.61, stdev=937.38 00:29:33.764 clat percentiles (usec): 00:29:33.764 | 1.00th=[ 2835], 5.00th=[ 3425], 10.00th=[ 3687], 20.00th=[ 3884], 00:29:33.764 | 30.00th=[ 3982], 40.00th=[ 4113], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:33.764 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4817], 95.00th=[ 5538], 00:29:33.764 | 99.00th=[ 6652], 99.50th=[ 6915], 99.90th=[ 7373], 99.95th=[ 7439], 00:29:33.764 | 99.99th=[42730] 00:29:33.764 bw ( KiB/s): min=14320, max=15728, per=24.87%, avg=14900.80, stdev=392.72, samples=10 00:29:33.764 iops : min= 1790, max= 1966, avg=1862.60, stdev=49.09, samples=10 00:29:33.764 lat (usec) : 1000=0.05% 00:29:33.764 lat (msec) : 2=0.31%, 4=29.95%, 10=69.65%, 50=0.03% 00:29:33.764 cpu : usr=94.25%, sys=5.18%, ctx=11, majf=0, minf=0 00:29:33.764 IO depths : 1=0.1%, 2=10.3%, 4=62.3%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:33.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.764 issued rwts: total=9316,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:33.764 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:33.765 filename1: (groupid=0, jobs=1): err= 0: pid=4122036: Wed Nov 27 21:19:29 2024 00:29:33.765 read: IOPS=1921, BW=15.0MiB/s (15.7MB/s)(75.1MiB/5003msec) 00:29:33.765 slat (nsec): min=4861, max=65992, avg=14590.40, stdev=8368.31 00:29:33.765 clat (usec): min=722, max=7836, avg=4115.52, stdev=656.79 00:29:33.765 lat (usec): min=734, max=7850, avg=4130.11, stdev=657.10 00:29:33.765 clat percentiles (usec): 00:29:33.765 | 1.00th=[ 2540], 5.00th=[ 3097], 10.00th=[ 3326], 20.00th=[ 3720], 00:29:33.765 | 30.00th=[ 3916], 40.00th=[ 4015], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:33.765 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4686], 95.00th=[ 5276], 00:29:33.765 | 99.00th=[ 6456], 99.50th=[ 6783], 99.90th=[ 7308], 99.95th=[ 7439], 00:29:33.765 | 99.99th=[ 7832] 00:29:33.765 bw ( KiB/s): min=14512, max=16992, per=25.66%, avg=15371.10, stdev=856.26, samples=10 00:29:33.765 iops : min= 1814, max= 2124, avg=1921.30, stdev=107.00, samples=10 00:29:33.765 lat (usec) : 750=0.01%, 1000=0.03% 00:29:33.765 lat (msec) : 2=0.21%, 4=37.64%, 10=62.11% 00:29:33.765 cpu : usr=94.34%, sys=5.12%, ctx=16, majf=0, minf=0 00:29:33.765 IO depths : 1=0.1%, 2=10.1%, 4=62.0%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:33.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.765 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:33.765 issued rwts: total=9611,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:33.765 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:33.765 00:29:33.765 Run status group 0 (all jobs): 00:29:33.765 READ: bw=58.5MiB/s (61.3MB/s), 14.4MiB/s-15.0MiB/s (15.1MB/s-15.7MB/s), io=295MiB (309MB), run=5001-5042msec 00:29:33.765 21:19:29 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:33.765 21:19:29 -- target/dif.sh@43 -- # local sub 00:29:33.765 21:19:29 -- target/dif.sh@45 -- # for sub in "$@" 00:29:33.765 21:19:29 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:33.765 21:19:29 -- target/dif.sh@36 -- # local sub_id=0 00:29:33.765 21:19:29 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@45 -- # for sub in "$@" 00:29:33.765 21:19:29 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:33.765 21:19:29 -- target/dif.sh@36 -- # local sub_id=1 00:29:33.765 21:19:29 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 00:29:33.765 real 0m24.572s 00:29:33.765 user 4m37.591s 00:29:33.765 sys 0m6.103s 00:29:33.765 21:19:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 ************************************ 00:29:33.765 END TEST fio_dif_rand_params 00:29:33.765 ************************************ 00:29:33.765 21:19:29 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:33.765 21:19:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:33.765 21:19:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 ************************************ 00:29:33.765 START TEST fio_dif_digest 00:29:33.765 ************************************ 00:29:33.765 21:19:29 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:33.765 21:19:29 -- target/dif.sh@123 -- # local NULL_DIF 00:29:33.765 21:19:29 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:33.765 21:19:29 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:33.765 21:19:29 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:33.765 21:19:29 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:33.765 21:19:29 -- target/dif.sh@127 -- # numjobs=3 00:29:33.765 21:19:29 -- target/dif.sh@127 -- # iodepth=3 00:29:33.765 21:19:29 -- target/dif.sh@127 -- # runtime=10 00:29:33.765 21:19:29 -- target/dif.sh@128 -- # hdgst=true 00:29:33.765 21:19:29 -- target/dif.sh@128 -- # ddgst=true 00:29:33.765 21:19:29 -- target/dif.sh@130 -- # create_subsystems 0 00:29:33.765 21:19:29 -- target/dif.sh@28 -- # local sub 00:29:33.765 21:19:29 -- target/dif.sh@30 -- # for sub in "$@" 00:29:33.765 21:19:29 -- target/dif.sh@31 -- # create_subsystem 0 00:29:33.765 21:19:29 -- target/dif.sh@18 -- # local sub_id=0 00:29:33.765 21:19:29 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 bdev_null0 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:33.765 21:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.765 21:19:29 -- common/autotest_common.sh@10 -- # set +x 00:29:33.765 [2024-11-27 21:19:29.630359] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:33.765 21:19:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:33.765 21:19:29 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:33.765 21:19:29 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:33.765 21:19:29 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:33.765 21:19:29 -- nvmf/common.sh@520 -- # config=() 00:29:33.765 21:19:29 -- nvmf/common.sh@520 -- # local subsystem config 00:29:33.765 21:19:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:33.765 21:19:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:33.765 { 00:29:33.765 "params": { 00:29:33.765 "name": "Nvme$subsystem", 00:29:33.765 "trtype": "$TEST_TRANSPORT", 00:29:33.765 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:33.765 "adrfam": "ipv4", 00:29:33.765 "trsvcid": "$NVMF_PORT", 00:29:33.765 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:33.765 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:33.765 "hdgst": ${hdgst:-false}, 00:29:33.765 "ddgst": ${ddgst:-false} 00:29:33.765 }, 00:29:33.765 "method": "bdev_nvme_attach_controller" 00:29:33.765 } 00:29:33.765 EOF 00:29:33.765 )") 00:29:33.765 21:19:29 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:33.765 21:19:29 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:33.765 21:19:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:33.765 21:19:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:33.765 21:19:29 -- target/dif.sh@82 -- # gen_fio_conf 00:29:33.765 21:19:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:33.765 21:19:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:33.765 21:19:29 -- target/dif.sh@54 -- # local file 00:29:33.765 21:19:29 -- common/autotest_common.sh@1330 -- # shift 00:29:33.765 21:19:29 -- target/dif.sh@56 -- # cat 00:29:33.765 21:19:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:33.765 21:19:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:33.765 21:19:29 -- nvmf/common.sh@542 -- # cat 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:33.765 21:19:29 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:33.765 21:19:29 -- target/dif.sh@72 -- # (( file <= files )) 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:33.765 21:19:29 -- nvmf/common.sh@544 -- # jq . 00:29:33.765 21:19:29 -- nvmf/common.sh@545 -- # IFS=, 00:29:33.765 21:19:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:33.765 "params": { 00:29:33.765 "name": "Nvme0", 00:29:33.765 "trtype": "tcp", 00:29:33.765 "traddr": "10.0.0.2", 00:29:33.765 "adrfam": "ipv4", 00:29:33.765 "trsvcid": "4420", 00:29:33.765 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:33.765 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:33.765 "hdgst": true, 00:29:33.765 "ddgst": true 00:29:33.765 }, 00:29:33.765 "method": "bdev_nvme_attach_controller" 00:29:33.765 }' 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:33.765 21:19:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:33.765 21:19:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:33.765 21:19:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:33.765 21:19:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:33.765 21:19:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:33.765 21:19:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:33.765 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:33.765 ... 00:29:33.765 fio-3.35 00:29:33.766 Starting 3 threads 00:29:33.766 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.024 [2024-11-27 21:19:30.231986] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:34.024 [2024-11-27 21:19:30.232068] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:46.217 00:29:46.217 filename0: (groupid=0, jobs=1): err= 0: pid=4122804: Wed Nov 27 21:19:40 2024 00:29:46.217 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10044msec) 00:29:46.217 slat (nsec): min=4529, max=28198, avg=13352.55, stdev=1551.76 00:29:46.217 clat (usec): min=9109, max=51675, avg=14076.68, stdev=1465.05 00:29:46.217 lat (usec): min=9122, max=51688, avg=14090.03, stdev=1465.08 00:29:46.217 clat percentiles (usec): 00:29:46.217 | 1.00th=[11731], 5.00th=[12518], 10.00th=[12911], 20.00th=[13304], 00:29:46.217 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:29:46.217 | 70.00th=[14484], 80.00th=[14746], 90.00th=[15270], 95.00th=[15664], 00:29:46.217 | 99.00th=[16909], 99.50th=[17171], 99.90th=[19006], 99.95th=[46924], 00:29:46.217 | 99.99th=[51643] 00:29:46.217 bw ( KiB/s): min=26368, max=27904, per=33.27%, avg=27302.40, stdev=471.86, samples=20 00:29:46.217 iops : min= 206, max= 218, avg=213.30, stdev= 3.69, samples=20 00:29:46.217 lat (msec) : 10=0.28%, 20=99.63%, 50=0.05%, 100=0.05% 00:29:46.217 cpu : usr=93.64%, sys=5.86%, ctx=23, majf=0, minf=172 00:29:46.217 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 issued rwts: total=2135,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.217 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.217 filename0: (groupid=0, jobs=1): err= 0: pid=4122805: Wed Nov 27 21:19:40 2024 00:29:46.217 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(270MiB/10045msec) 00:29:46.217 slat (nsec): min=4310, max=45123, avg=16029.11, stdev=4343.77 00:29:46.217 clat (usec): min=10488, max=55227, avg=13912.24, stdev=2115.79 00:29:46.217 lat (usec): min=10502, max=55240, avg=13928.27, stdev=2115.77 00:29:46.217 clat percentiles (usec): 00:29:46.217 | 1.00th=[11600], 5.00th=[12256], 10.00th=[12649], 20.00th=[13042], 00:29:46.217 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[13960], 00:29:46.217 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:29:46.217 | 99.00th=[16450], 99.50th=[17433], 99.90th=[54264], 99.95th=[54264], 00:29:46.217 | 99.99th=[55313] 00:29:46.217 bw ( KiB/s): min=24320, max=28416, per=33.66%, avg=27622.40, stdev=850.68, samples=20 00:29:46.217 iops : min= 190, max= 222, avg=215.80, stdev= 6.65, samples=20 00:29:46.217 lat (msec) : 20=99.63%, 50=0.19%, 100=0.19% 00:29:46.217 cpu : usr=88.99%, sys=8.46%, ctx=558, majf=0, minf=127 00:29:46.217 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 issued rwts: total=2160,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.217 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.217 filename0: (groupid=0, jobs=1): err= 0: pid=4122806: Wed Nov 27 21:19:40 2024 00:29:46.217 read: IOPS=213, BW=26.7MiB/s (28.0MB/s)(268MiB/10043msec) 00:29:46.217 slat (nsec): min=4154, max=29092, avg=13825.85, stdev=1445.37 00:29:46.217 clat (usec): min=8069, max=52480, avg=14016.31, stdev=1565.33 00:29:46.217 lat (usec): min=8082, max=52494, avg=14030.14, stdev=1565.35 00:29:46.217 clat percentiles (usec): 00:29:46.217 | 1.00th=[11469], 5.00th=[12387], 10.00th=[12780], 20.00th=[13173], 00:29:46.217 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:29:46.217 | 70.00th=[14484], 80.00th=[14746], 90.00th=[15270], 95.00th=[15664], 00:29:46.217 | 99.00th=[16581], 99.50th=[17171], 99.90th=[19792], 99.95th=[50070], 00:29:46.217 | 99.99th=[52691] 00:29:46.217 bw ( KiB/s): min=26164, max=29952, per=33.42%, avg=27420.20, stdev=737.69, samples=20 00:29:46.217 iops : min= 204, max= 234, avg=214.20, stdev= 5.80, samples=20 00:29:46.217 lat (msec) : 10=0.51%, 20=99.39%, 100=0.09% 00:29:46.217 cpu : usr=93.67%, sys=5.85%, ctx=31, majf=0, minf=98 00:29:46.217 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:46.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:46.217 issued rwts: total=2144,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:46.217 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:46.217 00:29:46.217 Run status group 0 (all jobs): 00:29:46.217 READ: bw=80.1MiB/s (84.0MB/s), 26.6MiB/s-26.9MiB/s (27.9MB/s-28.2MB/s), io=805MiB (844MB), run=10043-10045msec 00:29:46.217 21:19:40 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:46.217 21:19:40 -- target/dif.sh@43 -- # local sub 00:29:46.217 21:19:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:46.217 21:19:40 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:46.217 21:19:40 -- target/dif.sh@36 -- # local sub_id=0 00:29:46.217 21:19:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:46.217 21:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.217 21:19:40 -- common/autotest_common.sh@10 -- # set +x 00:29:46.217 21:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.217 21:19:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:46.217 21:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.217 21:19:40 -- common/autotest_common.sh@10 -- # set +x 00:29:46.217 21:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.217 00:29:46.217 real 0m11.033s 00:29:46.217 user 0m28.737s 00:29:46.217 sys 0m2.278s 00:29:46.217 21:19:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:46.217 21:19:40 -- common/autotest_common.sh@10 -- # set +x 00:29:46.217 ************************************ 00:29:46.217 END TEST fio_dif_digest 00:29:46.217 ************************************ 00:29:46.217 21:19:40 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:46.217 21:19:40 -- target/dif.sh@147 -- # nvmftestfini 00:29:46.217 21:19:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:46.217 21:19:40 -- nvmf/common.sh@116 -- # sync 00:29:46.217 21:19:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:46.217 21:19:40 -- nvmf/common.sh@119 -- # set +e 00:29:46.217 21:19:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:46.217 21:19:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:46.217 rmmod nvme_tcp 00:29:46.217 rmmod nvme_fabrics 00:29:46.217 rmmod nvme_keyring 00:29:46.217 21:19:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:46.217 21:19:40 -- nvmf/common.sh@123 -- # set -e 00:29:46.217 21:19:40 -- nvmf/common.sh@124 -- # return 0 00:29:46.218 21:19:40 -- nvmf/common.sh@477 -- # '[' -n 4116573 ']' 00:29:46.218 21:19:40 -- nvmf/common.sh@478 -- # killprocess 4116573 00:29:46.218 21:19:40 -- common/autotest_common.sh@936 -- # '[' -z 4116573 ']' 00:29:46.218 21:19:40 -- common/autotest_common.sh@940 -- # kill -0 4116573 00:29:46.218 21:19:40 -- common/autotest_common.sh@941 -- # uname 00:29:46.218 21:19:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:46.218 21:19:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4116573 00:29:46.218 21:19:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:46.218 21:19:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:46.218 21:19:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4116573' 00:29:46.218 killing process with pid 4116573 00:29:46.218 21:19:40 -- common/autotest_common.sh@955 -- # kill 4116573 00:29:46.218 21:19:40 -- common/autotest_common.sh@960 -- # wait 4116573 00:29:46.218 21:19:41 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:46.218 21:19:41 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:46.218 Waiting for block devices as requested 00:29:46.218 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:46.218 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:46.218 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:46.218 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:46.476 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:46.476 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:46.476 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:46.476 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:46.734 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:46.734 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:46.734 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:46.734 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:46.734 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:46.992 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:46.993 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:46.993 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:46.993 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:47.250 21:19:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:47.250 21:19:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:47.250 21:19:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:47.250 21:19:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:47.250 21:19:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:47.250 21:19:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:47.250 21:19:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:49.156 21:19:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:49.156 00:29:49.156 real 1m7.621s 00:29:49.156 user 6m35.421s 00:29:49.156 sys 0m17.267s 00:29:49.156 21:19:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.156 21:19:45 -- common/autotest_common.sh@10 -- # set +x 00:29:49.156 ************************************ 00:29:49.156 END TEST nvmf_dif 00:29:49.156 ************************************ 00:29:49.156 21:19:45 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:49.156 21:19:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:49.156 21:19:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:49.156 21:19:45 -- common/autotest_common.sh@10 -- # set +x 00:29:49.156 ************************************ 00:29:49.156 START TEST nvmf_abort_qd_sizes 00:29:49.156 ************************************ 00:29:49.156 21:19:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:49.415 * Looking for test storage... 00:29:49.415 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:49.415 21:19:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:49.415 21:19:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:49.415 21:19:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:49.415 21:19:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:49.415 21:19:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:49.415 21:19:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:49.415 21:19:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:49.415 21:19:45 -- scripts/common.sh@335 -- # IFS=.-: 00:29:49.415 21:19:45 -- scripts/common.sh@335 -- # read -ra ver1 00:29:49.415 21:19:45 -- scripts/common.sh@336 -- # IFS=.-: 00:29:49.415 21:19:45 -- scripts/common.sh@336 -- # read -ra ver2 00:29:49.415 21:19:45 -- scripts/common.sh@337 -- # local 'op=<' 00:29:49.415 21:19:45 -- scripts/common.sh@339 -- # ver1_l=2 00:29:49.415 21:19:45 -- scripts/common.sh@340 -- # ver2_l=1 00:29:49.415 21:19:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:49.415 21:19:45 -- scripts/common.sh@343 -- # case "$op" in 00:29:49.415 21:19:45 -- scripts/common.sh@344 -- # : 1 00:29:49.415 21:19:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:49.415 21:19:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:49.415 21:19:45 -- scripts/common.sh@364 -- # decimal 1 00:29:49.415 21:19:45 -- scripts/common.sh@352 -- # local d=1 00:29:49.415 21:19:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:49.415 21:19:45 -- scripts/common.sh@354 -- # echo 1 00:29:49.415 21:19:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:49.415 21:19:45 -- scripts/common.sh@365 -- # decimal 2 00:29:49.415 21:19:45 -- scripts/common.sh@352 -- # local d=2 00:29:49.415 21:19:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:49.415 21:19:45 -- scripts/common.sh@354 -- # echo 2 00:29:49.415 21:19:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:49.415 21:19:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:49.415 21:19:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:49.415 21:19:45 -- scripts/common.sh@367 -- # return 0 00:29:49.415 21:19:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:49.415 21:19:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:49.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.415 --rc genhtml_branch_coverage=1 00:29:49.415 --rc genhtml_function_coverage=1 00:29:49.415 --rc genhtml_legend=1 00:29:49.415 --rc geninfo_all_blocks=1 00:29:49.415 --rc geninfo_unexecuted_blocks=1 00:29:49.415 00:29:49.415 ' 00:29:49.415 21:19:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:49.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.415 --rc genhtml_branch_coverage=1 00:29:49.415 --rc genhtml_function_coverage=1 00:29:49.415 --rc genhtml_legend=1 00:29:49.415 --rc geninfo_all_blocks=1 00:29:49.415 --rc geninfo_unexecuted_blocks=1 00:29:49.415 00:29:49.415 ' 00:29:49.415 21:19:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:49.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.415 --rc genhtml_branch_coverage=1 00:29:49.415 --rc genhtml_function_coverage=1 00:29:49.415 --rc genhtml_legend=1 00:29:49.415 --rc geninfo_all_blocks=1 00:29:49.415 --rc geninfo_unexecuted_blocks=1 00:29:49.415 00:29:49.415 ' 00:29:49.415 21:19:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:49.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.415 --rc genhtml_branch_coverage=1 00:29:49.415 --rc genhtml_function_coverage=1 00:29:49.415 --rc genhtml_legend=1 00:29:49.415 --rc geninfo_all_blocks=1 00:29:49.415 --rc geninfo_unexecuted_blocks=1 00:29:49.415 00:29:49.415 ' 00:29:49.415 21:19:45 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:49.415 21:19:45 -- nvmf/common.sh@7 -- # uname -s 00:29:49.415 21:19:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:49.415 21:19:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:49.415 21:19:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:49.415 21:19:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:49.415 21:19:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:49.415 21:19:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:49.415 21:19:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:49.415 21:19:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:49.415 21:19:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:49.415 21:19:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:49.415 21:19:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:49.415 21:19:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:49.415 21:19:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:49.415 21:19:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:49.415 21:19:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:49.415 21:19:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:49.415 21:19:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:49.416 21:19:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:49.416 21:19:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:49.416 21:19:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.416 21:19:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.416 21:19:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.416 21:19:45 -- paths/export.sh@5 -- # export PATH 00:29:49.416 21:19:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.416 21:19:45 -- nvmf/common.sh@46 -- # : 0 00:29:49.416 21:19:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:49.416 21:19:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:49.416 21:19:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:49.416 21:19:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:49.416 21:19:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:49.416 21:19:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:49.416 21:19:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:49.416 21:19:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:49.416 21:19:45 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:49.416 21:19:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:49.416 21:19:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:49.416 21:19:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:49.416 21:19:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:49.416 21:19:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:49.416 21:19:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:49.416 21:19:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:49.416 21:19:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:49.416 21:19:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:49.416 21:19:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:49.416 21:19:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:49.416 21:19:45 -- common/autotest_common.sh@10 -- # set +x 00:29:51.376 21:19:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:51.376 21:19:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:51.376 21:19:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:51.376 21:19:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:51.376 21:19:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:51.376 21:19:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:51.376 21:19:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:51.376 21:19:47 -- nvmf/common.sh@294 -- # net_devs=() 00:29:51.376 21:19:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:51.376 21:19:47 -- nvmf/common.sh@295 -- # e810=() 00:29:51.376 21:19:47 -- nvmf/common.sh@295 -- # local -ga e810 00:29:51.376 21:19:47 -- nvmf/common.sh@296 -- # x722=() 00:29:51.376 21:19:47 -- nvmf/common.sh@296 -- # local -ga x722 00:29:51.376 21:19:47 -- nvmf/common.sh@297 -- # mlx=() 00:29:51.376 21:19:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:51.376 21:19:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:51.376 21:19:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:51.376 21:19:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:51.376 21:19:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:51.376 21:19:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:51.376 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:51.376 21:19:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:51.376 21:19:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:51.376 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:51.376 21:19:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:51.376 21:19:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:51.376 21:19:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:51.376 21:19:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:51.376 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:51.376 21:19:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:51.376 21:19:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:51.376 21:19:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:51.376 21:19:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:51.376 21:19:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:51.376 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:51.376 21:19:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:51.376 21:19:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:51.376 21:19:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:51.376 21:19:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:51.376 21:19:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:51.376 21:19:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:51.376 21:19:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:51.376 21:19:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:51.376 21:19:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:51.376 21:19:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:51.376 21:19:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:51.376 21:19:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:51.376 21:19:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:51.376 21:19:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:51.376 21:19:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:51.377 21:19:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:51.377 21:19:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:51.377 21:19:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:51.377 21:19:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:51.377 21:19:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:51.377 21:19:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:51.377 21:19:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:51.377 21:19:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:51.377 21:19:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:51.377 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:51.377 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:29:51.377 00:29:51.377 --- 10.0.0.2 ping statistics --- 00:29:51.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:51.377 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:29:51.377 21:19:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:51.377 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:51.377 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:29:51.377 00:29:51.377 --- 10.0.0.1 ping statistics --- 00:29:51.377 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:51.377 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:29:51.377 21:19:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:51.377 21:19:47 -- nvmf/common.sh@410 -- # return 0 00:29:51.377 21:19:47 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:51.377 21:19:47 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:52.753 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:52.753 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:52.753 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:52.753 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:52.754 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:52.754 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:52.754 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:52.754 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:52.754 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:53.689 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:53.689 21:19:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:53.689 21:19:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:53.689 21:19:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:53.689 21:19:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:53.689 21:19:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:53.689 21:19:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:53.689 21:19:49 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:53.689 21:19:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:53.689 21:19:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:53.689 21:19:49 -- common/autotest_common.sh@10 -- # set +x 00:29:53.689 21:19:49 -- nvmf/common.sh@469 -- # nvmfpid=4127826 00:29:53.689 21:19:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:53.689 21:19:49 -- nvmf/common.sh@470 -- # waitforlisten 4127826 00:29:53.689 21:19:49 -- common/autotest_common.sh@829 -- # '[' -z 4127826 ']' 00:29:53.689 21:19:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:53.689 21:19:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:53.689 21:19:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:53.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:53.689 21:19:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:53.689 21:19:49 -- common/autotest_common.sh@10 -- # set +x 00:29:53.947 [2024-11-27 21:19:49.930946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:53.947 [2024-11-27 21:19:49.931025] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:53.947 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.947 [2024-11-27 21:19:49.994521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:53.947 [2024-11-27 21:19:50.123705] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:53.947 [2024-11-27 21:19:50.123863] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:53.947 [2024-11-27 21:19:50.123882] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:53.947 [2024-11-27 21:19:50.123895] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:53.947 [2024-11-27 21:19:50.123945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.947 [2024-11-27 21:19:50.124015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:53.947 [2024-11-27 21:19:50.124082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:53.947 [2024-11-27 21:19:50.124084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:54.881 21:19:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:54.882 21:19:50 -- common/autotest_common.sh@862 -- # return 0 00:29:54.882 21:19:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:54.882 21:19:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:54.882 21:19:50 -- common/autotest_common.sh@10 -- # set +x 00:29:54.882 21:19:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:54.882 21:19:50 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:54.882 21:19:50 -- scripts/common.sh@312 -- # local nvmes 00:29:54.882 21:19:50 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:54.882 21:19:50 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:54.882 21:19:50 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:54.882 21:19:50 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:54.882 21:19:50 -- scripts/common.sh@322 -- # uname -s 00:29:54.882 21:19:50 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:54.882 21:19:50 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:54.882 21:19:50 -- scripts/common.sh@327 -- # (( 1 )) 00:29:54.882 21:19:50 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:54.882 21:19:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:54.882 21:19:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:54.882 21:19:50 -- common/autotest_common.sh@10 -- # set +x 00:29:54.882 ************************************ 00:29:54.882 START TEST spdk_target_abort 00:29:54.882 ************************************ 00:29:54.882 21:19:50 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:54.882 21:19:50 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:54.882 21:19:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.882 21:19:50 -- common/autotest_common.sh@10 -- # set +x 00:29:58.162 spdk_targetn1 00:29:58.162 21:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.162 21:19:53 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:58.162 21:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.162 21:19:53 -- common/autotest_common.sh@10 -- # set +x 00:29:58.162 [2024-11-27 21:19:53.786690] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:58.162 21:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.162 21:19:53 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:58.162 21:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.162 21:19:53 -- common/autotest_common.sh@10 -- # set +x 00:29:58.162 21:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.162 21:19:53 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:58.162 21:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.162 21:19:53 -- common/autotest_common.sh@10 -- # set +x 00:29:58.162 21:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.162 21:19:53 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:58.162 21:19:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.162 21:19:53 -- common/autotest_common.sh@10 -- # set +x 00:29:58.162 [2024-11-27 21:19:53.819011] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:58.162 21:19:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:58.163 21:19:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:58.163 EAL: No free 2048 kB hugepages reported on node 1 00:30:01.444 Initializing NVMe Controllers 00:30:01.444 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:01.444 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:01.444 Initialization complete. Launching workers. 00:30:01.444 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11757, failed: 0 00:30:01.444 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1249, failed to submit 10508 00:30:01.444 success 712, unsuccess 537, failed 0 00:30:01.444 21:19:57 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:01.444 21:19:57 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:01.444 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.722 Initializing NVMe Controllers 00:30:04.722 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:04.722 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:04.722 Initialization complete. Launching workers. 00:30:04.722 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8664, failed: 0 00:30:04.722 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1208, failed to submit 7456 00:30:04.722 success 358, unsuccess 850, failed 0 00:30:04.722 21:20:00 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:04.722 21:20:00 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:04.722 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.003 Initializing NVMe Controllers 00:30:08.003 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:08.003 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:08.003 Initialization complete. Launching workers. 00:30:08.003 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32609, failed: 0 00:30:08.003 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2644, failed to submit 29965 00:30:08.003 success 550, unsuccess 2094, failed 0 00:30:08.003 21:20:03 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:08.003 21:20:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.003 21:20:03 -- common/autotest_common.sh@10 -- # set +x 00:30:08.003 21:20:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.003 21:20:03 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:08.003 21:20:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.003 21:20:03 -- common/autotest_common.sh@10 -- # set +x 00:30:08.937 21:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.937 21:20:04 -- target/abort_qd_sizes.sh@62 -- # killprocess 4127826 00:30:08.937 21:20:04 -- common/autotest_common.sh@936 -- # '[' -z 4127826 ']' 00:30:08.937 21:20:04 -- common/autotest_common.sh@940 -- # kill -0 4127826 00:30:08.937 21:20:04 -- common/autotest_common.sh@941 -- # uname 00:30:08.937 21:20:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.937 21:20:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4127826 00:30:08.937 21:20:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:08.937 21:20:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:08.937 21:20:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4127826' 00:30:08.937 killing process with pid 4127826 00:30:08.937 21:20:04 -- common/autotest_common.sh@955 -- # kill 4127826 00:30:08.937 21:20:04 -- common/autotest_common.sh@960 -- # wait 4127826 00:30:08.937 00:30:08.937 real 0m14.212s 00:30:08.937 user 0m56.613s 00:30:08.937 sys 0m2.393s 00:30:08.937 21:20:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:08.937 21:20:05 -- common/autotest_common.sh@10 -- # set +x 00:30:08.937 ************************************ 00:30:08.937 END TEST spdk_target_abort 00:30:08.937 ************************************ 00:30:09.196 21:20:05 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:09.196 21:20:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:09.196 21:20:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:09.196 21:20:05 -- common/autotest_common.sh@10 -- # set +x 00:30:09.196 ************************************ 00:30:09.196 START TEST kernel_target_abort 00:30:09.196 ************************************ 00:30:09.196 21:20:05 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:09.196 21:20:05 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:09.196 21:20:05 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:09.196 21:20:05 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:09.196 21:20:05 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:09.196 21:20:05 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:09.196 21:20:05 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:09.196 21:20:05 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:09.196 21:20:05 -- nvmf/common.sh@627 -- # local block nvme 00:30:09.196 21:20:05 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:09.196 21:20:05 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:09.196 21:20:05 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:09.196 21:20:05 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:10.129 Waiting for block devices as requested 00:30:10.129 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:10.387 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:10.387 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:10.387 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:10.646 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:10.646 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:10.646 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:10.646 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:10.903 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:10.903 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:10.904 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:10.904 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:11.162 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:11.162 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:11.162 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:11.162 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:11.162 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:11.421 21:20:07 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:11.421 21:20:07 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:11.421 21:20:07 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:11.421 21:20:07 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:11.421 21:20:07 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:11.421 No valid GPT data, bailing 00:30:11.421 21:20:07 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:11.421 21:20:07 -- scripts/common.sh@393 -- # pt= 00:30:11.421 21:20:07 -- scripts/common.sh@394 -- # return 1 00:30:11.421 21:20:07 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:11.421 21:20:07 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:11.421 21:20:07 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:11.421 21:20:07 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:11.421 21:20:07 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:11.421 21:20:07 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:11.421 21:20:07 -- nvmf/common.sh@654 -- # echo 1 00:30:11.421 21:20:07 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:11.421 21:20:07 -- nvmf/common.sh@656 -- # echo 1 00:30:11.421 21:20:07 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:11.421 21:20:07 -- nvmf/common.sh@663 -- # echo tcp 00:30:11.421 21:20:07 -- nvmf/common.sh@664 -- # echo 4420 00:30:11.421 21:20:07 -- nvmf/common.sh@665 -- # echo ipv4 00:30:11.421 21:20:07 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:11.421 21:20:07 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:11.421 00:30:11.421 Discovery Log Number of Records 2, Generation counter 2 00:30:11.421 =====Discovery Log Entry 0====== 00:30:11.421 trtype: tcp 00:30:11.421 adrfam: ipv4 00:30:11.421 subtype: current discovery subsystem 00:30:11.421 treq: not specified, sq flow control disable supported 00:30:11.421 portid: 1 00:30:11.421 trsvcid: 4420 00:30:11.421 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:11.421 traddr: 10.0.0.1 00:30:11.421 eflags: none 00:30:11.421 sectype: none 00:30:11.421 =====Discovery Log Entry 1====== 00:30:11.421 trtype: tcp 00:30:11.421 adrfam: ipv4 00:30:11.421 subtype: nvme subsystem 00:30:11.421 treq: not specified, sq flow control disable supported 00:30:11.421 portid: 1 00:30:11.421 trsvcid: 4420 00:30:11.421 subnqn: kernel_target 00:30:11.421 traddr: 10.0.0.1 00:30:11.421 eflags: none 00:30:11.421 sectype: none 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:11.421 21:20:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:11.678 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.980 Initializing NVMe Controllers 00:30:14.980 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:14.980 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:14.980 Initialization complete. Launching workers. 00:30:14.980 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 42162, failed: 0 00:30:14.980 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 42162, failed to submit 0 00:30:14.980 success 0, unsuccess 42162, failed 0 00:30:14.980 21:20:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:14.980 21:20:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:14.980 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.264 Initializing NVMe Controllers 00:30:18.264 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:18.264 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:18.264 Initialization complete. Launching workers. 00:30:18.264 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81399, failed: 0 00:30:18.264 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20522, failed to submit 60877 00:30:18.264 success 0, unsuccess 20522, failed 0 00:30:18.264 21:20:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:18.264 21:20:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:18.264 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.793 Initializing NVMe Controllers 00:30:20.793 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:20.793 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:20.793 Initialization complete. Launching workers. 00:30:20.793 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 76948, failed: 0 00:30:20.793 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19210, failed to submit 57738 00:30:20.793 success 0, unsuccess 19210, failed 0 00:30:20.793 21:20:16 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:20.793 21:20:16 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:20.793 21:20:16 -- nvmf/common.sh@677 -- # echo 0 00:30:20.793 21:20:17 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:20.794 21:20:17 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:20.794 21:20:17 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:20.794 21:20:17 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:20.794 21:20:17 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:20.794 21:20:17 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:21.052 00:30:21.052 real 0m11.848s 00:30:21.052 user 0m5.543s 00:30:21.052 sys 0m2.364s 00:30:21.052 21:20:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:21.052 21:20:17 -- common/autotest_common.sh@10 -- # set +x 00:30:21.052 ************************************ 00:30:21.052 END TEST kernel_target_abort 00:30:21.052 ************************************ 00:30:21.052 21:20:17 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:21.052 21:20:17 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:21.052 21:20:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:21.052 21:20:17 -- nvmf/common.sh@116 -- # sync 00:30:21.052 21:20:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:21.052 21:20:17 -- nvmf/common.sh@119 -- # set +e 00:30:21.052 21:20:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:21.052 21:20:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:21.052 rmmod nvme_tcp 00:30:21.052 rmmod nvme_fabrics 00:30:21.052 rmmod nvme_keyring 00:30:21.052 21:20:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:21.052 21:20:17 -- nvmf/common.sh@123 -- # set -e 00:30:21.052 21:20:17 -- nvmf/common.sh@124 -- # return 0 00:30:21.052 21:20:17 -- nvmf/common.sh@477 -- # '[' -n 4127826 ']' 00:30:21.052 21:20:17 -- nvmf/common.sh@478 -- # killprocess 4127826 00:30:21.052 21:20:17 -- common/autotest_common.sh@936 -- # '[' -z 4127826 ']' 00:30:21.052 21:20:17 -- common/autotest_common.sh@940 -- # kill -0 4127826 00:30:21.052 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4127826) - No such process 00:30:21.052 21:20:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4127826 is not found' 00:30:21.052 Process with pid 4127826 is not found 00:30:21.052 21:20:17 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:21.053 21:20:17 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:22.430 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:22.430 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:22.430 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:22.430 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:22.430 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:22.430 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:22.430 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:22.430 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:22.430 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:22.430 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:22.430 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:22.430 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:22.430 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:22.430 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:22.430 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:22.430 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:22.430 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:22.430 21:20:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:22.430 21:20:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:22.430 21:20:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:22.430 21:20:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:22.430 21:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:22.430 21:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:22.430 21:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:24.959 21:20:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:24.959 00:30:24.959 real 0m35.261s 00:30:24.959 user 1m4.561s 00:30:24.959 sys 0m8.181s 00:30:24.959 21:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:24.959 21:20:20 -- common/autotest_common.sh@10 -- # set +x 00:30:24.959 ************************************ 00:30:24.959 END TEST nvmf_abort_qd_sizes 00:30:24.959 ************************************ 00:30:24.959 21:20:20 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:24.959 21:20:20 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:24.959 21:20:20 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:24.959 21:20:20 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:24.959 21:20:20 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:24.959 21:20:20 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:24.959 21:20:20 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:24.959 21:20:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:24.959 21:20:20 -- common/autotest_common.sh@10 -- # set +x 00:30:24.959 21:20:20 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:24.959 21:20:20 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:24.959 21:20:20 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:24.959 21:20:20 -- common/autotest_common.sh@10 -- # set +x 00:30:26.332 INFO: APP EXITING 00:30:26.332 INFO: killing all VMs 00:30:26.332 INFO: killing vhost app 00:30:26.332 INFO: EXIT DONE 00:30:27.707 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:27.707 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:27.707 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:27.707 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:27.707 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:27.707 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:27.707 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:27.707 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:27.707 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:27.707 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:27.707 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:27.707 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:27.707 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:27.707 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:27.707 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:27.707 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:27.707 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:29.082 Cleaning 00:30:29.082 Removing: /var/run/dpdk/spdk0/config 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:29.082 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:29.082 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:29.082 Removing: /var/run/dpdk/spdk1/config 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:29.082 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:29.082 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:29.082 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:29.082 Removing: /var/run/dpdk/spdk2/config 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:29.082 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:29.082 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:29.082 Removing: /var/run/dpdk/spdk3/config 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:29.082 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:29.082 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:29.082 Removing: /var/run/dpdk/spdk4/config 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:29.082 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:29.082 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:29.082 Removing: /dev/shm/bdev_svc_trace.1 00:30:29.082 Removing: /dev/shm/nvmf_trace.0 00:30:29.082 Removing: /dev/shm/spdk_tgt_trace.pid3859047 00:30:29.082 Removing: /var/run/dpdk/spdk0 00:30:29.082 Removing: /var/run/dpdk/spdk1 00:30:29.082 Removing: /var/run/dpdk/spdk2 00:30:29.082 Removing: /var/run/dpdk/spdk3 00:30:29.082 Removing: /var/run/dpdk/spdk4 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3856711 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3857707 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3859047 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3859569 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3860890 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3861848 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3862174 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3862499 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3862828 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3863060 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3863219 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3863399 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3863687 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3864152 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3866708 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3867009 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3867182 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3867322 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3867763 00:30:29.082 Removing: /var/run/dpdk/spdk_pid3867904 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3868216 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3868358 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3868649 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3868789 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3868965 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3869101 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3869481 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3869643 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3869965 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870153 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870276 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870360 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870498 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870778 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3870926 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3871087 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3871344 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3871511 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3871653 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3871933 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872075 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872242 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872441 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872654 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872808 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3872979 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3873226 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3873391 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3873538 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3873812 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3873964 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3874121 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3874384 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3874541 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3874693 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3874967 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3875111 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3875275 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3875499 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3875694 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3875842 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876028 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876260 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876423 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876638 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876855 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3876996 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3877255 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3877433 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3877594 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3877777 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3878022 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3878219 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3878432 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3880659 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3937844 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3940512 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3948352 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3951743 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3954136 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3954555 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3959769 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3960053 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3962738 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3966516 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3968754 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3975515 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3980931 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3982400 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3983585 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3994225 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3996483 00:30:29.341 Removing: /var/run/dpdk/spdk_pid3999453 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4000669 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4002035 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4002309 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4002460 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4002733 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4003329 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4004700 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4005724 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4006179 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4009814 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4013404 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4017664 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4041487 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4044953 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4048809 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4049897 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4051019 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4053731 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4056265 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4060667 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4060675 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4063639 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4063820 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4064038 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4064318 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4064323 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4065436 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4066653 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4067875 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4069145 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4070423 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4071644 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4075539 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4075953 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4077942 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4078697 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4082498 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4084665 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4088281 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4091922 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4095599 00:30:29.341 Removing: /var/run/dpdk/spdk_pid4096016 00:30:29.342 Removing: /var/run/dpdk/spdk_pid4096557 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4096979 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4097570 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4098125 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4098683 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4099232 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4101902 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4102052 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4105923 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4106101 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4107986 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4113673 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4113678 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4116754 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4118195 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4119633 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4120398 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4121846 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4122742 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4128270 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4128670 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4129074 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4130553 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4130965 00:30:29.600 Removing: /var/run/dpdk/spdk_pid4131371 00:30:29.600 Clean 00:30:29.600 killing process with pid 3828770 00:30:37.776 killing process with pid 3828767 00:30:37.776 killing process with pid 3828769 00:30:37.776 killing process with pid 3828768 00:30:37.776 21:20:33 -- common/autotest_common.sh@1446 -- # return 0 00:30:37.776 21:20:33 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:37.776 21:20:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:37.776 21:20:33 -- common/autotest_common.sh@10 -- # set +x 00:30:37.776 21:20:33 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:37.776 21:20:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:37.776 21:20:33 -- common/autotest_common.sh@10 -- # set +x 00:30:37.776 21:20:34 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:37.776 21:20:34 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:37.776 21:20:34 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:38.034 21:20:34 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:38.034 21:20:34 -- spdk/autotest.sh@383 -- # hostname 00:30:38.034 21:20:34 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:38.034 geninfo: WARNING: invalid characters removed from testname! 00:31:04.579 21:20:59 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:07.859 21:21:03 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:10.394 21:21:06 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:12.926 21:21:09 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:15.457 21:21:11 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:18.747 21:21:14 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:21.281 21:21:16 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:21.281 21:21:16 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:21.281 21:21:16 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:21.281 21:21:16 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:21.281 21:21:17 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:21.281 21:21:17 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:21.281 21:21:17 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:21.281 21:21:17 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:21.281 21:21:17 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:21.281 21:21:17 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:21.281 21:21:17 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:21.281 21:21:17 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:21.281 21:21:17 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:21.281 21:21:17 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:21.281 21:21:17 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:21.281 21:21:17 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:21.281 21:21:17 -- scripts/common.sh@343 -- $ case "$op" in 00:31:21.281 21:21:17 -- scripts/common.sh@344 -- $ : 1 00:31:21.281 21:21:17 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:21.281 21:21:17 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:21.281 21:21:17 -- scripts/common.sh@364 -- $ decimal 1 00:31:21.281 21:21:17 -- scripts/common.sh@352 -- $ local d=1 00:31:21.281 21:21:17 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:21.281 21:21:17 -- scripts/common.sh@354 -- $ echo 1 00:31:21.281 21:21:17 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:21.281 21:21:17 -- scripts/common.sh@365 -- $ decimal 2 00:31:21.281 21:21:17 -- scripts/common.sh@352 -- $ local d=2 00:31:21.281 21:21:17 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:21.281 21:21:17 -- scripts/common.sh@354 -- $ echo 2 00:31:21.281 21:21:17 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:21.281 21:21:17 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:21.281 21:21:17 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:21.281 21:21:17 -- scripts/common.sh@367 -- $ return 0 00:31:21.281 21:21:17 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:21.281 21:21:17 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:21.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:21.281 --rc genhtml_branch_coverage=1 00:31:21.281 --rc genhtml_function_coverage=1 00:31:21.281 --rc genhtml_legend=1 00:31:21.281 --rc geninfo_all_blocks=1 00:31:21.281 --rc geninfo_unexecuted_blocks=1 00:31:21.281 00:31:21.281 ' 00:31:21.281 21:21:17 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:21.281 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:21.282 --rc genhtml_branch_coverage=1 00:31:21.282 --rc genhtml_function_coverage=1 00:31:21.282 --rc genhtml_legend=1 00:31:21.282 --rc geninfo_all_blocks=1 00:31:21.282 --rc geninfo_unexecuted_blocks=1 00:31:21.282 00:31:21.282 ' 00:31:21.282 21:21:17 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:21.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:21.282 --rc genhtml_branch_coverage=1 00:31:21.282 --rc genhtml_function_coverage=1 00:31:21.282 --rc genhtml_legend=1 00:31:21.282 --rc geninfo_all_blocks=1 00:31:21.282 --rc geninfo_unexecuted_blocks=1 00:31:21.282 00:31:21.282 ' 00:31:21.282 21:21:17 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:21.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:21.282 --rc genhtml_branch_coverage=1 00:31:21.282 --rc genhtml_function_coverage=1 00:31:21.282 --rc genhtml_legend=1 00:31:21.282 --rc geninfo_all_blocks=1 00:31:21.282 --rc geninfo_unexecuted_blocks=1 00:31:21.282 00:31:21.282 ' 00:31:21.282 21:21:17 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:21.282 21:21:17 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:21.282 21:21:17 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:21.282 21:21:17 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:21.282 21:21:17 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.282 21:21:17 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.282 21:21:17 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.282 21:21:17 -- paths/export.sh@5 -- $ export PATH 00:31:21.282 21:21:17 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.282 21:21:17 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:21.282 21:21:17 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:21.282 21:21:17 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732738877.XXXXXX 00:31:21.282 21:21:17 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732738877.XDGz2h 00:31:21.282 21:21:17 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:21.282 21:21:17 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:21.282 21:21:17 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:21.282 21:21:17 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:21.282 21:21:17 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:21.282 21:21:17 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:21.282 21:21:17 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:21.282 21:21:17 -- common/autotest_common.sh@10 -- $ set +x 00:31:21.282 21:21:17 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:21.282 21:21:17 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:21.282 21:21:17 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:21.282 21:21:17 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:21.282 21:21:17 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:21.282 21:21:17 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:21.282 21:21:17 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:21.282 21:21:17 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:21.282 21:21:17 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:21.282 21:21:17 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:21.282 21:21:17 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:21.282 + [[ -n 3786469 ]] 00:31:21.282 + sudo kill 3786469 00:31:21.291 [Pipeline] } 00:31:21.306 [Pipeline] // stage 00:31:21.312 [Pipeline] } 00:31:21.326 [Pipeline] // timeout 00:31:21.330 [Pipeline] } 00:31:21.343 [Pipeline] // catchError 00:31:21.347 [Pipeline] } 00:31:21.360 [Pipeline] // wrap 00:31:21.365 [Pipeline] } 00:31:21.376 [Pipeline] // catchError 00:31:21.384 [Pipeline] stage 00:31:21.386 [Pipeline] { (Epilogue) 00:31:21.398 [Pipeline] catchError 00:31:21.399 [Pipeline] { 00:31:21.411 [Pipeline] echo 00:31:21.413 Cleanup processes 00:31:21.420 [Pipeline] sh 00:31:21.704 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:21.704 4143964 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:21.718 [Pipeline] sh 00:31:21.999 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:22.000 ++ grep -v 'sudo pgrep' 00:31:22.000 ++ awk '{print $1}' 00:31:22.000 + sudo kill -9 00:31:22.000 + true 00:31:22.011 [Pipeline] sh 00:31:22.293 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:32.275 [Pipeline] sh 00:31:32.564 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:32.564 Artifacts sizes are good 00:31:32.581 [Pipeline] archiveArtifacts 00:31:32.591 Archiving artifacts 00:31:32.776 [Pipeline] sh 00:31:33.120 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:33.140 [Pipeline] cleanWs 00:31:33.149 [WS-CLEANUP] Deleting project workspace... 00:31:33.149 [WS-CLEANUP] Deferred wipeout is used... 00:31:33.154 [WS-CLEANUP] done 00:31:33.156 [Pipeline] } 00:31:33.168 [Pipeline] // catchError 00:31:33.177 [Pipeline] sh 00:31:33.453 + logger -p user.info -t JENKINS-CI 00:31:33.462 [Pipeline] } 00:31:33.480 [Pipeline] // stage 00:31:33.487 [Pipeline] } 00:31:33.505 [Pipeline] // node 00:31:33.513 [Pipeline] End of Pipeline 00:31:33.565 Finished: SUCCESS